Jul 07 16:10:39.486484 ip-10-0-134-97 systemd[1]: Starting Kubernetes Kubelet... Jul 07 16:10:39.832572 ip-10-0-134-97 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:10:39.832572 ip-10-0-134-97 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 16:10:39.832572 ip-10-0-134-97 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:10:39.832572 ip-10-0-134-97 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 16:10:39.832572 ip-10-0-134-97 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 16:10:39.834648 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.834489 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 16:10:39.841802 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841782 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:10:39.841802 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841801 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841805 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841809 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841813 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841816 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841819 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841823 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841829 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841834 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841838 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841841 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841845 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841848 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841851 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841854 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841857 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841859 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841862 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841865 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:10:39.841880 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841868 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841871 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841874 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841877 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841880 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841883 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841886 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841889 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841892 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841896 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841899 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841902 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841905 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841908 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841911 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841913 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841916 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841919 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841923 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841926 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:10:39.842376 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841929 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841931 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841934 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841937 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841939 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841942 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841945 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841947 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841950 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841953 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841956 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841959 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841962 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841965 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841969 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841972 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841975 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841978 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841981 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841984 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:10:39.842926 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841986 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841991 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841994 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.841998 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842001 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842004 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842007 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842009 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842012 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842015 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842017 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842021 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842024 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842027 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842031 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842034 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842038 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842041 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842044 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842048 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:10:39.843446 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842051 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842054 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842057 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842060 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842063 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842066 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842069 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842072 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842075 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842078 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842081 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842084 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842086 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842089 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842092 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842094 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842097 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842100 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842102 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842867 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:10:39.843955 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842874 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842877 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842881 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842884 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842887 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842890 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842893 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842896 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842900 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842903 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842908 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842912 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842915 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842920 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842924 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842927 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842930 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842933 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842937 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:10:39.844501 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842940 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842943 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842947 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842950 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842953 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842955 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842958 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842961 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842964 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842967 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842970 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842972 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842975 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842978 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842981 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842983 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842986 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842989 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842992 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842995 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:10:39.845031 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.842999 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843002 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843004 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843007 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843010 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843012 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843015 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843018 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843020 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843023 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843026 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843030 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843033 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843035 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843038 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843041 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843043 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843046 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843049 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843051 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:10:39.845574 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843054 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843058 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843061 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843064 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843066 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843069 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843072 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843075 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843077 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843080 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843082 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843089 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843093 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843095 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843098 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843103 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843105 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843108 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843111 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843114 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:10:39.846092 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843117 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843121 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843125 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843129 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843132 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843135 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843138 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843140 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843143 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843146 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843149 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843152 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843155 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843157 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843160 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843163 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843180 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843184 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.843187 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:10:39.846627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844624 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844632 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844636 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844639 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844646 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844650 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844653 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844656 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844659 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844662 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844665 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844668 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844670 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844673 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844678 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844682 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844685 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844688 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844690 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844693 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:10:39.847116 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844696 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844699 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844702 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844705 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844707 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844710 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844713 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844715 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844718 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844721 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844723 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844726 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844729 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844731 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844735 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844738 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844741 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844750 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844753 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:10:39.847750 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844757 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844761 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844764 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844767 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844770 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844773 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844776 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844779 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844781 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844784 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844787 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844790 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844793 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844796 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844798 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844801 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844804 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844807 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844810 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:10:39.848255 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844812 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844815 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844818 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844820 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844824 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844828 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844831 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844835 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844838 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844842 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844845 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844848 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844860 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844863 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844866 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844869 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844872 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844876 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844879 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:10:39.848786 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844881 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844884 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844887 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844891 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844894 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844897 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844900 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844903 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844905 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844908 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844913 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844915 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844918 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844921 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844924 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844928 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844930 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844933 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844936 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844939 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844942 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:10:39.849289 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.844945 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845015 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845023 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845030 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845035 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845047 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845051 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845056 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845061 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845064 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845068 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845071 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845075 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845078 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845081 2581 flags.go:64] FLAG: --cgroup-root="" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845084 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845088 2581 flags.go:64] FLAG: --client-ca-file="" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845091 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845096 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845108 2581 flags.go:64] FLAG: --cluster-domain="" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845111 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845115 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845118 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845122 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 16:10:39.849842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845126 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845130 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845133 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845137 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845140 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845143 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845147 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845150 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845154 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845158 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845162 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845165 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845181 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845185 2581 flags.go:64] FLAG: --enable-server="true" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845194 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845201 2581 flags.go:64] FLAG: --event-burst="100" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845205 2581 flags.go:64] FLAG: --event-qps="50" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845208 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845211 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845214 2581 flags.go:64] FLAG: --eviction-hard="" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845219 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845222 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845226 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845229 2581 flags.go:64] FLAG: --eviction-soft="" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845232 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 16:10:39.850474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845235 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845240 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845243 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845246 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845249 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845252 2581 flags.go:64] FLAG: --feature-gates="" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845256 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845259 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845262 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845266 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845269 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845272 2581 flags.go:64] FLAG: --help="false" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845275 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-97.ec2.internal" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845278 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845281 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845284 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845288 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845291 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845295 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845298 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845301 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845304 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845313 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845317 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 16:10:39.851164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845326 2581 flags.go:64] FLAG: --kube-reserved="" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845329 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845332 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845335 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845338 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845342 2581 flags.go:64] FLAG: --lock-file="" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845344 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845348 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845351 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845358 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845361 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845364 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845367 2581 flags.go:64] FLAG: --logging-format="text" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845377 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845381 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845385 2581 flags.go:64] FLAG: --manifest-url="" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845387 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845392 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845395 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845400 2581 flags.go:64] FLAG: --max-pods="110" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845403 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845406 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845410 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845413 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845416 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 16:10:39.851852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845419 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845422 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845430 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845434 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845437 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845440 2581 flags.go:64] FLAG: --pod-cidr="" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845450 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845456 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845459 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845463 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845466 2581 flags.go:64] FLAG: --port="10250" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845469 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845472 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0dda9d497deb054a9" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845476 2581 flags.go:64] FLAG: --qos-reserved="" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845479 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845482 2581 flags.go:64] FLAG: --register-node="true" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845487 2581 flags.go:64] FLAG: --register-with-taints="" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845491 2581 flags.go:64] FLAG: --registry-burst="10" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845494 2581 flags.go:64] FLAG: --registry-qps="5" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845497 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845500 2581 flags.go:64] FLAG: --reserved-memory="" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845504 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845507 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845510 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845513 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 16:10:39.852522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845516 2581 flags.go:64] FLAG: --runonce="false" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845519 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845523 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845526 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845531 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845534 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845537 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845540 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845543 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845546 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845550 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845553 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845556 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845573 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845583 2581 flags.go:64] FLAG: --system-cgroups="" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845588 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845594 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845597 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845601 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845608 2581 flags.go:64] FLAG: --tls-min-version="" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845611 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845614 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845618 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845623 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845627 2581 flags.go:64] FLAG: --v="2" Jul 07 16:10:39.853153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845636 2581 flags.go:64] FLAG: --version="false" Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845640 2581 flags.go:64] FLAG: --vmodule="" Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845644 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.845647 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845809 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845813 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845817 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845820 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845823 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845826 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845829 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845833 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845836 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845839 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845842 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845845 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845847 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845850 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845853 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845857 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:10:39.853817 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845861 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845866 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845875 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845879 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845882 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845886 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845888 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845891 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845894 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845897 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845902 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845905 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845908 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845911 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845913 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845916 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845919 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845921 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845924 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:10:39.854369 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845927 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845930 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845932 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845935 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845940 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845942 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845945 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845948 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845950 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845953 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845956 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845959 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845961 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845964 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845967 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845970 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845979 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845982 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845984 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:10:39.854915 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845987 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845990 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845993 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.845995 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846000 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846002 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846005 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846008 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846011 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846013 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846016 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846018 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846021 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846024 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846027 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846030 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846033 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846037 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846040 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846042 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:10:39.855425 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846045 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846048 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846051 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846054 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846056 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846059 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846062 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846064 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846067 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846070 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846080 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846083 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846085 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846088 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846091 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846094 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846098 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846100 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846105 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846109 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:10:39.855943 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846112 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846115 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846118 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846121 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.846124 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.846129 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.853812 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.853828 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.854531 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.854540 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854617 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854623 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854628 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854632 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:10:39.856487 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854636 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854639 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854642 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854645 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854649 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854652 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854655 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854658 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854672 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854675 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854678 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854681 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854684 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854687 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854689 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854692 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854696 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854700 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854703 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:10:39.856916 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854706 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854709 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854712 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854715 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854717 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854720 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854724 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854727 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854730 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854733 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854736 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854738 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854741 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854744 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854747 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854750 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854753 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854755 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854758 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854761 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:10:39.857733 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854764 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854766 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854775 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854778 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854781 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854784 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854786 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854789 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854791 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854794 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854797 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854800 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854803 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854806 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854808 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854817 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854820 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854823 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854826 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:10:39.858418 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854829 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854832 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854835 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854838 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854840 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854844 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854846 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854849 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854852 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854854 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854857 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854860 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854863 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854866 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854868 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854871 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854880 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854883 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854885 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854888 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854891 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:10:39.858924 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854893 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854897 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854901 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854904 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854907 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854910 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854913 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854915 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854918 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854921 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854926 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854929 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854932 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854935 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854938 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:10:39.859584 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.854941 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.854946 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855116 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855122 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855125 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855128 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855131 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855134 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855136 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855139 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855142 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855145 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855148 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855157 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 16:10:39.859993 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855161 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855165 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855184 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855187 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855191 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855194 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855197 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855200 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855204 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855207 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855210 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855213 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855216 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855220 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855223 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855226 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855230 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855233 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855235 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 16:10:39.860392 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855238 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855241 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855244 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855246 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855249 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855252 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855255 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855258 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855260 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855263 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855266 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855268 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855271 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855281 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855284 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855286 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855289 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855291 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855294 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 16:10:39.860919 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855297 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855300 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855303 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855306 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855308 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855311 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855314 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855317 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855320 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855322 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855325 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855328 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855331 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855333 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855336 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855338 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855341 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855344 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855347 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855351 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 16:10:39.861467 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855355 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855358 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855361 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855364 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855367 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855370 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855373 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855381 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855384 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855387 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855389 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855392 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855394 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855397 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855400 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855403 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855406 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855409 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855412 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855415 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 16:10:39.861983 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855418 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855420 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855424 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855428 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855431 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855435 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855438 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855442 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:39.855444 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.855450 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.855572 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.859449 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.860769 2581 server.go:1019] "Starting client certificate rotation" Jul 07 16:10:39.862521 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.860877 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:10:39.862876 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.860914 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 16:10:39.863071 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.863056 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:10:39.864357 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.864336 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 16:10:39.874440 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.874417 2581 log.go:25] "Validated CRI v1 runtime API" Jul 07 16:10:39.878859 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.878841 2581 log.go:25] "Validated CRI v1 image API" Jul 07 16:10:39.879681 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.879662 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 16:10:39.882637 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.882616 2581 fs.go:135] Filesystem UUIDs: map[5773b331-db93-4dec-9690-dbee7ad90c63:/dev/nvme0n1p4 64a6f8dd-d6a3-4f3b-af78-2f4defdbaf2a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 16:10:39.882687 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.882638 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 16:10:39.888697 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.888574 2581 manager.go:216] Machine: {Timestamp:2026-07-07 16:10:39.887388236 +0000 UTC m=+0.294590853 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3094206 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec228e106dd374fddfc83cfcec6857eb SystemUUID:ec228e10-6dd3-74fd-dfc8-3cfcec6857eb BootID:a18b681a-ba86-4b42-8f63-8a41b965a01c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:6e:71:e3:b8:09 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:6e:71:e3:b8:09 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:9d:44:2b:de:eb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 16:10:39.888697 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.888692 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 16:10:39.888816 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.888798 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 16:10:39.889835 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.889805 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 16:10:39.890105 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.889837 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-97.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 16:10:39.890150 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.890099 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:10:39.890705 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.890692 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 16:10:39.890741 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.890709 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 16:10:39.890741 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.890718 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:10:39.890741 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.890732 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 16:10:39.892140 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.892128 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 16:10:39.896219 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.896204 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:10:39.896356 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.896346 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 16:10:39.896398 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.896377 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 07 16:10:39.896398 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.896395 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 16:10:39.896464 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.896410 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 16:10:39.896464 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.896421 2581 kubelet.go:398] "Adding apiserver pod source" Jul 07 16:10:39.896464 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.896429 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 16:10:39.897085 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.897029 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:10:39.897834 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.897805 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 16:10:39.900057 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.900038 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 16:10:39.902315 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.902296 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 16:10:39.902395 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.902329 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 16:10:39.903393 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903380 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 16:10:39.903445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903397 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 16:10:39.903445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903403 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 16:10:39.903445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903410 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 16:10:39.903445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903419 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 16:10:39.903445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903425 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 16:10:39.903445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903434 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 16:10:39.903445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903440 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 16:10:39.903445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903447 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 16:10:39.903658 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903454 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 16:10:39.903658 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903463 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 16:10:39.903658 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.903470 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 16:10:39.904109 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.904099 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 16:10:39.904109 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.904109 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 16:10:39.907603 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.907588 2581 server.go:1268] "Started kubelet" Jul 07 16:10:39.908202 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.907850 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 16:10:39.908567 ip-10-0-134-97 systemd[1]: Started Kubernetes Kubelet. Jul 07 16:10:39.908962 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.908778 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 16:10:39.908962 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.908870 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 16:10:39.911187 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.910024 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 16:10:39.911187 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.910027 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 07 16:10:39.911187 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.910240 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-97.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 16:10:39.911187 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.910239 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 16:10:39.911187 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.910277 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 16:10:39.912989 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.912966 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 16:10:39.917309 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.916359 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-97.ec2.internal.18c00dd01baf8634 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-97.ec2.internal,UID:ip-10-0-134-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-97.ec2.internal,},FirstTimestamp:2026-07-07 16:10:39.90756306 +0000 UTC m=+0.314765676,LastTimestamp:2026-07-07 16:10:39.90756306 +0000 UTC m=+0.314765676,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-97.ec2.internal,}" Jul 07 16:10:39.917783 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.917764 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 16:10:39.917895 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.917784 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 16:10:39.917895 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.917838 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:39.918533 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.918331 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 16:10:39.918533 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.918354 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 16:10:39.918533 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.918459 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 07 16:10:39.918533 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.918469 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 07 16:10:39.918533 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.918494 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 16:10:39.918875 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.918860 2581 factory.go:55] Registering systemd factory Jul 07 16:10:39.918933 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.918879 2581 factory.go:223] Registration of the systemd container factory successfully Jul 07 16:10:39.919167 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.919154 2581 factory.go:153] Registering CRI-O factory Jul 07 16:10:39.919167 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.919167 2581 factory.go:223] Registration of the crio container factory successfully Jul 07 16:10:39.919272 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.919212 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 16:10:39.919272 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.919249 2581 factory.go:103] Registering Raw factory Jul 07 16:10:39.919272 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.919259 2581 manager.go:1196] Started watching for new ooms in manager Jul 07 16:10:39.920474 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.920457 2581 manager.go:349] Starting recovery of all containers Jul 07 16:10:39.921726 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.921582 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 16:10:39.921726 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.921687 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 16:10:39.932109 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.932047 2581 manager.go:354] Recovery completed Jul 07 16:10:39.937268 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.937250 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:10:39.939606 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.939579 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:10:39.939672 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.939621 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:10:39.939672 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.939632 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:10:39.940307 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.940290 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 16:10:39.940307 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.940306 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 16:10:39.940307 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.940307 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:10:39.940480 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.940323 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 07 16:10:39.941055 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.941039 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:10:39.941126 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.941073 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:10:39.941126 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.941089 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:10:39.941726 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.941650 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-97.ec2.internal.18c00dd01d987600 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-97.ec2.internal,UID:ip-10-0-134-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-97.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-97.ec2.internal,},FirstTimestamp:2026-07-07 16:10:39.939606016 +0000 UTC m=+0.346808631,LastTimestamp:2026-07-07 16:10:39.939606016 +0000 UTC m=+0.346808631,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-97.ec2.internal,}" Jul 07 16:10:39.942644 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.942631 2581 policy_none.go:49] "None policy: Start" Jul 07 16:10:39.942690 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.942653 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 16:10:39.942690 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.942669 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 16:10:39.944819 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.944808 2581 policy_none.go:47] "Start" Jul 07 16:10:39.944912 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.944896 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mrn9t" Jul 07 16:10:39.951706 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.951638 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-97.ec2.internal.18c00dd01d98c4fc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-97.ec2.internal,UID:ip-10-0-134-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-97.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-97.ec2.internal,},FirstTimestamp:2026-07-07 16:10:39.939626236 +0000 UTC m=+0.346828851,LastTimestamp:2026-07-07 16:10:39.939626236 +0000 UTC m=+0.346828851,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-97.ec2.internal,}" Jul 07 16:10:39.953442 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.953427 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mrn9t" Jul 07 16:10:39.985590 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.985574 2581 manager.go:337] "Starting Device Plugin manager" Jul 07 16:10:39.985673 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.985612 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 16:10:39.985673 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.985628 2581 server.go:87] "Starting device plugin registration server" Jul 07 16:10:39.985933 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.985910 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 16:10:39.986008 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.985924 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 16:10:39.986286 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.986051 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 16:10:39.986423 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.986378 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 16:10:39.986423 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:39.986392 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 16:10:39.986751 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.986732 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 16:10:39.986810 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:39.986792 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.061107 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.061052 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 16:10:40.063548 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.062340 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 16:10:40.063548 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.062379 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 16:10:40.063548 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.062405 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 16:10:40.063548 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.062440 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 16:10:40.065093 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.065061 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:10:40.086991 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.086961 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:10:40.087845 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.087828 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:10:40.087922 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.087860 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:10:40.087922 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.087874 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:10:40.087922 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.087898 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.098150 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.098131 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.098206 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.098158 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-97.ec2.internal\": node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.119601 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.119575 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.163332 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.163293 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal"] Jul 07 16:10:40.163410 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.163385 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:10:40.164471 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.164455 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:10:40.164540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.164486 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:10:40.164540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.164496 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:10:40.166988 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.166975 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:10:40.167119 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.167091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.167158 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.167139 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:10:40.167683 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.167668 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:10:40.167745 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.167715 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:10:40.167745 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.167730 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:10:40.167745 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.167735 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:10:40.167856 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.167761 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:10:40.167856 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.167777 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:10:40.170195 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.170178 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.170289 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.170205 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:10:40.170918 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.170901 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:10:40.170999 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.170934 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:10:40.170999 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.170951 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:10:40.185820 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.185759 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-97.ec2.internal\" not found" node="ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.189570 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.189554 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-97.ec2.internal\" not found" node="ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.219454 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.219422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c38e96b9a88058f800f8db7067621905-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"c38e96b9a88058f800f8db7067621905\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.220471 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.220453 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.319724 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.319688 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c38e96b9a88058f800f8db7067621905-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"c38e96b9a88058f800f8db7067621905\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.319882 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.319731 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c38e96b9a88058f800f8db7067621905-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"c38e96b9a88058f800f8db7067621905\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.319882 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.319760 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/069618fd9935d30ef59a0acde000b9cb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-97.ec2.internal\" (UID: \"069618fd9935d30ef59a0acde000b9cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.319882 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.319787 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c38e96b9a88058f800f8db7067621905-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"c38e96b9a88058f800f8db7067621905\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.320840 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.320820 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.420187 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.420147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c38e96b9a88058f800f8db7067621905-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"c38e96b9a88058f800f8db7067621905\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.420187 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.420194 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/069618fd9935d30ef59a0acde000b9cb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-97.ec2.internal\" (UID: \"069618fd9935d30ef59a0acde000b9cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.420349 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.420221 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/069618fd9935d30ef59a0acde000b9cb-config\") pod \"kube-apiserver-proxy-ip-10-0-134-97.ec2.internal\" (UID: \"069618fd9935d30ef59a0acde000b9cb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.420349 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.420259 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c38e96b9a88058f800f8db7067621905-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"c38e96b9a88058f800f8db7067621905\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.421273 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.421256 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.492895 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.492793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.493059 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.492793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:40.522145 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.522114 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.625231 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.625178 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.726138 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.726067 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.806943 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.806862 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:10:40.826306 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.826277 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.860483 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.860455 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 16:10:40.860963 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.860606 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:10:40.860963 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.860642 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 16:10:40.927111 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:40.927082 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:40.957772 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.957725 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 16:05:40 +0000 UTC" deadline="2027-12-09 21:33:42.26452541 +0000 UTC" Jul 07 16:10:40.957772 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:40.957761 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12485h23m1.306767708s" Jul 07 16:10:41.027337 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:41.027296 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:41.062586 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.062521 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 16:10:41.063939 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.063918 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory" Jul 07 16:10:41.064048 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.063946 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 16:10:41.064048 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.063957 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID" Jul 07 16:10:41.127568 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.126439 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:10:41.127700 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:41.127590 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:41.131315 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:41.131289 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod069618fd9935d30ef59a0acde000b9cb.slice/crio-23dfdf924bde1873f96ab172e1d90df9ba962a3e483621670ed4395a4220819e WatchSource:0}: Error finding container 23dfdf924bde1873f96ab172e1d90df9ba962a3e483621670ed4395a4220819e: Status 404 returned error can't find the container with id 23dfdf924bde1873f96ab172e1d90df9ba962a3e483621670ed4395a4220819e Jul 07 16:10:41.137539 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.137520 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:10:41.143804 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:41.143779 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc38e96b9a88058f800f8db7067621905.slice/crio-c1b77b4ab68912ba5bddb5f4f2019f46561fa51736a04290035ea1b1ff01b2f5 WatchSource:0}: Error finding container c1b77b4ab68912ba5bddb5f4f2019f46561fa51736a04290035ea1b1ff01b2f5: Status 404 returned error can't find the container with id c1b77b4ab68912ba5bddb5f4f2019f46561fa51736a04290035ea1b1ff01b2f5 Jul 07 16:10:41.227993 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:41.227960 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found" Jul 07 16:10:41.229601 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.229584 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:10:41.324348 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.324260 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" Jul 07 16:10:41.338898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.338872 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:10:41.339856 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.339841 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" Jul 07 16:10:41.349224 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.349204 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 16:10:41.898913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.898881 2581 apiserver.go:52] "Watching apiserver" Jul 07 16:10:41.909485 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.909451 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 16:10:41.909908 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.909881 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-wxvmj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal","openshift-multus/multus-additional-cni-plugins-z4rps","openshift-network-diagnostics/network-check-target-zjldg","kube-system/global-pull-secret-syncer-rs5zd","kube-system/konnectivity-agent-gpqgr","kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal","openshift-multus/multus-4bsww","openshift-multus/network-metrics-daemon-lfhn7","openshift-network-operator/iptables-alerter-2f6xm","openshift-ovn-kubernetes/ovnkube-node-hcfqv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw","openshift-cluster-node-tuning-operator/tuned-mvxdk","openshift-dns/node-resolver-hjxzx"] Jul 07 16:10:41.912713 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.912693 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:41.915681 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.915518 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 16:10:41.915681 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.915538 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 16:10:41.915681 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.915572 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4swjx\"" Jul 07 16:10:41.915957 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.915722 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:10:41.916630 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.916259 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.919281 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.918655 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 16:10:41.919281 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.918851 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:10:41.919281 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.919024 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ttfvv\"" Jul 07 16:10:41.919281 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.919047 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 16:10:41.919281 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.919278 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.921462 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.921442 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:41.921589 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:41.921520 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:41.922353 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.922156 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 16:10:41.922353 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.922308 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 16:10:41.922353 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.922329 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 16:10:41.922583 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.922481 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 16:10:41.922636 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.922610 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9p9fr\"" Jul 07 16:10:41.922893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.922871 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 16:10:41.923863 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.923835 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:41.923966 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:41.923924 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:41.926270 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.926252 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:41.928848 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.928817 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:41.928946 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:41.928892 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:41.929298 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.929115 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 16:10:41.929298 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.929209 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-97c8r\"" Jul 07 16:10:41.929298 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.929214 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 16:10:41.931353 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.931332 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:41.932203 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932180 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19eac631-0134-4955-8305-3ab387223cf9-etc-tuned\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.932297 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-cnibin\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.932297 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysctl-d\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.932297 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932271 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-var-lib-kubelet\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.932574 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.932634 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xctmw\" (UniqueName: \"kubernetes.io/projected/c8423cec-c965-4e4b-b366-050dfdf1ce59-kube-api-access-xctmw\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.932634 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932624 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-systemd\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.932759 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-run\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.932759 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-kubernetes\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.932906 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19eac631-0134-4955-8305-3ab387223cf9-tmp\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.932967 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-system-cni-dir\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.932967 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.933068 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.932994 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-host-slash\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:41.933068 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-modprobe-d\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.933289 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933265 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-lib-modules\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.934341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933304 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-host\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.934341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933777 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 16:10:41.934341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933802 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv6j6\" (UniqueName: \"kubernetes.io/projected/19eac631-0134-4955-8305-3ab387223cf9-kube-api-access-gv6j6\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.934341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-os-release\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.934341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933869 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.934341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933902 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:41.934341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.933938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-sys\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.935683 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.935132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-iptables-alerter-script\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:41.935683 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.935161 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4bsww" Jul 07 16:10:41.935683 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.935175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whdc9\" (UniqueName: \"kubernetes.io/projected/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-kube-api-access-whdc9\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:41.935683 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.935213 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysconfig\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.935683 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.935288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysctl-conf\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:41.935683 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.935594 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 16:10:41.936032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.935799 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 16:10:41.936032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.935913 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7ck5j\"" Jul 07 16:10:41.938592 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.938224 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 16:10:41.938592 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.938426 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sf667\"" Jul 07 16:10:41.938756 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.938647 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:41.941156 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.941075 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 16:10:41.941251 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.941157 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:41.941440 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.941315 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vx6pq\"" Jul 07 16:10:41.942253 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.942144 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 16:10:41.942406 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.942386 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 16:10:41.943756 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.943734 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:41.944870 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.944433 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 16:10:41.944870 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.944448 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 16:10:41.944870 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.944696 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lftb6\"" Jul 07 16:10:41.944870 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.944720 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 16:10:41.945108 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.944986 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 16:10:41.945851 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.945831 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 16:10:41.945851 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.945840 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 16:10:41.946784 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.946765 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 16:10:41.947122 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.947086 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 16:10:41.947394 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.947375 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 16:10:41.947485 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.947446 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dvrpw\"" Jul 07 16:10:41.958044 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.958016 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tq6j" Jul 07 16:10:41.964892 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:41.964870 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tq6j" Jul 07 16:10:42.019774 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.019749 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 16:10:42.036257 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036236 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-systemd\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.036345 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:42.036345 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036294 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-sys\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.036345 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-cnibin\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.036489 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036360 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-cnibin\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.036489 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036384 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-kubelet\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.036489 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036413 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-sys\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.036489 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036432 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-cnibin\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.036489 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036433 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e05262-7701-4d63-a4d8-1a53e6eec64c-host\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.036678 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036495 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-node-log\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.036678 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036526 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-log-socket\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.036678 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036542 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovnkube-config\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.036678 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-etc-kubernetes\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.036678 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036582 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.036678 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036617 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnl9v\" (UniqueName: \"kubernetes.io/projected/5fb1537f-e9bf-4dd6-8c39-326102d64292-kube-api-access-fnl9v\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.036678 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9cd1b59b-3916-4651-a3ae-527595660f75-dbus\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036687 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-run\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-system-cni-dir\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036730 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-netns\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036756 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-cni-bin\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bgkc\" (UniqueName: \"kubernetes.io/projected/b753600e-c525-4724-853a-cfc03c9cf260-kube-api-access-5bgkc\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036798 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-system-cni-dir\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-tmp-dir\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036833 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-os-release\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036851 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036882 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-run\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036898 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-cni-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036914 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-os-release\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036934 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-os-release\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.036971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036959 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-kubelet\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.036983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-cni-bin\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037054 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-sys-fs\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037098 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-iptables-alerter-script\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysconfig\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037176 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysctl-conf\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-run-netns\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-ovn\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037252 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysconfig\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037287 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g57s2\" (UniqueName: \"kubernetes.io/projected/1149ea79-0147-4e20-b44d-84c518e99ccb-kube-api-access-g57s2\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037319 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xctmw\" (UniqueName: \"kubernetes.io/projected/c8423cec-c965-4e4b-b366-050dfdf1ce59-kube-api-access-xctmw\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037348 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysctl-conf\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037358 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-cni-multus\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-hostroot\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037430 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-slash\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037463 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.037618 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037469 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-systemd\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19eac631-0134-4955-8305-3ab387223cf9-tmp\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037538 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-conf-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037549 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-systemd\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037571 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-var-lib-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovnkube-script-lib\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037671 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-socket-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv6j6\" (UniqueName: \"kubernetes.io/projected/19eac631-0134-4955-8305-3ab387223cf9-kube-api-access-gv6j6\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-socket-dir-parent\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037776 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b753600e-c525-4724-853a-cfc03c9cf260-multus-daemon-config\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037835 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82e05262-7701-4d63-a4d8-1a53e6eec64c-serviceca\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037839 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19eac631-0134-4955-8305-3ab387223cf9-etc-tuned\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037899 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5970b079-4ed8-4587-8055-0a12cd138cf7-agent-certs\") pod \"konnectivity-agent-gpqgr\" (UID: \"5970b079-4ed8-4587-8055-0a12cd138cf7\") " pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-var-lib-kubelet\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.037991 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-var-lib-kubelet\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038045 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-multus-certs\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.038473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038074 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w95r4\" (UniqueName: \"kubernetes.io/projected/82e05262-7701-4d63-a4d8-1a53e6eec64c-kube-api-access-w95r4\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038100 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038141 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-hosts-file\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsqcs\" (UniqueName: \"kubernetes.io/projected/ab32e5be-3eea-4303-98f9-247e50b9bf06-kube-api-access-lsqcs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-kubernetes\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038257 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038285 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-etc-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038313 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5970b079-4ed8-4587-8055-0a12cd138cf7-konnectivity-ca\") pod \"konnectivity-agent-gpqgr\" (UID: \"5970b079-4ed8-4587-8055-0a12cd138cf7\") " pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038343 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-lib-modules\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038347 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-kubernetes\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038374 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038402 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038553 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-iptables-alerter-script\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whdc9\" (UniqueName: \"kubernetes.io/projected/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-kube-api-access-whdc9\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038598 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-lib-modules\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.039238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b753600e-c525-4724-853a-cfc03c9cf260-cni-binary-copy\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038707 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c8423cec-c965-4e4b-b366-050dfdf1ce59-tuning-conf-dir\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-systemd-units\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038773 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-cni-netd\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-env-overrides\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038872 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovn-node-metrics-cert\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038942 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysctl-d\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.038988 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039000 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-cni-binary-copy\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9cd1b59b-3916-4651-a3ae-527595660f75-kubelet-config\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-registration-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039067 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-sysctl-d\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039121 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039112 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c8423cec-c965-4e4b-b366-050dfdf1ce59-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-system-cni-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.040046 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-k8s-cni-cncf-io\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.040913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039231 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxxw6\" (UniqueName: \"kubernetes.io/projected/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-kube-api-access-sxxw6\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.040913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-device-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.040913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-host-slash\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:42.040913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-modprobe-d\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.040913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039350 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-host\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.040913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039364 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-host-slash\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:42.040913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-etc-modprobe-d\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.040913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.039449 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/19eac631-0134-4955-8305-3ab387223cf9-host\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.041627 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.041605 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19eac631-0134-4955-8305-3ab387223cf9-tmp\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.041729 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.041655 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/19eac631-0134-4955-8305-3ab387223cf9-etc-tuned\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.046966 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.046939 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv6j6\" (UniqueName: \"kubernetes.io/projected/19eac631-0134-4955-8305-3ab387223cf9-kube-api-access-gv6j6\") pod \"tuned-mvxdk\" (UID: \"19eac631-0134-4955-8305-3ab387223cf9\") " pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.047266 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.047249 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xctmw\" (UniqueName: \"kubernetes.io/projected/c8423cec-c965-4e4b-b366-050dfdf1ce59-kube-api-access-xctmw\") pod \"multus-additional-cni-plugins-z4rps\" (UID: \"c8423cec-c965-4e4b-b366-050dfdf1ce59\") " pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.047716 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.047700 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whdc9\" (UniqueName: \"kubernetes.io/projected/ec9111c6-a987-4a9b-8454-3b8cc2c56d53-kube-api-access-whdc9\") pod \"iptables-alerter-2f6xm\" (UID: \"ec9111c6-a987-4a9b-8454-3b8cc2c56d53\") " pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:42.067498 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.067449 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" event={"ID":"c38e96b9a88058f800f8db7067621905","Type":"ContainerStarted","Data":"c1b77b4ab68912ba5bddb5f4f2019f46561fa51736a04290035ea1b1ff01b2f5"} Jul 07 16:10:42.068452 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.068433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" event={"ID":"069618fd9935d30ef59a0acde000b9cb","Type":"ContainerStarted","Data":"23dfdf924bde1873f96ab172e1d90df9ba962a3e483621670ed4395a4220819e"} Jul 07 16:10:42.116605 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.116573 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:10:42.140007 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.139962 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-cni-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140007 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-os-release\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140037 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-kubelet\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140061 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-cni-bin\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140086 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-sys-fs\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-run-netns\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140162 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-kubelet\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140181 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-ovn\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-cni-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140188 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-cni-bin\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140203 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g57s2\" (UniqueName: \"kubernetes.io/projected/1149ea79-0147-4e20-b44d-84c518e99ccb-kube-api-access-g57s2\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.140249 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140245 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-sys-fs\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-cni-multus\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140286 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-os-release\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140295 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-cni-multus\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.140294 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140336 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-hostroot\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.140377 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret podName:9cd1b59b-3916-4651-a3ae-527595660f75 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:42.640353761 +0000 UTC m=+3.047556392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret") pod "global-pull-secret-syncer-rs5zd" (UID: "9cd1b59b-3916-4651-a3ae-527595660f75") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140398 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-slash\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140414 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-hostroot\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140376 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-run-netns\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140450 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-ovn\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-slash\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140496 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-conf-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-var-lib-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140549 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-conf-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovnkube-script-lib\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140600 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-var-lib-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-socket-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.140857 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140642 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-socket-dir-parent\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140669 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b753600e-c525-4724-853a-cfc03c9cf260-multus-daemon-config\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82e05262-7701-4d63-a4d8-1a53e6eec64c-serviceca\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140701 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-multus-socket-dir-parent\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140709 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-socket-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140719 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5970b079-4ed8-4587-8055-0a12cd138cf7-agent-certs\") pod \"konnectivity-agent-gpqgr\" (UID: \"5970b079-4ed8-4587-8055-0a12cd138cf7\") " pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140755 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-multus-certs\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w95r4\" (UniqueName: \"kubernetes.io/projected/82e05262-7701-4d63-a4d8-1a53e6eec64c-kube-api-access-w95r4\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-hosts-file\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140859 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsqcs\" (UniqueName: \"kubernetes.io/projected/ab32e5be-3eea-4303-98f9-247e50b9bf06-kube-api-access-lsqcs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140859 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-multus-certs\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140887 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-etc-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5970b079-4ed8-4587-8055-0a12cd138cf7-konnectivity-ca\") pod \"konnectivity-agent-gpqgr\" (UID: \"5970b079-4ed8-4587-8055-0a12cd138cf7\") " pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140939 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b753600e-c525-4724-853a-cfc03c9cf260-cni-binary-copy\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.140993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-systemd-units\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.141898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141046 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-cni-netd\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141070 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-env-overrides\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141118 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovn-node-metrics-cert\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141192 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9cd1b59b-3916-4651-a3ae-527595660f75-kubelet-config\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141221 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82e05262-7701-4d63-a4d8-1a53e6eec64c-serviceca\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141258 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-registration-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141285 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-cni-netd\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141292 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141293 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-system-cni-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141358 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-systemd-units\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141380 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141386 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-system-cni-dir\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141394 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-hosts-file\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovnkube-script-lib\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.142799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9cd1b59b-3916-4651-a3ae-527595660f75-kubelet-config\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141416 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-k8s-cni-cncf-io\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141449 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-k8s-cni-cncf-io\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141456 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxxw6\" (UniqueName: \"kubernetes.io/projected/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-kube-api-access-sxxw6\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141359 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b753600e-c525-4724-853a-cfc03c9cf260-multus-daemon-config\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141416 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-run-ovn-kubernetes\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-device-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141520 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141524 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-registration-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141521 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-systemd\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141552 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-run-systemd\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141599 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1149ea79-0147-4e20-b44d-84c518e99ccb-device-dir\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141621 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5970b079-4ed8-4587-8055-0a12cd138cf7-konnectivity-ca\") pod \"konnectivity-agent-gpqgr\" (UID: \"5970b079-4ed8-4587-8055-0a12cd138cf7\") " pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141672 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-cnibin\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141715 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-etc-openvswitch\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141735 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-kubelet\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141762 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e05262-7701-4d63-a4d8-1a53e6eec64c-host\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.143675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141773 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-cnibin\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.141776 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141809 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-env-overrides\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141787 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-node-log\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141823 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-node-log\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.141835 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:42.641819702 +0000 UTC m=+3.049022316 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-kubelet\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141858 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82e05262-7701-4d63-a4d8-1a53e6eec64c-host\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141859 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b753600e-c525-4724-853a-cfc03c9cf260-cni-binary-copy\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-log-socket\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141897 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-log-socket\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141909 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovnkube-config\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141934 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-etc-kubernetes\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141961 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141968 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-etc-kubernetes\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.141988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnl9v\" (UniqueName: \"kubernetes.io/projected/5fb1537f-e9bf-4dd6-8c39-326102d64292-kube-api-access-fnl9v\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9cd1b59b-3916-4651-a3ae-527595660f75-dbus\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.144598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142012 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fb1537f-e9bf-4dd6-8c39-326102d64292-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142071 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9cd1b59b-3916-4651-a3ae-527595660f75-dbus\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-netns\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142160 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-cni-bin\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142166 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-run-netns\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142226 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b753600e-c525-4724-853a-cfc03c9cf260-host-var-lib-cni-bin\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142186 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bgkc\" (UniqueName: \"kubernetes.io/projected/b753600e-c525-4724-853a-cfc03c9cf260-kube-api-access-5bgkc\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142269 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-tmp-dir\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142420 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovnkube-config\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.142547 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-tmp-dir\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.145566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.144224 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5fb1537f-e9bf-4dd6-8c39-326102d64292-ovn-node-metrics-cert\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.146210 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.146186 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5970b079-4ed8-4587-8055-0a12cd138cf7-agent-certs\") pod \"konnectivity-agent-gpqgr\" (UID: \"5970b079-4ed8-4587-8055-0a12cd138cf7\") " pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:42.157109 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.157049 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g57s2\" (UniqueName: \"kubernetes.io/projected/1149ea79-0147-4e20-b44d-84c518e99ccb-kube-api-access-g57s2\") pod \"aws-ebs-csi-driver-node-t4ccw\" (UID: \"1149ea79-0147-4e20-b44d-84c518e99ccb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.160277 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.160252 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:10:42.160390 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.160282 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:10:42.160390 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.160296 2581 projected.go:196] Error preparing data for projected volume kube-api-access-6n64b for pod openshift-network-diagnostics/network-check-target-zjldg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:42.160390 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.160352 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b podName:052ce891-8d50-4448-83f3-6a0f543b1aa3 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:42.660335678 +0000 UTC m=+3.067538284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6n64b" (UniqueName: "kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b") pod "network-check-target-zjldg" (UID: "052ce891-8d50-4448-83f3-6a0f543b1aa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:42.162325 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.162268 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxxw6\" (UniqueName: \"kubernetes.io/projected/8a2d0cb9-a4f1-46a2-b838-6c92146f9677-kube-api-access-sxxw6\") pod \"node-resolver-hjxzx\" (UID: \"8a2d0cb9-a4f1-46a2-b838-6c92146f9677\") " pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.162421 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.162379 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bgkc\" (UniqueName: \"kubernetes.io/projected/b753600e-c525-4724-853a-cfc03c9cf260-kube-api-access-5bgkc\") pod \"multus-4bsww\" (UID: \"b753600e-c525-4724-853a-cfc03c9cf260\") " pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.162767 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.162746 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnl9v\" (UniqueName: \"kubernetes.io/projected/5fb1537f-e9bf-4dd6-8c39-326102d64292-kube-api-access-fnl9v\") pod \"ovnkube-node-hcfqv\" (UID: \"5fb1537f-e9bf-4dd6-8c39-326102d64292\") " pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.164629 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.164605 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w95r4\" (UniqueName: \"kubernetes.io/projected/82e05262-7701-4d63-a4d8-1a53e6eec64c-kube-api-access-w95r4\") pod \"node-ca-wxvmj\" (UID: \"82e05262-7701-4d63-a4d8-1a53e6eec64c\") " pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.165484 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.165463 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsqcs\" (UniqueName: \"kubernetes.io/projected/ab32e5be-3eea-4303-98f9-247e50b9bf06-kube-api-access-lsqcs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:42.227082 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.227047 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2f6xm" Jul 07 16:10:42.239238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.239209 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" Jul 07 16:10:42.240437 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.240346 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9111c6_a987_4a9b_8454_3b8cc2c56d53.slice/crio-5f523e518a33235a46ce491ad32e760099b7ac89e4f8d63253f6ea511fcd0a43 WatchSource:0}: Error finding container 5f523e518a33235a46ce491ad32e760099b7ac89e4f8d63253f6ea511fcd0a43: Status 404 returned error can't find the container with id 5f523e518a33235a46ce491ad32e760099b7ac89e4f8d63253f6ea511fcd0a43 Jul 07 16:10:42.248107 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.247930 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-z4rps" Jul 07 16:10:42.250021 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.249993 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19eac631_0134_4955_8305_3ab387223cf9.slice/crio-8f6d12e818a36bc62e454bce924d56e6bf9846fac58e1afa6eabd7c03156f869 WatchSource:0}: Error finding container 8f6d12e818a36bc62e454bce924d56e6bf9846fac58e1afa6eabd7c03156f869: Status 404 returned error can't find the container with id 8f6d12e818a36bc62e454bce924d56e6bf9846fac58e1afa6eabd7c03156f869 Jul 07 16:10:42.254842 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.254821 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:42.259338 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.259317 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8423cec_c965_4e4b_b366_050dfdf1ce59.slice/crio-f20bd84b771b471faa3681c0bcf034bddd26ec4e0c6faa7fc8d3e66cb58180ba WatchSource:0}: Error finding container f20bd84b771b471faa3681c0bcf034bddd26ec4e0c6faa7fc8d3e66cb58180ba: Status 404 returned error can't find the container with id f20bd84b771b471faa3681c0bcf034bddd26ec4e0c6faa7fc8d3e66cb58180ba Jul 07 16:10:42.263356 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.263338 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hjxzx" Jul 07 16:10:42.263626 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.263607 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5970b079_4ed8_4587_8055_0a12cd138cf7.slice/crio-cbdb6168abad6a2635ae54df154bf4f7c076ffcc678073ce5b3f062f41504474 WatchSource:0}: Error finding container cbdb6168abad6a2635ae54df154bf4f7c076ffcc678073ce5b3f062f41504474: Status 404 returned error can't find the container with id cbdb6168abad6a2635ae54df154bf4f7c076ffcc678073ce5b3f062f41504474 Jul 07 16:10:42.272197 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.272179 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4bsww" Jul 07 16:10:42.272497 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.272477 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2d0cb9_a4f1_46a2_b838_6c92146f9677.slice/crio-71b9bf8c07883341d67a2668792dd0879778cab60b00757ef2f3cbe120b575d5 WatchSource:0}: Error finding container 71b9bf8c07883341d67a2668792dd0879778cab60b00757ef2f3cbe120b575d5: Status 404 returned error can't find the container with id 71b9bf8c07883341d67a2668792dd0879778cab60b00757ef2f3cbe120b575d5 Jul 07 16:10:42.281568 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.281544 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb753600e_c525_4724_853a_cfc03c9cf260.slice/crio-55036e22f2ece65b3343919bbcf5a9963b5486935b3ce6686631a75993bebfd2 WatchSource:0}: Error finding container 55036e22f2ece65b3343919bbcf5a9963b5486935b3ce6686631a75993bebfd2: Status 404 returned error can't find the container with id 55036e22f2ece65b3343919bbcf5a9963b5486935b3ce6686631a75993bebfd2 Jul 07 16:10:42.288204 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.288174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wxvmj" Jul 07 16:10:42.297441 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.297423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:10:42.297663 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.297643 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82e05262_7701_4d63_a4d8_1a53e6eec64c.slice/crio-9af85d99c6bee70a327bea99440f5396fb1dc220a587194e4dd484905c837afb WatchSource:0}: Error finding container 9af85d99c6bee70a327bea99440f5396fb1dc220a587194e4dd484905c837afb: Status 404 returned error can't find the container with id 9af85d99c6bee70a327bea99440f5396fb1dc220a587194e4dd484905c837afb Jul 07 16:10:42.302449 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.302431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" Jul 07 16:10:42.307799 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.307773 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb1537f_e9bf_4dd6_8c39_326102d64292.slice/crio-c9974a7462078dfdab7322c826cf8b94c87608364bb208aa4e93c76bd2a14493 WatchSource:0}: Error finding container c9974a7462078dfdab7322c826cf8b94c87608364bb208aa4e93c76bd2a14493: Status 404 returned error can't find the container with id c9974a7462078dfdab7322c826cf8b94c87608364bb208aa4e93c76bd2a14493 Jul 07 16:10:42.314040 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:10:42.314004 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1149ea79_0147_4e20_b44d_84c518e99ccb.slice/crio-2d23f1c26543ee7657a5aea8ea02b78ad8aa76129c179d53b874114f1d294a40 WatchSource:0}: Error finding container 2d23f1c26543ee7657a5aea8ea02b78ad8aa76129c179d53b874114f1d294a40: Status 404 returned error can't find the container with id 2d23f1c26543ee7657a5aea8ea02b78ad8aa76129c179d53b874114f1d294a40 Jul 07 16:10:42.575128 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.575016 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 16:10:42.646024 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.645985 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:42.646243 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.646074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:42.646243 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.646180 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:42.646243 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.646232 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:42.646407 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.646261 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:43.646240198 +0000 UTC m=+4.053442800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:42.646407 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.646286 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret podName:9cd1b59b-3916-4651-a3ae-527595660f75 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:43.646273778 +0000 UTC m=+4.053476380 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret") pod "global-pull-secret-syncer-rs5zd" (UID: "9cd1b59b-3916-4651-a3ae-527595660f75") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:42.746838 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.746799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:42.747022 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.746999 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:10:42.747081 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.747033 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:10:42.747081 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.747049 2581 projected.go:196] Error preparing data for projected volume kube-api-access-6n64b for pod openshift-network-diagnostics/network-check-target-zjldg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:42.747182 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:42.747112 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b podName:052ce891-8d50-4448-83f3-6a0f543b1aa3 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:43.747093332 +0000 UTC m=+4.154295934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6n64b" (UniqueName: "kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b") pod "network-check-target-zjldg" (UID: "052ce891-8d50-4448-83f3-6a0f543b1aa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:42.968196 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.968150 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:05:42 +0000 UTC" deadline="2028-02-16 05:13:33.186866401 +0000 UTC" Jul 07 16:10:42.968196 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:42.968191 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14125h2m50.218679599s" Jul 07 16:10:43.064323 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.063539 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:43.064323 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.063668 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:43.064323 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.064092 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:43.064323 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.064205 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:43.077827 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.077720 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" event={"ID":"1149ea79-0147-4e20-b44d-84c518e99ccb","Type":"ContainerStarted","Data":"2d23f1c26543ee7657a5aea8ea02b78ad8aa76129c179d53b874114f1d294a40"} Jul 07 16:10:43.081832 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.081800 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"c9974a7462078dfdab7322c826cf8b94c87608364bb208aa4e93c76bd2a14493"} Jul 07 16:10:43.083635 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.083598 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4bsww" event={"ID":"b753600e-c525-4724-853a-cfc03c9cf260","Type":"ContainerStarted","Data":"55036e22f2ece65b3343919bbcf5a9963b5486935b3ce6686631a75993bebfd2"} Jul 07 16:10:43.087136 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.087057 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gpqgr" event={"ID":"5970b079-4ed8-4587-8055-0a12cd138cf7","Type":"ContainerStarted","Data":"cbdb6168abad6a2635ae54df154bf4f7c076ffcc678073ce5b3f062f41504474"} Jul 07 16:10:43.089536 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.089465 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerStarted","Data":"f20bd84b771b471faa3681c0bcf034bddd26ec4e0c6faa7fc8d3e66cb58180ba"} Jul 07 16:10:43.092612 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.092540 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" event={"ID":"19eac631-0134-4955-8305-3ab387223cf9","Type":"ContainerStarted","Data":"8f6d12e818a36bc62e454bce924d56e6bf9846fac58e1afa6eabd7c03156f869"} Jul 07 16:10:43.095790 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.095740 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxvmj" event={"ID":"82e05262-7701-4d63-a4d8-1a53e6eec64c","Type":"ContainerStarted","Data":"9af85d99c6bee70a327bea99440f5396fb1dc220a587194e4dd484905c837afb"} Jul 07 16:10:43.097485 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.097408 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hjxzx" event={"ID":"8a2d0cb9-a4f1-46a2-b838-6c92146f9677","Type":"ContainerStarted","Data":"71b9bf8c07883341d67a2668792dd0879778cab60b00757ef2f3cbe120b575d5"} Jul 07 16:10:43.099471 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.099400 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2f6xm" event={"ID":"ec9111c6-a987-4a9b-8454-3b8cc2c56d53","Type":"ContainerStarted","Data":"5f523e518a33235a46ce491ad32e760099b7ac89e4f8d63253f6ea511fcd0a43"} Jul 07 16:10:43.660608 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.660570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:43.660792 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.660633 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:43.660792 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.660788 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:43.660915 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.660850 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret podName:9cd1b59b-3916-4651-a3ae-527595660f75 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:45.660832017 +0000 UTC m=+6.068034621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret") pod "global-pull-secret-syncer-rs5zd" (UID: "9cd1b59b-3916-4651-a3ae-527595660f75") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:43.660993 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.660920 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:43.660993 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.660952 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:45.660939624 +0000 UTC m=+6.068142229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:43.761254 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.761161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:43.761425 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.761323 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:10:43.761425 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.761345 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:10:43.761425 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.761357 2581 projected.go:196] Error preparing data for projected volume kube-api-access-6n64b for pod openshift-network-diagnostics/network-check-target-zjldg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:43.761425 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:43.761414 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b podName:052ce891-8d50-4448-83f3-6a0f543b1aa3 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:45.761393823 +0000 UTC m=+6.168596440 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6n64b" (UniqueName: "kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b") pod "network-check-target-zjldg" (UID: "052ce891-8d50-4448-83f3-6a0f543b1aa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:43.969345 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.969244 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 16:05:42 +0000 UTC" deadline="2028-03-06 14:40:11.313877549 +0000 UTC" Jul 07 16:10:43.969345 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:43.969315 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14590h29m27.344567312s" Jul 07 16:10:44.064638 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:44.064392 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:44.064638 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:44.064531 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:45.063587 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:45.063555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:45.064037 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:45.063555 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:45.064037 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.063695 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:45.064037 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.063746 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:45.676109 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:45.676068 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:45.676303 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:45.676143 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:45.676303 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.676276 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:45.676423 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.676338 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:45.676423 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.676348 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret podName:9cd1b59b-3916-4651-a3ae-527595660f75 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:49.676328536 +0000 UTC m=+10.083531142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret") pod "global-pull-secret-syncer-rs5zd" (UID: "9cd1b59b-3916-4651-a3ae-527595660f75") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:45.676423 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.676417 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:49.676397776 +0000 UTC m=+10.083600388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:45.777759 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:45.777200 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:45.777759 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.777451 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:10:45.777759 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.777470 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:10:45.777759 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.777482 2581 projected.go:196] Error preparing data for projected volume kube-api-access-6n64b for pod openshift-network-diagnostics/network-check-target-zjldg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:45.777759 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:45.777537 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b podName:052ce891-8d50-4448-83f3-6a0f543b1aa3 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:49.777521344 +0000 UTC m=+10.184723950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6n64b" (UniqueName: "kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b") pod "network-check-target-zjldg" (UID: "052ce891-8d50-4448-83f3-6a0f543b1aa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:46.062795 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:46.062655 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:46.062976 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:46.062801 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:47.063238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:47.063138 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:47.063753 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:47.063139 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:47.063753 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:47.063273 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:47.063753 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:47.063357 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:48.062910 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:48.062831 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:48.063071 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:48.062959 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:49.063234 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:49.063152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:49.063609 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:49.063152 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:49.063609 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.063277 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:49.063609 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.063324 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:49.706544 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:49.706452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:49.706699 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:49.706545 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:49.706699 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.706652 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:49.706809 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.706713 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret podName:9cd1b59b-3916-4651-a3ae-527595660f75 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:57.706694773 +0000 UTC m=+18.113897391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret") pod "global-pull-secret-syncer-rs5zd" (UID: "9cd1b59b-3916-4651-a3ae-527595660f75") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:49.706809 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.706652 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:49.706809 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.706806 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:57.706781789 +0000 UTC m=+18.113984400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:49.807590 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:49.807536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:49.807760 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.807738 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:10:49.807834 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.807768 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:10:49.807834 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.807782 2581 projected.go:196] Error preparing data for projected volume kube-api-access-6n64b for pod openshift-network-diagnostics/network-check-target-zjldg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:49.807940 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:49.807841 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b podName:052ce891-8d50-4448-83f3-6a0f543b1aa3 nodeName:}" failed. No retries permitted until 2026-07-07 16:10:57.807822558 +0000 UTC m=+18.215025174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6n64b" (UniqueName: "kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b") pod "network-check-target-zjldg" (UID: "052ce891-8d50-4448-83f3-6a0f543b1aa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:50.063570 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:50.063491 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:50.064011 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:50.063599 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:51.063533 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:51.063494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:51.063730 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:51.063494 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:51.063730 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:51.063618 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:51.063730 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:51.063686 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:52.063071 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.062796 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:52.063238 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:52.063163 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:52.123517 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.123476 2581 generic.go:356] "Generic (PLEG): container finished" podID="c38e96b9a88058f800f8db7067621905" containerID="0f9f1963d0211234b98f050c8d55fc35ec7f44af661ef84727d6c48922a36c85" exitCode=0 Jul 07 16:10:52.124035 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.123580 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" event={"ID":"c38e96b9a88058f800f8db7067621905","Type":"ContainerDied","Data":"0f9f1963d0211234b98f050c8d55fc35ec7f44af661ef84727d6c48922a36c85"} Jul 07 16:10:52.125676 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.125648 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" event={"ID":"1149ea79-0147-4e20-b44d-84c518e99ccb","Type":"ContainerStarted","Data":"11ccf1fab70fc097f7679804714ee3c86ccaf27eab3889b0e144b39d1bb0da06"} Jul 07 16:10:52.127522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.127494 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gpqgr" event={"ID":"5970b079-4ed8-4587-8055-0a12cd138cf7","Type":"ContainerStarted","Data":"2649770c2835b3a0f5c6a5ab78765cb05541ecf250fed600df4943634721649f"} Jul 07 16:10:52.129756 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.129724 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8423cec-c965-4e4b-b366-050dfdf1ce59" containerID="5582a74be40aa9e7692df3b203ac5ddd3fbe1ebf00b8e90a92b374258fdfabb0" exitCode=0 Jul 07 16:10:52.129853 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.129821 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerDied","Data":"5582a74be40aa9e7692df3b203ac5ddd3fbe1ebf00b8e90a92b374258fdfabb0"} Jul 07 16:10:52.131663 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.131609 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" event={"ID":"19eac631-0134-4955-8305-3ab387223cf9","Type":"ContainerStarted","Data":"781946d695a23bca56f69506bca2e3e27ff2eea7876e3f68100935fe980203b3"} Jul 07 16:10:52.134482 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.134456 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" event={"ID":"069618fd9935d30ef59a0acde000b9cb","Type":"ContainerStarted","Data":"ab4073ff76be6c946ac419f70792530d24ba815734f3b65b651b2cb8d96e8b0f"} Jul 07 16:10:52.136886 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.136848 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wxvmj" event={"ID":"82e05262-7701-4d63-a4d8-1a53e6eec64c","Type":"ContainerStarted","Data":"0c84f9e8d74b51b4501998194d9aa2855af106bac762d112656196d80c674edd"} Jul 07 16:10:52.144088 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.144061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hjxzx" event={"ID":"8a2d0cb9-a4f1-46a2-b838-6c92146f9677","Type":"ContainerStarted","Data":"9a72e8a957cc5a02155715fe839d6b28fb93d75160303a7d2298ac8d7707fd07"} Jul 07 16:10:52.159048 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.158999 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gpqgr" podStartSLOduration=2.950477006 podStartE2EDuration="12.15898031s" totalImagesPullingTime="9.208503304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:52.158817143 +0000 UTC m=+12.566019764" watchObservedRunningTime="2026-07-07 16:10:52.15898031 +0000 UTC m=+12.566182933" Jul 07 16:10:52.174403 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.174351 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wxvmj" podStartSLOduration=3.000085445 podStartE2EDuration="12.174328449s" totalImagesPullingTime="9.174243004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:52.174298553 +0000 UTC m=+12.581501178" watchObservedRunningTime="2026-07-07 16:10:52.174328449 +0000 UTC m=+12.581531074" Jul 07 16:10:52.192050 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.192000 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" podStartSLOduration=11.191983903 podStartE2EDuration="11.191983903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:52.191554104 +0000 UTC m=+12.598756726" watchObservedRunningTime="2026-07-07 16:10:52.191983903 +0000 UTC m=+12.599186531" Jul 07 16:10:52.214126 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.214059 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mvxdk" podStartSLOduration=2.912492681 podStartE2EDuration="12.214041123s" totalImagesPullingTime="9.301548442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:52.213460787 +0000 UTC m=+12.620663411" watchObservedRunningTime="2026-07-07 16:10:52.214041123 +0000 UTC m=+12.621243748" Jul 07 16:10:52.265471 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:52.265415 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hjxzx" podStartSLOduration=3.022389516 podStartE2EDuration="12.265397619s" totalImagesPullingTime="9.243008103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:52.264695407 +0000 UTC m=+12.671898031" watchObservedRunningTime="2026-07-07 16:10:52.265397619 +0000 UTC m=+12.672600241" Jul 07 16:10:53.063595 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.063567 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:53.063595 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.063590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:53.063764 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:53.063697 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:53.063764 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:53.063755 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:53.148589 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.148546 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2f6xm" event={"ID":"ec9111c6-a987-4a9b-8454-3b8cc2c56d53","Type":"ContainerStarted","Data":"471a8db74e6310fee0594a946540b4bd87f23636eb226b4ae0e08f0392dc432c"} Jul 07 16:10:53.151710 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.151681 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" event={"ID":"c38e96b9a88058f800f8db7067621905","Type":"ContainerStarted","Data":"7003fd96031519339ad249e074df7657a695b5ffa4f7333343f779dbfddf2660"} Jul 07 16:10:53.164729 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.164188 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2f6xm" podStartSLOduration=3.890549535 podStartE2EDuration="13.164172231s" totalImagesPullingTime="9.273622696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:53.16383382 +0000 UTC m=+13.571036443" watchObservedRunningTime="2026-07-07 16:10:53.164172231 +0000 UTC m=+13.571374852" Jul 07 16:10:53.557506 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.557474 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:53.558041 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.558022 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:10:53.574226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.574179 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" podStartSLOduration=12.574164462 podStartE2EDuration="12.574164462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:53.179782356 +0000 UTC m=+13.586984979" watchObservedRunningTime="2026-07-07 16:10:53.574164462 +0000 UTC m=+13.981367083" Jul 07 16:10:53.741893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.741869 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 16:10:53.996204 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.996035 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T16:10:53.74188885Z","UUID":"f32e49dd-59cb-4753-96f9-2dccf475e4b9","Handler":null,"Name":"","Endpoint":""} Jul 07 16:10:53.997846 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.997824 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 16:10:53.997974 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:53.997870 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 16:10:54.063560 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:54.063527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:54.063728 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:54.063666 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:54.154582 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:54.154541 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" event={"ID":"1149ea79-0147-4e20-b44d-84c518e99ccb","Type":"ContainerStarted","Data":"1866508c94cb83423784decb7e3ba1e504d5fe7d0cbd7abdbc546280d56e7b3b"} Jul 07 16:10:55.063297 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:55.063264 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:55.063297 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:55.063298 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:55.063497 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:55.063376 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:55.063497 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:55.063485 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:55.157365 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:55.157339 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 16:10:56.063550 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:56.063509 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:56.063734 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:56.063707 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:56.162412 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:56.162229 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" event={"ID":"1149ea79-0147-4e20-b44d-84c518e99ccb","Type":"ContainerStarted","Data":"fbeded1aa797d6767ac178a671e53fa516995d9f8d8a4d94087c5fd7cb6c3b6c"} Jul 07 16:10:56.182937 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:56.182887 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4ccw" podStartSLOduration=3.849357226 podStartE2EDuration="16.182870869s" totalImagesPullingTime="12.333513643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:10:56.18128886 +0000 UTC m=+16.588491482" watchObservedRunningTime="2026-07-07 16:10:56.182870869 +0000 UTC m=+16.590073491" Jul 07 16:10:57.063238 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:57.063197 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:57.063459 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:57.063206 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:57.063459 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.063307 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:10:57.063459 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.063421 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:57.770672 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:57.770630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:57.771375 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:57.770693 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:57.771375 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.770772 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:57.771375 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.770802 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:57.771375 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.770841 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:11:13.770823935 +0000 UTC m=+34.178026547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:10:57.771375 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.770855 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret podName:9cd1b59b-3916-4651-a3ae-527595660f75 nodeName:}" failed. No retries permitted until 2026-07-07 16:11:13.770849325 +0000 UTC m=+34.178051925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret") pod "global-pull-secret-syncer-rs5zd" (UID: "9cd1b59b-3916-4651-a3ae-527595660f75") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:10:57.871353 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:57.871315 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:57.871540 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.871464 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:10:57.871540 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.871487 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:10:57.871540 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.871500 2581 projected.go:196] Error preparing data for projected volume kube-api-access-6n64b for pod openshift-network-diagnostics/network-check-target-zjldg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:57.871700 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:57.871567 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b podName:052ce891-8d50-4448-83f3-6a0f543b1aa3 nodeName:}" failed. No retries permitted until 2026-07-07 16:11:13.871546524 +0000 UTC m=+34.278749140 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6n64b" (UniqueName: "kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b") pod "network-check-target-zjldg" (UID: "052ce891-8d50-4448-83f3-6a0f543b1aa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:10:58.062726 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:58.062632 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:10:58.062890 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:58.062784 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:10:59.062908 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:59.062867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:10:59.063363 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:10:59.062867 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:10:59.063363 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:59.062997 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:10:59.063363 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:10:59.063046 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:00.064409 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:00.064373 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:00.064960 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:00.064500 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:00.993455 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:00.993419 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:11:00.993646 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:00.993571 2581 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 07 16:11:00.994204 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:00.994176 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gpqgr" Jul 07 16:11:01.063686 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:01.063646 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:01.063868 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:01.063653 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:01.063868 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:01.063789 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:01.063868 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:01.063813 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:02.062978 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:02.062943 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:02.063446 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:02.063089 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:03.063366 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:03.063330 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:03.063870 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:03.063370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:03.063870 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:03.063448 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:03.063870 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:03.063566 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:04.062915 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:04.062885 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:04.063110 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:04.063040 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:05.063492 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:05.063448 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:05.063955 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:05.063448 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:05.063955 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:05.063605 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:05.063955 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:05.063656 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:06.063594 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:06.063561 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:06.064010 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:06.063708 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:07.063547 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:07.063520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:07.063696 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:07.063520 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:07.063696 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:07.063615 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:07.063696 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:07.063688 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:08.063478 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.063158 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:08.063635 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:08.063584 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:08.188855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.188819 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"e4b28512cfe1d2a7fc4f31098e992e01051bf3c722e6a445dd540a551de58fba"} Jul 07 16:11:08.189359 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.188903 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"0dddb8962d2b6813d31acc495ac88cb42e96da8f4f6759a539a0b08b76690f4f"} Jul 07 16:11:08.189359 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.188953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"145315b1ce209636079c908911acfa9f3f12717c19bba9005cead88315f2104a"} Jul 07 16:11:08.189359 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.189006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"5d4d7b8ed962f5f1c80198ce307b1ab526cb1a04eb94f33959c0641360f5446d"} Jul 07 16:11:08.189359 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.189050 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"21604f8409b2b28a27a0a20ca6de8af50e3f1f28f73665e42a7579364222e9e3"} Jul 07 16:11:08.189359 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.189114 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"2d0a47e7ac93ba06ddecf1c8eea67c0bb1a0346610d1e62e389f9d4def761032"} Jul 07 16:11:08.190278 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.190253 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4bsww" event={"ID":"b753600e-c525-4724-853a-cfc03c9cf260","Type":"ContainerStarted","Data":"1821e8522ac935211861e706969c90434592c98b9a33d4988f9d9c245dea9fdd"} Jul 07 16:11:08.192047 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.192027 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8423cec-c965-4e4b-b366-050dfdf1ce59" containerID="1dc362ca0b279f4024c50bca9911cc9cdbcb6394977b79265cb8050991cce9c4" exitCode=0 Jul 07 16:11:08.192146 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.192059 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerDied","Data":"1dc362ca0b279f4024c50bca9911cc9cdbcb6394977b79265cb8050991cce9c4"} Jul 07 16:11:08.208758 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:08.208715 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4bsww" podStartSLOduration=3.350427104 podStartE2EDuration="28.20870207s" totalImagesPullingTime="24.858274966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:11:08.208285483 +0000 UTC m=+28.615488106" watchObservedRunningTime="2026-07-07 16:11:08.20870207 +0000 UTC m=+28.615904688" Jul 07 16:11:09.063479 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:09.063441 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:09.063760 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:09.063441 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:09.063760 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:09.063573 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:09.063760 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:09.063615 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:10.063998 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:10.063964 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:10.064383 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:10.064062 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:10.199301 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:10.199269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"e24fe872d6ac88979808d8df2972f8afa8da7465243fabe152eb3c7a3a2ba0de"} Jul 07 16:11:10.200950 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:10.200924 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8423cec-c965-4e4b-b366-050dfdf1ce59" containerID="43911796f9de98381a336c36910a5667990a1009b9c255403dfe47e86500c990" exitCode=0 Jul 07 16:11:10.201050 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:10.200978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerDied","Data":"43911796f9de98381a336c36910a5667990a1009b9c255403dfe47e86500c990"} Jul 07 16:11:11.063106 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:11.063067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:11.063278 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:11.063067 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:11.063278 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:11.063174 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:11.063278 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:11.063256 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:12.062852 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:12.062813 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:12.063824 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:12.062932 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:12.209323 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:12.209125 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" event={"ID":"5fb1537f-e9bf-4dd6-8c39-326102d64292","Type":"ContainerStarted","Data":"ebdab921f6f29a0f82ac183efc4ad2e4a87639b244613e351a2443f5270e4ad6"} Jul 07 16:11:12.209323 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:12.209382 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:11:12.209323 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:12.209439 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:11:12.216657 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:12.216629 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8423cec-c965-4e4b-b366-050dfdf1ce59" containerID="b44e0bb1a59314cc2bef2196038c916456198f24e4b470de1478cbdbe605cb46" exitCode=0 Jul 07 16:11:12.216788 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:12.216667 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerDied","Data":"b44e0bb1a59314cc2bef2196038c916456198f24e4b470de1478cbdbe605cb46"} Jul 07 16:11:12.227711 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:12.227688 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:11:12.239168 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:12.239122 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" podStartSLOduration=7.378040581 podStartE2EDuration="32.239107987s" totalImagesPullingTime="24.861067406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:11:12.238907193 +0000 UTC m=+32.646109816" watchObservedRunningTime="2026-07-07 16:11:12.239107987 +0000 UTC m=+32.646310603" Jul 07 16:11:13.062822 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.062790 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:13.062984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.062793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:13.062984 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.062891 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:13.062984 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.062978 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:13.225202 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.223237 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:11:13.243635 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.243606 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:11:13.796356 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.796320 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:13.796549 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.796370 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:13.796549 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.796472 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 16:11:13.796549 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.796477 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:11:13.796549 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.796529 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret podName:9cd1b59b-3916-4651-a3ae-527595660f75 nodeName:}" failed. No retries permitted until 2026-07-07 16:11:45.796514117 +0000 UTC m=+66.203716737 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret") pod "global-pull-secret-syncer-rs5zd" (UID: "9cd1b59b-3916-4651-a3ae-527595660f75") : object "kube-system"/"original-pull-secret" not registered Jul 07 16:11:13.796549 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.796545 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:11:45.796539114 +0000 UTC m=+66.203741714 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 16:11:13.879011 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.878974 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zjldg"] Jul 07 16:11:13.879183 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.879123 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:13.879249 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.879217 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:13.881864 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.881843 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rs5zd"] Jul 07 16:11:13.881978 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.881937 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:13.882021 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.882011 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:13.892770 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.892747 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lfhn7"] Jul 07 16:11:13.892873 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.892852 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:13.892962 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.892938 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:13.897508 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:13.897483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:13.897677 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.897655 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 16:11:13.897741 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.897684 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 16:11:13.897741 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.897697 2581 projected.go:196] Error preparing data for projected volume kube-api-access-6n64b for pod openshift-network-diagnostics/network-check-target-zjldg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:11:13.897827 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:13.897792 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b podName:052ce891-8d50-4448-83f3-6a0f543b1aa3 nodeName:}" failed. No retries permitted until 2026-07-07 16:11:45.897778162 +0000 UTC m=+66.304980762 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6n64b" (UniqueName: "kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b") pod "network-check-target-zjldg" (UID: "052ce891-8d50-4448-83f3-6a0f543b1aa3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 16:11:15.063372 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:15.063336 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:15.063372 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:15.063375 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:15.063776 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:15.063454 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:15.063776 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:15.063583 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:16.063541 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:16.063515 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:16.063938 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:16.063648 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:17.062575 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:17.062542 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:17.062768 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:17.062650 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:17.062768 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:17.062718 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:17.062854 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:17.062817 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:18.063168 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:18.063129 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:18.063549 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:18.063245 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zjldg" podUID="052ce891-8d50-4448-83f3-6a0f543b1aa3" Jul 07 16:11:19.062653 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.062611 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:19.062828 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.062629 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:19.062828 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:19.062729 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rs5zd" podUID="9cd1b59b-3916-4651-a3ae-527595660f75" Jul 07 16:11:19.062926 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:19.062826 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:11:19.903713 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.903640 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeReady" Jul 07 16:11:19.904140 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.903819 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 16:11:19.938919 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.938875 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67d447c6db-glgkj"] Jul 07 16:11:19.963368 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.963336 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67d447c6db-glgkj"] Jul 07 16:11:19.963534 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.963381 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4dzf7"] Jul 07 16:11:19.963534 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.963467 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:19.966192 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.966154 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 16:11:19.966358 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.966225 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ggm89\"" Jul 07 16:11:19.966358 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.966309 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 16:11:19.966358 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.966318 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 16:11:19.972526 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.972278 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 16:11:19.977324 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.977296 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2twqz"] Jul 07 16:11:19.977469 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.977447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:19.980042 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.980023 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kw4lk\"" Jul 07 16:11:19.980169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.980105 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 16:11:19.980380 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.980365 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 16:11:19.995367 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.995342 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2twqz"] Jul 07 16:11:19.995486 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.995377 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dzf7"] Jul 07 16:11:19.995486 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.995423 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2twqz" Jul 07 16:11:19.998017 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.997999 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p996z\"" Jul 07 16:11:19.998143 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.998117 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 16:11:19.998287 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.998268 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 16:11:19.998372 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:19.998270 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 16:11:20.064214 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.064184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:20.066948 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.066924 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:11:20.067073 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.066967 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rlz8z\"" Jul 07 16:11:20.067073 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.067017 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:11:20.141890 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.141855 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.141890 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.141895 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttjjp\" (UniqueName: \"kubernetes.io/projected/d8efd57e-7db3-43b5-8db1-1c3228d84e70-kube-api-access-ttjjp\") pod \"ingress-canary-2twqz\" (UID: \"d8efd57e-7db3-43b5-8db1-1c3228d84e70\") " pod="openshift-ingress-canary/ingress-canary-2twqz" Jul 07 16:11:20.142170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.141938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-image-registry-private-configuration\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.142170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.141955 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-trusted-ca\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.142170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.141972 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-installation-pull-secrets\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.142170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142005 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2kdf\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-kube-api-access-m2kdf\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.142170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfq6t\" (UniqueName: \"kubernetes.io/projected/e16f8521-2cd1-4e56-b923-17af5ec091bb-kube-api-access-hfq6t\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.142170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142153 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.142170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-bound-sa-token\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.142515 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142189 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-ca-trust-extracted\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.142515 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142208 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8efd57e-7db3-43b5-8db1-1c3228d84e70-cert\") pod \"ingress-canary-2twqz\" (UID: \"d8efd57e-7db3-43b5-8db1-1c3228d84e70\") " pod="openshift-ingress-canary/ingress-canary-2twqz" Jul 07 16:11:20.142515 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e16f8521-2cd1-4e56-b923-17af5ec091bb-tmp-dir\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.142515 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-certificates\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.142515 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.142356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e16f8521-2cd1-4e56-b923-17af5ec091bb-config-volume\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.243231 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.242982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2kdf\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-kube-api-access-m2kdf\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.243408 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243284 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfq6t\" (UniqueName: \"kubernetes.io/projected/e16f8521-2cd1-4e56-b923-17af5ec091bb-kube-api-access-hfq6t\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.243408 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243316 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.243408 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-bound-sa-token\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.243408 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243369 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-ca-trust-extracted\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.243603 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.243455 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:11:20.243603 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.243471 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:11:20.243603 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8efd57e-7db3-43b5-8db1-1c3228d84e70-cert\") pod \"ingress-canary-2twqz\" (UID: \"d8efd57e-7db3-43b5-8db1-1c3228d84e70\") " pod="openshift-ingress-canary/ingress-canary-2twqz" Jul 07 16:11:20.243603 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.243537 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:11:20.743518085 +0000 UTC m=+41.150720691 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:11:20.243603 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243584 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e16f8521-2cd1-4e56-b923-17af5ec091bb-tmp-dir\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.243753 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243615 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-certificates\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.243753 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e16f8521-2cd1-4e56-b923-17af5ec091bb-config-volume\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.243753 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.243753 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttjjp\" (UniqueName: \"kubernetes.io/projected/d8efd57e-7db3-43b5-8db1-1c3228d84e70-kube-api-access-ttjjp\") pod \"ingress-canary-2twqz\" (UID: \"d8efd57e-7db3-43b5-8db1-1c3228d84e70\") " pod="openshift-ingress-canary/ingress-canary-2twqz" Jul 07 16:11:20.243864 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.243789 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:11:20.243864 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.243826 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:11:20.743814712 +0000 UTC m=+41.151017312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:11:20.243960 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243905 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e16f8521-2cd1-4e56-b923-17af5ec091bb-tmp-dir\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.243960 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243927 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-ca-trust-extracted\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.243960 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243951 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-image-registry-private-configuration\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.244118 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.243986 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-trusted-ca\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.244118 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.244011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-installation-pull-secrets\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.244318 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.244290 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e16f8521-2cd1-4e56-b923-17af5ec091bb-config-volume\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.244440 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.244402 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-certificates\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.245081 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.245058 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-trusted-ca\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.248510 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.248489 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-installation-pull-secrets\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.248606 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.248490 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-image-registry-private-configuration\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.248606 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.248524 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8efd57e-7db3-43b5-8db1-1c3228d84e70-cert\") pod \"ingress-canary-2twqz\" (UID: \"d8efd57e-7db3-43b5-8db1-1c3228d84e70\") " pod="openshift-ingress-canary/ingress-canary-2twqz" Jul 07 16:11:20.252140 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.252082 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-bound-sa-token\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.252276 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.252254 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfq6t\" (UniqueName: \"kubernetes.io/projected/e16f8521-2cd1-4e56-b923-17af5ec091bb-kube-api-access-hfq6t\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.252349 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.252321 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2kdf\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-kube-api-access-m2kdf\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.253031 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.253009 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttjjp\" (UniqueName: \"kubernetes.io/projected/d8efd57e-7db3-43b5-8db1-1c3228d84e70-kube-api-access-ttjjp\") pod \"ingress-canary-2twqz\" (UID: \"d8efd57e-7db3-43b5-8db1-1c3228d84e70\") " pod="openshift-ingress-canary/ingress-canary-2twqz" Jul 07 16:11:20.306751 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.306708 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2twqz" Jul 07 16:11:20.748529 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.748488 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:20.748702 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.748583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:20.748702 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.748642 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:11:20.748702 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.748659 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:11:20.748804 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.748713 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:11:21.748700267 +0000 UTC m=+42.155902871 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:11:20.748804 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.748732 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:11:20.748804 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:20.748797 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:11:21.74878351 +0000 UTC m=+42.155986110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:11:20.976946 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:20.976910 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2twqz"] Jul 07 16:11:21.051576 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:11:21.051509 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8efd57e_7db3_43b5_8db1_1c3228d84e70.slice/crio-186d60ddc69870239d1fd9d97037d45a10e06e78e6ce404854b7a9c00382bd0c WatchSource:0}: Error finding container 186d60ddc69870239d1fd9d97037d45a10e06e78e6ce404854b7a9c00382bd0c: Status 404 returned error can't find the container with id 186d60ddc69870239d1fd9d97037d45a10e06e78e6ce404854b7a9c00382bd0c Jul 07 16:11:21.063372 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.063348 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:21.063444 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.063379 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:21.066075 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.066055 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:11:21.066179 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.066110 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wvdn7\"" Jul 07 16:11:21.067172 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.067157 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:11:21.245033 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.244835 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerStarted","Data":"ac2af194e1fc44c4638975e48f9daba449e1a59518071df4ac1e9889695f9c35"} Jul 07 16:11:21.246025 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.245998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2twqz" event={"ID":"d8efd57e-7db3-43b5-8db1-1c3228d84e70","Type":"ContainerStarted","Data":"186d60ddc69870239d1fd9d97037d45a10e06e78e6ce404854b7a9c00382bd0c"} Jul 07 16:11:21.756811 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.756774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:21.756960 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:21.756845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:21.757026 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:21.756966 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:11:21.757077 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:21.757054 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:11:23.757031579 +0000 UTC m=+44.164234196 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:11:21.757077 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:21.756971 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:11:21.757077 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:21.757076 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:11:21.757223 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:21.757149 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:11:23.757134262 +0000 UTC m=+44.164336875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:11:22.250342 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:22.250307 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8423cec-c965-4e4b-b366-050dfdf1ce59" containerID="ac2af194e1fc44c4638975e48f9daba449e1a59518071df4ac1e9889695f9c35" exitCode=0 Jul 07 16:11:22.250813 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:22.250349 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerDied","Data":"ac2af194e1fc44c4638975e48f9daba449e1a59518071df4ac1e9889695f9c35"} Jul 07 16:11:23.255387 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:23.255357 2581 generic.go:356] "Generic (PLEG): container finished" podID="c8423cec-c965-4e4b-b366-050dfdf1ce59" containerID="0d88d82b2db3d948ae13b5c693ca12d04ffdd5662cc3cd0be2e85fd4efc5041a" exitCode=0 Jul 07 16:11:23.255780 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:23.255407 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerDied","Data":"0d88d82b2db3d948ae13b5c693ca12d04ffdd5662cc3cd0be2e85fd4efc5041a"} Jul 07 16:11:23.772951 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:23.772915 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:23.773157 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:23.772994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:23.773157 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:23.773067 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:11:23.773157 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:23.773119 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:11:23.773157 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:23.773132 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:11:23.773157 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:23.773155 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:11:27.773137276 +0000 UTC m=+48.180339880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:11:23.773444 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:23.773173 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:11:27.773164117 +0000 UTC m=+48.180366717 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:11:24.262081 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:24.262021 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-z4rps" event={"ID":"c8423cec-c965-4e4b-b366-050dfdf1ce59","Type":"ContainerStarted","Data":"d26c0081fe59ecf56887f51ab90aa599e47b784a9a40243a17efeb19bfaa76e5"} Jul 07 16:11:24.292524 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:24.292476 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-z4rps" podStartSLOduration=8.719353837 podStartE2EDuration="44.292460377s" totalImagesPullingTime="35.57310654s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:11:24.290038661 +0000 UTC m=+44.697241283" watchObservedRunningTime="2026-07-07 16:11:24.292460377 +0000 UTC m=+44.699662999" Jul 07 16:11:25.270085 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:25.270042 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2twqz" event={"ID":"d8efd57e-7db3-43b5-8db1-1c3228d84e70","Type":"ContainerStarted","Data":"4aabfba719bf01cfda478cf16889db0ac0fca31cd3c87a0644a36be23a3bf091"} Jul 07 16:11:25.288921 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:25.288862 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2twqz" podStartSLOduration=2.691663649 podStartE2EDuration="6.288847049s" totalImagesPullingTime="3.5971834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:11:25.287332199 +0000 UTC m=+45.694534822" watchObservedRunningTime="2026-07-07 16:11:25.288847049 +0000 UTC m=+45.696049671" Jul 07 16:11:27.799985 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:27.799937 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:27.800450 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:27.800008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:27.800450 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:27.800086 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:11:27.800450 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:27.800148 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:11:27.800450 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:27.800171 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:11:27.800450 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:27.800176 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:11:35.800159156 +0000 UTC m=+56.207361755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:11:27.800450 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:27.800229 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:11:35.800213509 +0000 UTC m=+56.207416128 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:11:35.860547 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:35.860486 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:35.861169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:35.860588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:35.861169 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:35.860656 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:11:35.861169 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:35.860675 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:11:35.861169 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:35.860723 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:11:35.861169 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:35.860738 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:11:51.860723237 +0000 UTC m=+72.267925837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:11:35.861169 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:35.860782 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:11:51.860766902 +0000 UTC m=+72.267969508 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:11:45.236777 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.236750 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hcfqv" Jul 07 16:11:45.838825 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.838777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:11:45.839016 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.838838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:45.841806 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.841786 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 16:11:45.841806 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.841800 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 16:11:45.849948 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:45.849925 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 16:11:45.850053 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:45.850015 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:12:49.849992772 +0000 UTC m=+130.257195376 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : secret "metrics-daemon-secret" not found Jul 07 16:11:45.853541 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.853523 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9cd1b59b-3916-4651-a3ae-527595660f75-original-pull-secret\") pod \"global-pull-secret-syncer-rs5zd\" (UID: \"9cd1b59b-3916-4651-a3ae-527595660f75\") " pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:45.939411 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.939373 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:45.942310 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.942286 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 16:11:45.951999 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.951976 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 16:11:45.962446 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.962421 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n64b\" (UniqueName: \"kubernetes.io/projected/052ce891-8d50-4448-83f3-6a0f543b1aa3-kube-api-access-6n64b\") pod \"network-check-target-zjldg\" (UID: \"052ce891-8d50-4448-83f3-6a0f543b1aa3\") " pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:45.979448 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:45.979421 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rs5zd" Jul 07 16:11:46.100623 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.100554 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rs5zd"] Jul 07 16:11:46.103909 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:11:46.103880 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cd1b59b_3916_4651_a3ae_527595660f75.slice/crio-7a95739f6f08969895a80a153a13d01db6228a89fad4fd5d8154789eb7dcd9b6 WatchSource:0}: Error finding container 7a95739f6f08969895a80a153a13d01db6228a89fad4fd5d8154789eb7dcd9b6: Status 404 returned error can't find the container with id 7a95739f6f08969895a80a153a13d01db6228a89fad4fd5d8154789eb7dcd9b6 Jul 07 16:11:46.177376 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.177344 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rlz8z\"" Jul 07 16:11:46.185519 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.185498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:46.305450 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.305419 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zjldg"] Jul 07 16:11:46.308695 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:11:46.308668 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod052ce891_8d50_4448_83f3_6a0f543b1aa3.slice/crio-7f147a2ed42cbeca57fde402b6d2bbb2d7850d06e49b8a9484fccc66c24f8fc8 WatchSource:0}: Error finding container 7f147a2ed42cbeca57fde402b6d2bbb2d7850d06e49b8a9484fccc66c24f8fc8: Status 404 returned error can't find the container with id 7f147a2ed42cbeca57fde402b6d2bbb2d7850d06e49b8a9484fccc66c24f8fc8 Jul 07 16:11:46.318941 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.318913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zjldg" event={"ID":"052ce891-8d50-4448-83f3-6a0f543b1aa3","Type":"ContainerStarted","Data":"7f147a2ed42cbeca57fde402b6d2bbb2d7850d06e49b8a9484fccc66c24f8fc8"} Jul 07 16:11:46.320045 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.320022 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rs5zd" event={"ID":"9cd1b59b-3916-4651-a3ae-527595660f75","Type":"ContainerStarted","Data":"7a95739f6f08969895a80a153a13d01db6228a89fad4fd5d8154789eb7dcd9b6"} Jul 07 16:11:46.343943 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.343914 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25"] Jul 07 16:11:46.347908 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.347893 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.350879 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.350821 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 07 16:11:46.350879 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.350847 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 07 16:11:46.351018 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.350821 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 07 16:11:46.352011 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.351991 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 07 16:11:46.356163 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.356129 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25"] Jul 07 16:11:46.444251 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.444215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87cdf8f1-d74f-43a1-82e3-67ce9010390c-tmp\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.444251 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.444258 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/87cdf8f1-d74f-43a1-82e3-67ce9010390c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.444444 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.444276 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bsj5\" (UniqueName: \"kubernetes.io/projected/87cdf8f1-d74f-43a1-82e3-67ce9010390c-kube-api-access-2bsj5\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.544676 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.544636 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87cdf8f1-d74f-43a1-82e3-67ce9010390c-tmp\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.544676 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.544681 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/87cdf8f1-d74f-43a1-82e3-67ce9010390c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.544938 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.544702 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bsj5\" (UniqueName: \"kubernetes.io/projected/87cdf8f1-d74f-43a1-82e3-67ce9010390c-kube-api-access-2bsj5\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.545079 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.545057 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/87cdf8f1-d74f-43a1-82e3-67ce9010390c-tmp\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.547152 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.547130 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/87cdf8f1-d74f-43a1-82e3-67ce9010390c-klusterlet-config\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.555749 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.555727 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bsj5\" (UniqueName: \"kubernetes.io/projected/87cdf8f1-d74f-43a1-82e3-67ce9010390c-kube-api-access-2bsj5\") pod \"klusterlet-addon-workmgr-6cd5d848d8-t4m25\" (UID: \"87cdf8f1-d74f-43a1-82e3-67ce9010390c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.658674 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.658579 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:46.778779 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:46.778746 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25"] Jul 07 16:11:46.783712 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:11:46.783680 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87cdf8f1_d74f_43a1_82e3_67ce9010390c.slice/crio-48dd60822d0163cb47c57de569c6fb56a0abe3fe0c586ba8ca1e4acc266e2362 WatchSource:0}: Error finding container 48dd60822d0163cb47c57de569c6fb56a0abe3fe0c586ba8ca1e4acc266e2362: Status 404 returned error can't find the container with id 48dd60822d0163cb47c57de569c6fb56a0abe3fe0c586ba8ca1e4acc266e2362 Jul 07 16:11:47.324000 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:47.323958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" event={"ID":"87cdf8f1-d74f-43a1-82e3-67ce9010390c","Type":"ContainerStarted","Data":"48dd60822d0163cb47c57de569c6fb56a0abe3fe0c586ba8ca1e4acc266e2362"} Jul 07 16:11:51.887334 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:51.887299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:11:51.887774 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:51.887354 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:11:51.887774 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:51.887450 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:11:51.887774 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:51.887467 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:11:51.887774 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:51.887471 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:11:51.887774 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:51.887519 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:12:23.887504937 +0000 UTC m=+104.294707538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:11:51.887774 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:11:51.887533 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:12:23.887527254 +0000 UTC m=+104.294729855 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:11:54.345522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.345486 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rs5zd" event={"ID":"9cd1b59b-3916-4651-a3ae-527595660f75","Type":"ContainerStarted","Data":"6b6cfa1572adf32c181c4b53a446f84f15fa9c78775df7244c0ee17b9b800ef3"} Jul 07 16:11:54.347061 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.347031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" event={"ID":"87cdf8f1-d74f-43a1-82e3-67ce9010390c","Type":"ContainerStarted","Data":"8856da8725587564b0ee6ef6be2fb98ebf5f0ab4133389f45b3cdea83b613723"} Jul 07 16:11:54.347219 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.347200 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:54.348682 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.348654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zjldg" event={"ID":"052ce891-8d50-4448-83f3-6a0f543b1aa3","Type":"ContainerStarted","Data":"426521c180516fe2a0ad922251b0e8f48c7529bf1a831774ce754875f44c21a8"} Jul 07 16:11:54.348876 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.348785 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:11:54.349201 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.349181 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:11:54.361765 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.361723 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rs5zd" podStartSLOduration=67.043615235 podStartE2EDuration="1m14.361710795s" totalImagesPullingTime="7.31809556s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:11:54.360847754 +0000 UTC m=+74.768050377" watchObservedRunningTime="2026-07-07 16:11:54.361710795 +0000 UTC m=+74.768913417" Jul 07 16:11:54.375926 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.375882 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zjldg" podStartSLOduration=67.274705796 podStartE2EDuration="1m14.375868234s" totalImagesPullingTime="7.101162438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:11:54.375551324 +0000 UTC m=+74.782753947" watchObservedRunningTime="2026-07-07 16:11:54.375868234 +0000 UTC m=+74.783070855" Jul 07 16:11:54.392112 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:11:54.392052 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" podStartSLOduration=1.752078487 podStartE2EDuration="8.392038047s" totalImagesPullingTime="6.63995956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:11:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:11:54.391687175 +0000 UTC m=+74.798889797" watchObservedRunningTime="2026-07-07 16:11:54.392038047 +0000 UTC m=+74.799240668" Jul 07 16:12:23.923295 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:12:23.923259 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:12:23.923726 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:12:23.923317 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:12:23.923726 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:12:23.923405 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:12:23.923726 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:12:23.923460 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:13:27.9234465 +0000 UTC m=+168.330649101 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:12:23.923726 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:12:23.923402 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:12:23.923726 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:12:23.923492 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:12:23.923726 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:12:23.923553 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:13:27.92353927 +0000 UTC m=+168.330741870 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:12:25.354426 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:12:25.354397 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zjldg" Jul 07 16:12:49.909176 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:12:49.909126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:12:49.909597 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:12:49.909312 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 16:12:49.909597 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:12:49.909380 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:14:51.909365125 +0000 UTC m=+252.316567726 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : secret "metrics-daemon-secret" not found Jul 07 16:13:22.976114 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:13:22.976057 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" podUID="6389363e-c5df-4cc3-b893-e6f7e8a93c7c" Jul 07 16:13:22.987176 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:13:22.987142 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4dzf7" podUID="e16f8521-2cd1-4e56-b923-17af5ec091bb" Jul 07 16:13:23.555835 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:23.555802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dzf7" Jul 07 16:13:24.073415 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:13:24.073377 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:13:27.985759 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:27.985712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:13:27.986231 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:27.985784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:13:27.986231 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:13:27.985865 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 16:13:27.986231 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:13:27.985885 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67d447c6db-glgkj: secret "image-registry-tls" not found Jul 07 16:13:27.986231 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:13:27.985909 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 16:13:27.986231 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:13:27.985963 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls podName:6389363e-c5df-4cc3-b893-e6f7e8a93c7c nodeName:}" failed. No retries permitted until 2026-07-07 16:15:29.985947297 +0000 UTC m=+290.393149901 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls") pod "image-registry-67d447c6db-glgkj" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c") : secret "image-registry-tls" not found Jul 07 16:13:27.986231 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:13:27.985977 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls podName:e16f8521-2cd1-4e56-b923-17af5ec091bb nodeName:}" failed. No retries permitted until 2026-07-07 16:15:29.985971727 +0000 UTC m=+290.393174326 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls") pod "dns-default-4dzf7" (UID: "e16f8521-2cd1-4e56-b923-17af5ec091bb") : secret "dns-default-metrics-tls" not found Jul 07 16:13:34.063715 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:34.063619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:13:35.063286 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:35.063248 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:13:53.628994 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:53.628955 2581 generic.go:356] "Generic (PLEG): container finished" podID="87cdf8f1-d74f-43a1-82e3-67ce9010390c" containerID="8856da8725587564b0ee6ef6be2fb98ebf5f0ab4133389f45b3cdea83b613723" exitCode=1 Jul 07 16:13:53.629380 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:53.629023 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" event={"ID":"87cdf8f1-d74f-43a1-82e3-67ce9010390c","Type":"ContainerDied","Data":"8856da8725587564b0ee6ef6be2fb98ebf5f0ab4133389f45b3cdea83b613723"} Jul 07 16:13:53.629380 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:53.629365 2581 scope.go:117] "RemoveContainer" containerID="8856da8725587564b0ee6ef6be2fb98ebf5f0ab4133389f45b3cdea83b613723" Jul 07 16:13:54.347726 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:54.347688 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:13:54.632801 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:54.632712 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" event={"ID":"87cdf8f1-d74f-43a1-82e3-67ce9010390c","Type":"ContainerStarted","Data":"57d61b9d87e30b0bc44486102c850e42cdbe93aa3d1fe96289efa2b4760c8a1b"} Jul 07 16:13:54.633260 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:54.632962 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:13:54.633523 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:13:54.633508 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:14:51.995179 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:14:51.995126 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:14:51.995655 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:14:51.995284 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 16:14:51.995655 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:14:51.995352 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs podName:ab32e5be-3eea-4303-98f9-247e50b9bf06 nodeName:}" failed. No retries permitted until 2026-07-07 16:16:53.995335546 +0000 UTC m=+374.402538146 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs") pod "network-metrics-daemon-lfhn7" (UID: "ab32e5be-3eea-4303-98f9-247e50b9bf06") : secret "metrics-daemon-secret" not found Jul 07 16:15:01.557718 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.557637 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6"] Jul 07 16:15:01.560479 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.560462 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:01.563424 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.563391 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 07 16:15:01.563424 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.563394 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 07 16:15:01.563720 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.563446 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 07 16:15:01.564665 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.564651 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-cm9lf\"" Jul 07 16:15:01.575286 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.575265 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6"] Jul 07 16:15:01.654866 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.654830 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn"] Jul 07 16:15:01.657678 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.657661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn" Jul 07 16:15:01.660423 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.660404 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qd4hh\"" Jul 07 16:15:01.662442 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.662423 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhvxw\" (UniqueName: \"kubernetes.io/projected/7cba9074-e21c-4946-be89-afbde1896780-kube-api-access-bhvxw\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:01.662563 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.662469 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:01.672256 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.672235 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn"] Jul 07 16:15:01.763751 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.763710 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhvxw\" (UniqueName: \"kubernetes.io/projected/7cba9074-e21c-4946-be89-afbde1896780-kube-api-access-bhvxw\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:01.763751 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.763758 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:01.763963 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.763785 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pskhh\" (UniqueName: \"kubernetes.io/projected/90a26398-a0e3-408b-ba0d-c064636f8061-kube-api-access-pskhh\") pod \"network-check-source-989f8b8dc-cgssn\" (UID: \"90a26398-a0e3-408b-ba0d-c064636f8061\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn" Jul 07 16:15:01.763963 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:01.763877 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:15:01.763963 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:01.763945 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls podName:7cba9074-e21c-4946-be89-afbde1896780 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:02.263927709 +0000 UTC m=+262.671130326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h82c6" (UID: "7cba9074-e21c-4946-be89-afbde1896780") : secret "samples-operator-tls" not found Jul 07 16:15:01.773033 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.773008 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhvxw\" (UniqueName: \"kubernetes.io/projected/7cba9074-e21c-4946-be89-afbde1896780-kube-api-access-bhvxw\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:01.864897 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.864796 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pskhh\" (UniqueName: \"kubernetes.io/projected/90a26398-a0e3-408b-ba0d-c064636f8061-kube-api-access-pskhh\") pod \"network-check-source-989f8b8dc-cgssn\" (UID: \"90a26398-a0e3-408b-ba0d-c064636f8061\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn" Jul 07 16:15:01.874679 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.874656 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pskhh\" (UniqueName: \"kubernetes.io/projected/90a26398-a0e3-408b-ba0d-c064636f8061-kube-api-access-pskhh\") pod \"network-check-source-989f8b8dc-cgssn\" (UID: \"90a26398-a0e3-408b-ba0d-c064636f8061\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn" Jul 07 16:15:01.965998 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:01.965963 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn" Jul 07 16:15:02.088309 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:02.088256 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn"] Jul 07 16:15:02.090648 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:02.090622 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90a26398_a0e3_408b_ba0d_c064636f8061.slice/crio-b4ea83c648a025e9032ab59fdf68457ed6a270383b7fccd7914ae8f78828b95a WatchSource:0}: Error finding container b4ea83c648a025e9032ab59fdf68457ed6a270383b7fccd7914ae8f78828b95a: Status 404 returned error can't find the container with id b4ea83c648a025e9032ab59fdf68457ed6a270383b7fccd7914ae8f78828b95a Jul 07 16:15:02.267726 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:02.267690 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:02.267891 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:02.267807 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:15:02.267891 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:02.267860 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls podName:7cba9074-e21c-4946-be89-afbde1896780 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:03.267845606 +0000 UTC m=+263.675048211 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h82c6" (UID: "7cba9074-e21c-4946-be89-afbde1896780") : secret "samples-operator-tls" not found Jul 07 16:15:02.802428 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:02.802394 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn" event={"ID":"90a26398-a0e3-408b-ba0d-c064636f8061","Type":"ContainerStarted","Data":"157443eb176dbbb1dc482cce32c711fec43b98632c3e92534f6e0720fc11a33b"} Jul 07 16:15:02.802895 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:02.802452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn" event={"ID":"90a26398-a0e3-408b-ba0d-c064636f8061","Type":"ContainerStarted","Data":"b4ea83c648a025e9032ab59fdf68457ed6a270383b7fccd7914ae8f78828b95a"} Jul 07 16:15:02.824745 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:02.824689 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-cgssn" podStartSLOduration=1.824670832 podStartE2EDuration="1.824670832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:02.823683375 +0000 UTC m=+263.230885997" watchObservedRunningTime="2026-07-07 16:15:02.824670832 +0000 UTC m=+263.231873509" Jul 07 16:15:03.274510 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:03.274477 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:03.274706 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:03.274647 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:15:03.274765 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:03.274726 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls podName:7cba9074-e21c-4946-be89-afbde1896780 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:05.27470231 +0000 UTC m=+265.681904921 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h82c6" (UID: "7cba9074-e21c-4946-be89-afbde1896780") : secret "samples-operator-tls" not found Jul 07 16:15:05.290484 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:05.290425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:05.290892 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:05.290594 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:15:05.290892 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:05.290662 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls podName:7cba9074-e21c-4946-be89-afbde1896780 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:09.290645663 +0000 UTC m=+269.697848268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h82c6" (UID: "7cba9074-e21c-4946-be89-afbde1896780") : secret "samples-operator-tls" not found Jul 07 16:15:07.645592 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.645557 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jlcj5"] Jul 07 16:15:07.648642 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.648625 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.651387 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.651360 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 16:15:07.651524 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.651388 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 16:15:07.651524 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.651419 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 16:15:07.651524 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.651431 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pp9hp\"" Jul 07 16:15:07.652457 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.652437 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 16:15:07.671560 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.671539 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jlcj5"] Jul 07 16:15:07.706155 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.706122 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfef5166-d088-4911-8b94-94ac6082968e-crio-socket\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.706155 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.706161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfef5166-d088-4911-8b94-94ac6082968e-data-volume\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.706369 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.706187 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.706369 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.706207 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m7fc\" (UniqueName: \"kubernetes.io/projected/cfef5166-d088-4911-8b94-94ac6082968e-kube-api-access-8m7fc\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.706369 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.706246 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.806841 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.806802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfef5166-d088-4911-8b94-94ac6082968e-crio-socket\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.806841 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.806841 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfef5166-d088-4911-8b94-94ac6082968e-data-volume\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.807084 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.806860 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.807084 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.806931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m7fc\" (UniqueName: \"kubernetes.io/projected/cfef5166-d088-4911-8b94-94ac6082968e-kube-api-access-8m7fc\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.807084 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:07.806949 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:15:07.807084 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.806989 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.807084 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:07.807000 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:08.306986914 +0000 UTC m=+268.714189514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : secret "insights-runtime-extractor-tls" not found Jul 07 16:15:07.807084 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:07.807033 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:15:07.807084 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.806934 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cfef5166-d088-4911-8b94-94ac6082968e-crio-socket\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.807084 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:07.807085 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:08.307070651 +0000 UTC m=+268.714273251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : configmap "kube-rbac-proxy" not found Jul 07 16:15:07.807470 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.807234 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfef5166-d088-4911-8b94-94ac6082968e-data-volume\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.821884 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.821856 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m7fc\" (UniqueName: \"kubernetes.io/projected/cfef5166-d088-4911-8b94-94ac6082968e-kube-api-access-8m7fc\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:07.881735 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.881703 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q"] Jul 07 16:15:07.884664 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.884649 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" Jul 07 16:15:07.889051 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.889029 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 16:15:07.889051 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.889047 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-wqggm\"" Jul 07 16:15:07.889273 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.889047 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 16:15:07.893815 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:07.893792 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q"] Jul 07 16:15:08.008633 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:08.008600 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47z5w\" (UniqueName: \"kubernetes.io/projected/32489081-30a2-49a3-b315-bf73c0164aba-kube-api-access-47z5w\") pod \"migrator-d57d58cc9-z6l4q\" (UID: \"32489081-30a2-49a3-b315-bf73c0164aba\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" Jul 07 16:15:08.109864 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:08.109825 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47z5w\" (UniqueName: \"kubernetes.io/projected/32489081-30a2-49a3-b315-bf73c0164aba-kube-api-access-47z5w\") pod \"migrator-d57d58cc9-z6l4q\" (UID: \"32489081-30a2-49a3-b315-bf73c0164aba\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" Jul 07 16:15:08.117932 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:08.117899 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47z5w\" (UniqueName: \"kubernetes.io/projected/32489081-30a2-49a3-b315-bf73c0164aba-kube-api-access-47z5w\") pod \"migrator-d57d58cc9-z6l4q\" (UID: \"32489081-30a2-49a3-b315-bf73c0164aba\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" Jul 07 16:15:08.193788 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:08.193760 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" Jul 07 16:15:08.311516 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:08.311483 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:08.311656 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:08.311533 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:08.311656 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:08.311617 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:15:08.311656 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:08.311632 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:15:08.311821 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:08.311682 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:09.311667722 +0000 UTC m=+269.718870344 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : secret "insights-runtime-extractor-tls" not found Jul 07 16:15:08.311821 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:08.311696 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:09.311690725 +0000 UTC m=+269.718893328 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : configmap "kube-rbac-proxy" not found Jul 07 16:15:08.313720 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:08.313696 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q"] Jul 07 16:15:08.316758 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:08.316730 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32489081_30a2_49a3_b315_bf73c0164aba.slice/crio-2a53d5f2f13554b5b2e8ea6501d24b9f527efedc612fc5a60c628d0cdafa0c17 WatchSource:0}: Error finding container 2a53d5f2f13554b5b2e8ea6501d24b9f527efedc612fc5a60c628d0cdafa0c17: Status 404 returned error can't find the container with id 2a53d5f2f13554b5b2e8ea6501d24b9f527efedc612fc5a60c628d0cdafa0c17 Jul 07 16:15:08.821449 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:08.821417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" event={"ID":"32489081-30a2-49a3-b315-bf73c0164aba","Type":"ContainerStarted","Data":"2a53d5f2f13554b5b2e8ea6501d24b9f527efedc612fc5a60c628d0cdafa0c17"} Jul 07 16:15:09.318542 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:09.318500 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:09.318542 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:09.318541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:09.318744 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:09.318605 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:09.318744 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:09.318660 2581 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 07 16:15:09.318744 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:09.318704 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:15:09.318744 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:09.318721 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls podName:7cba9074-e21c-4946-be89-afbde1896780 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:17.318706707 +0000 UTC m=+277.725909306 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-h82c6" (UID: "7cba9074-e21c-4946-be89-afbde1896780") : secret "samples-operator-tls" not found Jul 07 16:15:09.318879 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:09.318757 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:11.318745199 +0000 UTC m=+271.725947803 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : configmap "kube-rbac-proxy" not found Jul 07 16:15:09.318879 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:09.318766 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:15:09.318879 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:09.318812 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:11.318790949 +0000 UTC m=+271.725993549 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : secret "insights-runtime-extractor-tls" not found Jul 07 16:15:09.641833 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:09.641600 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hjxzx_8a2d0cb9-a4f1-46a2-b838-6c92146f9677/dns-node-resolver/0.log" Jul 07 16:15:10.830141 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:10.830084 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" event={"ID":"32489081-30a2-49a3-b315-bf73c0164aba","Type":"ContainerStarted","Data":"d7525ba91dc5ad7ee664901498ec9662d9b49e182d5c72fed1bee58ae7aa2f52"} Jul 07 16:15:10.830555 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:10.830157 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" event={"ID":"32489081-30a2-49a3-b315-bf73c0164aba","Type":"ContainerStarted","Data":"9ec8e2a7563096c4bffdcf1cee18d3dacb38a8e1ad9b94fb0f2a85b4172e4096"} Jul 07 16:15:10.838912 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:10.838890 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxvmj_82e05262-7701-4d63-a4d8-1a53e6eec64c/node-ca/0.log" Jul 07 16:15:10.847644 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:10.847596 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-z6l4q" podStartSLOduration=2.232471118 podStartE2EDuration="3.847581979s" totalImagesPullingTime="1.615110861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:10.8469941 +0000 UTC m=+271.254196723" watchObservedRunningTime="2026-07-07 16:15:10.847581979 +0000 UTC m=+271.254784601" Jul 07 16:15:11.240004 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:11.239972 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2twqz_d8efd57e-7db3-43b5-8db1-1c3228d84e70/serve-healthcheck-canary/0.log" Jul 07 16:15:11.335812 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:11.335773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:11.335975 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:11.335890 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:11.335975 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:11.335906 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:15:11.335975 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:11.335971 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:15.335953295 +0000 UTC m=+275.743155910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : configmap "kube-rbac-proxy" not found Jul 07 16:15:11.336172 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:11.336015 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:15:11.336172 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:11.336070 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:15.336054823 +0000 UTC m=+275.743257437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : secret "insights-runtime-extractor-tls" not found Jul 07 16:15:15.370968 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:15.370930 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:15.371413 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:15.370978 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:15.371413 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:15.371046 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 16:15:15.371413 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:15.371109 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 16:15:15.371413 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:15.371118 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:23.371085134 +0000 UTC m=+283.778287748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : configmap "kube-rbac-proxy" not found Jul 07 16:15:15.371413 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:15.371185 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls podName:cfef5166-d088-4911-8b94-94ac6082968e nodeName:}" failed. No retries permitted until 2026-07-07 16:15:23.371169033 +0000 UTC m=+283.778371638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jlcj5" (UID: "cfef5166-d088-4911-8b94-94ac6082968e") : secret "insights-runtime-extractor-tls" not found Jul 07 16:15:17.388106 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:17.388060 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:17.390417 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:17.390398 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cba9074-e21c-4946-be89-afbde1896780-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-h82c6\" (UID: \"7cba9074-e21c-4946-be89-afbde1896780\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:17.469153 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:17.469115 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" Jul 07 16:15:17.591130 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:17.591084 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6"] Jul 07 16:15:17.851716 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:17.851671 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" event={"ID":"7cba9074-e21c-4946-be89-afbde1896780","Type":"ContainerStarted","Data":"2410f264394fe575fb24619c626ccd55414180134070ef368adf425b947964ce"} Jul 07 16:15:20.865795 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:20.865751 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" event={"ID":"7cba9074-e21c-4946-be89-afbde1896780","Type":"ContainerStarted","Data":"af236eccdfc70e9d45983f9939c2274d85d421f0b5480dc2858062e5e8f27bdd"} Jul 07 16:15:20.866192 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:20.865849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" event={"ID":"7cba9074-e21c-4946-be89-afbde1896780","Type":"ContainerStarted","Data":"0d1676a67bab28ad4ed6abfd746331555ce22f6d567b6e557c5ba14e781451ab"} Jul 07 16:15:20.884286 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:20.884241 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-h82c6" podStartSLOduration=17.679382921 podStartE2EDuration="19.88422823s" totalImagesPullingTime="2.204845309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:20.883696564 +0000 UTC m=+281.290899187" watchObservedRunningTime="2026-07-07 16:15:20.88422823 +0000 UTC m=+281.291430852" Jul 07 16:15:23.442828 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:23.442788 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:23.443314 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:23.442921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:23.443439 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:23.443419 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cfef5166-d088-4911-8b94-94ac6082968e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:23.445231 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:23.445210 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cfef5166-d088-4911-8b94-94ac6082968e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlcj5\" (UID: \"cfef5166-d088-4911-8b94-94ac6082968e\") " pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:23.557551 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:23.557517 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jlcj5" Jul 07 16:15:23.684369 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:23.684343 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jlcj5"] Jul 07 16:15:23.686497 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:23.686472 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfef5166_d088_4911_8b94_94ac6082968e.slice/crio-385a8d88b403709904ed2461b22b17c0ac98d934c99659e219116f5c267caca9 WatchSource:0}: Error finding container 385a8d88b403709904ed2461b22b17c0ac98d934c99659e219116f5c267caca9: Status 404 returned error can't find the container with id 385a8d88b403709904ed2461b22b17c0ac98d934c99659e219116f5c267caca9 Jul 07 16:15:23.875677 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:23.875591 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlcj5" event={"ID":"cfef5166-d088-4911-8b94-94ac6082968e","Type":"ContainerStarted","Data":"385a8d88b403709904ed2461b22b17c0ac98d934c99659e219116f5c267caca9"} Jul 07 16:15:26.557182 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:26.557134 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4dzf7" podUID="e16f8521-2cd1-4e56-b923-17af5ec091bb" Jul 07 16:15:26.886427 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:26.886350 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dzf7" Jul 07 16:15:27.890402 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:27.890318 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlcj5" event={"ID":"cfef5166-d088-4911-8b94-94ac6082968e","Type":"ContainerStarted","Data":"e0a1c68957fadc8518d5145ee4b524c6b65d1df8c99a1e89b5bee9529e664fcb"} Jul 07 16:15:28.895864 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:28.895826 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlcj5" event={"ID":"cfef5166-d088-4911-8b94-94ac6082968e","Type":"ContainerStarted","Data":"ac5e8613a2b8b827a76ae31e61d82501a9c8a9b718ca9cd095c383e1601d64c5"} Jul 07 16:15:29.993977 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:29.993935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:15:29.994367 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:29.994035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:15:29.996277 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:29.996249 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e16f8521-2cd1-4e56-b923-17af5ec091bb-metrics-tls\") pod \"dns-default-4dzf7\" (UID: \"e16f8521-2cd1-4e56-b923-17af5ec091bb\") " pod="openshift-dns/dns-default-4dzf7" Jul 07 16:15:29.996382 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:29.996329 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"image-registry-67d447c6db-glgkj\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:15:30.167494 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:30.167456 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ggm89\"" Jul 07 16:15:30.175654 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:30.175623 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:15:30.189913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:30.189890 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kw4lk\"" Jul 07 16:15:30.197240 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:30.197219 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4dzf7" Jul 07 16:15:31.177184 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.177026 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67d447c6db-glgkj"] Jul 07 16:15:31.179224 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:31.179197 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6389363e_c5df_4cc3_b893_e6f7e8a93c7c.slice/crio-787aaadbfae88c5c6d784a29d6db792c78577bbda1ddf5c7732a37e8111636e5 WatchSource:0}: Error finding container 787aaadbfae88c5c6d784a29d6db792c78577bbda1ddf5c7732a37e8111636e5: Status 404 returned error can't find the container with id 787aaadbfae88c5c6d784a29d6db792c78577bbda1ddf5c7732a37e8111636e5 Jul 07 16:15:31.191599 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.191577 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4dzf7"] Jul 07 16:15:31.194449 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:31.194419 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode16f8521_2cd1_4e56_b923_17af5ec091bb.slice/crio-e70afee26ec3196bdb69405ec2a1368fe68bf0226b1d21c16de5eb47eb21f055 WatchSource:0}: Error finding container e70afee26ec3196bdb69405ec2a1368fe68bf0226b1d21c16de5eb47eb21f055: Status 404 returned error can't find the container with id e70afee26ec3196bdb69405ec2a1368fe68bf0226b1d21c16de5eb47eb21f055 Jul 07 16:15:31.906875 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.906831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlcj5" event={"ID":"cfef5166-d088-4911-8b94-94ac6082968e","Type":"ContainerStarted","Data":"9d75247f3698a11af542ff3bad00b8270a2cedddeffadd3f2472d774d41c5742"} Jul 07 16:15:31.908233 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.908204 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dzf7" event={"ID":"e16f8521-2cd1-4e56-b923-17af5ec091bb","Type":"ContainerStarted","Data":"e70afee26ec3196bdb69405ec2a1368fe68bf0226b1d21c16de5eb47eb21f055"} Jul 07 16:15:31.909863 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.909835 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" event={"ID":"6389363e-c5df-4cc3-b893-e6f7e8a93c7c","Type":"ContainerStarted","Data":"f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4"} Jul 07 16:15:31.909988 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.909882 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" event={"ID":"6389363e-c5df-4cc3-b893-e6f7e8a93c7c","Type":"ContainerStarted","Data":"787aaadbfae88c5c6d784a29d6db792c78577bbda1ddf5c7732a37e8111636e5"} Jul 07 16:15:31.910045 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.909992 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:15:31.927529 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.927485 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jlcj5" podStartSLOduration=17.632032053 podStartE2EDuration="24.927469985s" totalImagesPullingTime="7.295437932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:15:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:31.925427124 +0000 UTC m=+292.332629751" watchObservedRunningTime="2026-07-07 16:15:31.927469985 +0000 UTC m=+292.334672607" Jul 07 16:15:31.946974 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:31.946932 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" podStartSLOduration=291.946917903 podStartE2EDuration="4m51.946917903s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:31.946469732 +0000 UTC m=+292.353672354" watchObservedRunningTime="2026-07-07 16:15:31.946917903 +0000 UTC m=+292.354120506" Jul 07 16:15:32.830432 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:32.830399 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-864fm"] Jul 07 16:15:32.833622 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:32.833599 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-864fm" Jul 07 16:15:32.836775 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:32.836747 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 16:15:32.836898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:32.836746 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5nwzv\"" Jul 07 16:15:32.836898 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:32.836840 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 16:15:32.849679 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:32.849652 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-864fm"] Jul 07 16:15:32.919804 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:32.919770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m5pn\" (UniqueName: \"kubernetes.io/projected/352efe56-78bd-4354-a5a9-7b95869fd19d-kube-api-access-8m5pn\") pod \"downloads-685bfb5f64-864fm\" (UID: \"352efe56-78bd-4354-a5a9-7b95869fd19d\") " pod="openshift-console/downloads-685bfb5f64-864fm" Jul 07 16:15:33.021165 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.021125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m5pn\" (UniqueName: \"kubernetes.io/projected/352efe56-78bd-4354-a5a9-7b95869fd19d-kube-api-access-8m5pn\") pod \"downloads-685bfb5f64-864fm\" (UID: \"352efe56-78bd-4354-a5a9-7b95869fd19d\") " pod="openshift-console/downloads-685bfb5f64-864fm" Jul 07 16:15:33.031952 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.031922 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m5pn\" (UniqueName: \"kubernetes.io/projected/352efe56-78bd-4354-a5a9-7b95869fd19d-kube-api-access-8m5pn\") pod \"downloads-685bfb5f64-864fm\" (UID: \"352efe56-78bd-4354-a5a9-7b95869fd19d\") " pod="openshift-console/downloads-685bfb5f64-864fm" Jul 07 16:15:33.142751 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.142665 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-864fm" Jul 07 16:15:33.510267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.510244 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-864fm"] Jul 07 16:15:33.512298 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:33.512268 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod352efe56_78bd_4354_a5a9_7b95869fd19d.slice/crio-ee2d4a13605963ac87bfec4979099212b54dd6f4c8d29c9479e52379dae949d0 WatchSource:0}: Error finding container ee2d4a13605963ac87bfec4979099212b54dd6f4c8d29c9479e52379dae949d0: Status 404 returned error can't find the container with id ee2d4a13605963ac87bfec4979099212b54dd6f4c8d29c9479e52379dae949d0 Jul 07 16:15:33.917278 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.917243 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dzf7" event={"ID":"e16f8521-2cd1-4e56-b923-17af5ec091bb","Type":"ContainerStarted","Data":"88be855154b907c7edfab1d4c66d7c18cbfb4a231819b394255eebbb131d92c3"} Jul 07 16:15:33.917709 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.917306 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4dzf7" event={"ID":"e16f8521-2cd1-4e56-b923-17af5ec091bb","Type":"ContainerStarted","Data":"fa92db354b0cfcbfc0d62721f4f8f103300c61d6162ee9db48abebbf20f5c7df"} Jul 07 16:15:33.917709 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.917419 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4dzf7" Jul 07 16:15:33.918381 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.918360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-864fm" event={"ID":"352efe56-78bd-4354-a5a9-7b95869fd19d","Type":"ContainerStarted","Data":"ee2d4a13605963ac87bfec4979099212b54dd6f4c8d29c9479e52379dae949d0"} Jul 07 16:15:33.937693 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:33.937638 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4dzf7" podStartSLOduration=252.70738953 podStartE2EDuration="4m14.937622379s" totalImagesPullingTime="2.230232849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:11:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:33.935754539 +0000 UTC m=+294.342957161" watchObservedRunningTime="2026-07-07 16:15:33.937622379 +0000 UTC m=+294.344825014" Jul 07 16:15:36.491864 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.491830 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt"] Jul 07 16:15:36.494841 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.494822 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" Jul 07 16:15:36.497561 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.497541 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 16:15:36.497674 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.497610 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qlcfk\"" Jul 07 16:15:36.505700 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.505675 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt"] Jul 07 16:15:36.545157 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.545126 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b1db7ec0-2947-405c-ba17-565867eb8de0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9wsbt\" (UID: \"b1db7ec0-2947-405c-ba17-565867eb8de0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" Jul 07 16:15:36.645662 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.645632 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b1db7ec0-2947-405c-ba17-565867eb8de0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9wsbt\" (UID: \"b1db7ec0-2947-405c-ba17-565867eb8de0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" Jul 07 16:15:36.645848 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:36.645759 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 16:15:36.645848 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:36.645822 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1db7ec0-2947-405c-ba17-565867eb8de0-tls-certificates podName:b1db7ec0-2947-405c-ba17-565867eb8de0 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:37.145804105 +0000 UTC m=+297.553006705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/b1db7ec0-2947-405c-ba17-565867eb8de0-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-9wsbt" (UID: "b1db7ec0-2947-405c-ba17-565867eb8de0") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 16:15:36.775487 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.775408 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79574fff44-vgbpj"] Jul 07 16:15:36.778408 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.778390 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.781358 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.781338 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 16:15:36.781478 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.781462 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 16:15:36.781716 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.781700 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 16:15:36.781799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.781724 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 16:15:36.781799 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.781737 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 16:15:36.782673 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.782649 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qcgf9\"" Jul 07 16:15:36.791222 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.791201 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79574fff44-vgbpj"] Jul 07 16:15:36.846327 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.846290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-oauth-config\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.846504 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.846336 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-serving-cert\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.846504 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.846411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-service-ca\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.846504 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.846444 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-oauth-serving-cert\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.846623 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.846503 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-config\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.846623 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.846528 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rctgh\" (UniqueName: \"kubernetes.io/projected/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-kube-api-access-rctgh\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.947462 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.947427 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-oauth-serving-cert\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.947462 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.947471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-config\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.947705 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.947490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rctgh\" (UniqueName: \"kubernetes.io/projected/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-kube-api-access-rctgh\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.947705 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.947571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-oauth-config\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.947705 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.947596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-serving-cert\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.947860 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.947798 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-service-ca\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.948286 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.948236 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-config\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.948515 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.948484 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-oauth-serving-cert\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.948811 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.948785 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-service-ca\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.950567 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.950534 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-oauth-config\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.950695 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.950674 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-serving-cert\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:36.959001 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:36.958978 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rctgh\" (UniqueName: \"kubernetes.io/projected/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-kube-api-access-rctgh\") pod \"console-79574fff44-vgbpj\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:37.088838 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:37.088750 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:37.149724 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:37.149607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b1db7ec0-2947-405c-ba17-565867eb8de0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9wsbt\" (UID: \"b1db7ec0-2947-405c-ba17-565867eb8de0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" Jul 07 16:15:37.152672 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:37.152617 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b1db7ec0-2947-405c-ba17-565867eb8de0-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-9wsbt\" (UID: \"b1db7ec0-2947-405c-ba17-565867eb8de0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" Jul 07 16:15:37.227696 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:37.227665 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79574fff44-vgbpj"] Jul 07 16:15:37.231676 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:37.231644 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c8a02b_773a_48cb_ae7b_cbf6fe1c5508.slice/crio-9523d36e6564d9e3b27c6796b4c5e4245b35c86c2d35969b2560e4478c1c2bbf WatchSource:0}: Error finding container 9523d36e6564d9e3b27c6796b4c5e4245b35c86c2d35969b2560e4478c1c2bbf: Status 404 returned error can't find the container with id 9523d36e6564d9e3b27c6796b4c5e4245b35c86c2d35969b2560e4478c1c2bbf Jul 07 16:15:37.403830 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:37.403736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" Jul 07 16:15:37.536564 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:37.536530 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt"] Jul 07 16:15:37.540575 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:37.540541 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1db7ec0_2947_405c_ba17_565867eb8de0.slice/crio-b4108180ecfe32a24b4d78e0c5a4f208a18f6b97866e64e17e41f43dea90a1c7 WatchSource:0}: Error finding container b4108180ecfe32a24b4d78e0c5a4f208a18f6b97866e64e17e41f43dea90a1c7: Status 404 returned error can't find the container with id b4108180ecfe32a24b4d78e0c5a4f208a18f6b97866e64e17e41f43dea90a1c7 Jul 07 16:15:37.933971 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:37.933932 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" event={"ID":"b1db7ec0-2947-405c-ba17-565867eb8de0","Type":"ContainerStarted","Data":"b4108180ecfe32a24b4d78e0c5a4f208a18f6b97866e64e17e41f43dea90a1c7"} Jul 07 16:15:37.935326 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:37.935303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79574fff44-vgbpj" event={"ID":"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508","Type":"ContainerStarted","Data":"9523d36e6564d9e3b27c6796b4c5e4245b35c86c2d35969b2560e4478c1c2bbf"} Jul 07 16:15:38.063748 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:38.063700 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lfhn7" podUID="ab32e5be-3eea-4303-98f9-247e50b9bf06" Jul 07 16:15:39.946511 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:39.946473 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" event={"ID":"b1db7ec0-2947-405c-ba17-565867eb8de0","Type":"ContainerStarted","Data":"e49162f42d70a095e81cdbfe74519348de8dc013c4e21ffd4735e4088725d868"} Jul 07 16:15:39.947024 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:39.947008 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" Jul 07 16:15:39.947432 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:39.947411 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 16:15:39.953020 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:39.952997 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" Jul 07 16:15:39.964390 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:39.964348 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-9wsbt" podStartSLOduration=2.553067358 podStartE2EDuration="3.964333101s" totalImagesPullingTime="1.411265743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:39.962644455 +0000 UTC m=+300.369847077" watchObservedRunningTime="2026-07-07 16:15:39.964333101 +0000 UTC m=+300.371535722" Jul 07 16:15:40.573587 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.573545 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9"] Jul 07 16:15:40.578112 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.578072 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.580773 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.580744 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 16:15:40.580882 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.580748 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 16:15:40.580882 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.580832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-92nnf\"" Jul 07 16:15:40.582004 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.581983 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 16:15:40.582133 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.582062 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 16:15:40.582231 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.582217 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 16:15:40.586264 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.586241 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9"] Jul 07 16:15:40.679267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.679232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwcg7\" (UniqueName: \"kubernetes.io/projected/02782260-75f6-449e-81ac-6673897c48be-kube-api-access-zwcg7\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.679267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.679280 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/02782260-75f6-449e-81ac-6673897c48be-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.679527 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.679395 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02782260-75f6-449e-81ac-6673897c48be-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.679527 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.679488 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02782260-75f6-449e-81ac-6673897c48be-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.780563 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.780176 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02782260-75f6-449e-81ac-6673897c48be-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.780563 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.780272 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02782260-75f6-449e-81ac-6673897c48be-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.780563 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.780307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwcg7\" (UniqueName: \"kubernetes.io/projected/02782260-75f6-449e-81ac-6673897c48be-kube-api-access-zwcg7\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.780563 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.780330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/02782260-75f6-449e-81ac-6673897c48be-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.781622 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.781590 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02782260-75f6-449e-81ac-6673897c48be-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.783269 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.783230 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/02782260-75f6-449e-81ac-6673897c48be-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.783269 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.783238 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/02782260-75f6-449e-81ac-6673897c48be-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.789821 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.789784 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwcg7\" (UniqueName: \"kubernetes.io/projected/02782260-75f6-449e-81ac-6673897c48be-kube-api-access-zwcg7\") pod \"prometheus-operator-567f7b8b7c-kqjf9\" (UID: \"02782260-75f6-449e-81ac-6673897c48be\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:40.891850 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:40.891668 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" Jul 07 16:15:41.219543 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:41.219075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9"] Jul 07 16:15:41.222794 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:41.222767 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02782260_75f6_449e_81ac_6673897c48be.slice/crio-bfb54682cba0729f6bd50070d31d287494ab3f8dc565bf0a467b3f913f38d31d WatchSource:0}: Error finding container bfb54682cba0729f6bd50070d31d287494ab3f8dc565bf0a467b3f913f38d31d: Status 404 returned error can't find the container with id bfb54682cba0729f6bd50070d31d287494ab3f8dc565bf0a467b3f913f38d31d Jul 07 16:15:41.225226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:41.225206 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 16:15:41.954757 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:41.954722 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" event={"ID":"02782260-75f6-449e-81ac-6673897c48be","Type":"ContainerStarted","Data":"bfb54682cba0729f6bd50070d31d287494ab3f8dc565bf0a467b3f913f38d31d"} Jul 07 16:15:41.956032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:41.956006 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79574fff44-vgbpj" event={"ID":"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508","Type":"ContainerStarted","Data":"e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292"} Jul 07 16:15:41.974388 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:41.974343 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79574fff44-vgbpj" podStartSLOduration=2.075560449 podStartE2EDuration="5.974327969s" totalImagesPullingTime="3.89876752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:41.973641123 +0000 UTC m=+302.380843744" watchObservedRunningTime="2026-07-07 16:15:41.974327969 +0000 UTC m=+302.381530572" Jul 07 16:15:42.962302 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:42.962266 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" event={"ID":"02782260-75f6-449e-81ac-6673897c48be","Type":"ContainerStarted","Data":"8e2aa2e234d615255bd4911829ec834be011f10a7629b3275465484dcae660b0"} Jul 07 16:15:42.962684 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:42.962331 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" event={"ID":"02782260-75f6-449e-81ac-6673897c48be","Type":"ContainerStarted","Data":"6599611d18a0588b5673afd385b01492474cd9d4295847e9809550399f9d2ce3"} Jul 07 16:15:42.985164 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:42.985085 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-kqjf9" podStartSLOduration=1.39601242 podStartE2EDuration="2.985069613s" totalImagesPullingTime="1.589057193s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:42.983565391 +0000 UTC m=+303.390768037" watchObservedRunningTime="2026-07-07 16:15:42.985069613 +0000 UTC m=+303.392272234" Jul 07 16:15:43.924011 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:43.923982 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4dzf7" Jul 07 16:15:45.000917 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.000887 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d"] Jul 07 16:15:45.005349 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.005329 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.008390 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.008366 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 16:15:45.008519 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.008386 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-r5kj2\"" Jul 07 16:15:45.008519 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.008442 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 16:15:45.009667 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.009652 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 16:15:45.026347 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.026322 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d"] Jul 07 16:15:45.030157 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.030132 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fk79t"] Jul 07 16:15:45.034732 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.034713 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.037785 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.037661 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 16:15:45.037785 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.037718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xp62h\"" Jul 07 16:15:45.037955 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.037910 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 16:15:45.038159 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.038015 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 16:15:45.112001 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.111962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.112001 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112001 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-root\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.112226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.112226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112066 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.112226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-wtmp\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.112226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112162 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzrn\" (UniqueName: \"kubernetes.io/projected/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-kube-api-access-fgzrn\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.112226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.112226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b65sf\" (UniqueName: \"kubernetes.io/projected/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-api-access-b65sf\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.112420 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112232 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-textfile\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.112420 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112256 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.112420 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-tls\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.112420 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112339 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-metrics-client-ca\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.112420 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112386 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.112420 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112414 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-sys\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.112620 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.112436 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.212949 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.212912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.213165 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.212982 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213165 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-wtmp\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213165 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213021 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzrn\" (UniqueName: \"kubernetes.io/projected/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-kube-api-access-fgzrn\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213165 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213041 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.213165 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213056 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b65sf\" (UniqueName: \"kubernetes.io/projected/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-api-access-b65sf\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.213165 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213073 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-textfile\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213478 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:45.213207 2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 16:15:45.213478 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213220 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-wtmp\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213478 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:45.213283 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-tls podName:4e1923bb-2f87-4936-b5f6-6d7ea79883d0 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:45.713263779 +0000 UTC m=+306.120466389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-mg84d" (UID: "4e1923bb-2f87-4936-b5f6-6d7ea79883d0") : secret "kube-state-metrics-tls" not found Jul 07 16:15:45.213478 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213339 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.213478 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213413 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-tls\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213478 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213428 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-textfile\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213478 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-metrics-client-ca\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213501 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:45.213513 2581 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213545 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-sys\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:15:45.213575 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-tls podName:4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6 nodeName:}" failed. No retries permitted until 2026-07-07 16:15:45.7135587 +0000 UTC m=+306.120761306 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-tls") pod "node-exporter-fk79t" (UID: "4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6") : secret "node-exporter-tls" not found Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-sys\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213657 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213685 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-root\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213759 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-root\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213804 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213807 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-accelerators-collector-config\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.213824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213806 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.214440 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.213978 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-metrics-client-ca\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.214440 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.214413 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.215769 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.215748 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.215769 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.215758 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.221761 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.221739 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzrn\" (UniqueName: \"kubernetes.io/projected/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-kube-api-access-fgzrn\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.222382 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.222362 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b65sf\" (UniqueName: \"kubernetes.io/projected/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-api-access-b65sf\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.719731 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.719691 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.719910 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.719753 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-tls\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.722066 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.722040 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6-node-exporter-tls\") pod \"node-exporter-fk79t\" (UID: \"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6\") " pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.722200 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.722109 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e1923bb-2f87-4936-b5f6-6d7ea79883d0-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-mg84d\" (UID: \"4e1923bb-2f87-4936-b5f6-6d7ea79883d0\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.914370 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.914333 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" Jul 07 16:15:45.945824 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.945793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fk79t" Jul 07 16:15:45.964606 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:45.964577 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4019f9ac_9ad2_4f48_ba1d_b82c32d58fe6.slice/crio-94bf4952add474db99b0018d8b11b9088624d5b7b068aaf67e0d1d8f726ae845 WatchSource:0}: Error finding container 94bf4952add474db99b0018d8b11b9088624d5b7b068aaf67e0d1d8f726ae845: Status 404 returned error can't find the container with id 94bf4952add474db99b0018d8b11b9088624d5b7b068aaf67e0d1d8f726ae845 Jul 07 16:15:45.981048 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:45.981016 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fk79t" event={"ID":"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6","Type":"ContainerStarted","Data":"94bf4952add474db99b0018d8b11b9088624d5b7b068aaf67e0d1d8f726ae845"} Jul 07 16:15:46.071526 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:46.071503 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d"] Jul 07 16:15:46.987589 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:46.987547 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" event={"ID":"4e1923bb-2f87-4936-b5f6-6d7ea79883d0","Type":"ContainerStarted","Data":"721353c3303c32fd7597faff1a39afc818bb318088830f69146f7c74d67d4ddc"} Jul 07 16:15:47.089496 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:47.089455 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:47.089965 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:47.089549 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:47.095591 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:47.095557 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:47.994177 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:47.994141 2581 generic.go:356] "Generic (PLEG): container finished" podID="4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6" containerID="cdf36c7a3fa0b4a69a7761c48f9c9d9ee2079687ca28aa4954850d76664503a8" exitCode=0 Jul 07 16:15:47.994364 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:47.994228 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fk79t" event={"ID":"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6","Type":"ContainerDied","Data":"cdf36c7a3fa0b4a69a7761c48f9c9d9ee2079687ca28aa4954850d76664503a8"} Jul 07 16:15:47.998884 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:47.998853 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:15:48.999980 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:48.999944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fk79t" event={"ID":"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6","Type":"ContainerStarted","Data":"6090fead08a5b06dde5313f94ec78d6790951b651d8f6f12106723a7d24653eb"} Jul 07 16:15:49.000469 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:48.999996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fk79t" event={"ID":"4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6","Type":"ContainerStarted","Data":"b3a0607b9d812e0d670adece8d6f16dd31879e83f786ab7e2b9f8023bb4b01c1"} Jul 07 16:15:49.001987 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:49.001966 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" event={"ID":"4e1923bb-2f87-4936-b5f6-6d7ea79883d0","Type":"ContainerStarted","Data":"3c4107fc948512b7eff19b5190049964af28e7f6fedab99d70a20b48326efae3"} Jul 07 16:15:49.002077 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:49.002010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" event={"ID":"4e1923bb-2f87-4936-b5f6-6d7ea79883d0","Type":"ContainerStarted","Data":"2d81d069f041430d754a2ba6ea4e4b930944a095408a509d2fc30034334d3dfc"} Jul 07 16:15:49.002077 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:49.002031 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" event={"ID":"4e1923bb-2f87-4936-b5f6-6d7ea79883d0","Type":"ContainerStarted","Data":"32c2de1a7b3cb58bfe73253957b0b9a2897d5f19fdcdf785c2ee671753420b1a"} Jul 07 16:15:49.024695 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:49.024645 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fk79t" podStartSLOduration=2.700728701 podStartE2EDuration="4.024630883s" totalImagesPullingTime="1.251423496s" totalInitContainerRuntime="72.478686ms" isStatefulPod=true podCreationTimestamp="2026-07-07 16:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:49.022521134 +0000 UTC m=+309.429723757" watchObservedRunningTime="2026-07-07 16:15:49.024630883 +0000 UTC m=+309.431833505" Jul 07 16:15:49.041774 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:49.041727 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-mg84d" podStartSLOduration=2.815749817 podStartE2EDuration="5.041711888s" totalImagesPullingTime="2.225962071s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:15:49.040685534 +0000 UTC m=+309.447888153" watchObservedRunningTime="2026-07-07 16:15:49.041711888 +0000 UTC m=+309.448914510" Jul 07 16:15:49.063222 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:49.063198 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:15:50.181219 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:50.181161 2581 patch_prober.go:28] interesting pod/image-registry-67d447c6db-glgkj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 16:15:50.181614 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:50.181247 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" podUID="6389363e-c5df-4cc3-b893-e6f7e8a93c7c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 16:15:51.236705 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.236668 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:15:51.248926 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.248890 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.260390 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.260367 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 16:15:51.260390 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.260382 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 16:15:51.261291 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.261274 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 16:15:51.261384 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.261369 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 16:15:51.261488 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.261476 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 16:15:51.261541 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.261498 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tfpgc\"" Jul 07 16:15:51.261617 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.261601 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 16:15:51.261759 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.261745 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 16:15:51.261759 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.261753 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 16:15:51.261847 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.261811 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 16:15:51.265368 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.265346 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 16:15:51.265501 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.265484 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bg86jvtgbl81c\"" Jul 07 16:15:51.265566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.265429 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 16:15:51.265623 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.265442 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 16:15:51.265623 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.265580 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 16:15:51.267556 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.267536 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 16:15:51.277558 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.277530 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:15:51.277688 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.277670 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 16:15:51.374367 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374553 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374411 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374553 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374442 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374553 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374471 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374700 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374700 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374636 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374700 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374669 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374700 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374696 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374858 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374858 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374752 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374858 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374805 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.374858 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374847 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpcq9\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-kube-api-access-gpcq9\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.375009 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.375009 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374918 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.375009 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374949 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.375009 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.374975 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.375169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.375037 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.375169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.375064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.375169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.375083 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.375169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.375127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476175 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476084 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476175 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476158 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476175 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476184 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476214 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476241 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476306 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476371 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476394 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476425 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476477 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476452 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476485 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476508 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476568 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpcq9\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-kube-api-access-gpcq9\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476618 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476652 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.476893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.476697 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.478156 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.477812 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.478156 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.477928 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.478156 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.478124 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.479075 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.479048 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.479943 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.479915 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.482922 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.481848 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.482922 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.482558 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.482922 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.482619 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.483136 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.482953 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-web-config\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.483435 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.483408 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492262 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.485547 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492262 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.486128 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492262 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.486405 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492262 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.486464 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config-out\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492262 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.486470 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492262 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.486633 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492262 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.486854 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492262 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.486956 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.492725 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.492550 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.499532 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.499502 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpcq9\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-kube-api-access-gpcq9\") pod \"prometheus-k8s-0\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.559431 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.559155 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:15:51.740311 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:51.740284 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:15:51.743071 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:15:51.742997 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e8bcdf_547d_416f_b1a7_867c0b14ccbf.slice/crio-03090bf2dc6180fea9e951905f3945850b21df6f854774e6ed99e48029e70c4f WatchSource:0}: Error finding container 03090bf2dc6180fea9e951905f3945850b21df6f854774e6ed99e48029e70c4f: Status 404 returned error can't find the container with id 03090bf2dc6180fea9e951905f3945850b21df6f854774e6ed99e48029e70c4f Jul 07 16:15:52.013451 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:52.013373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerStarted","Data":"03090bf2dc6180fea9e951905f3945850b21df6f854774e6ed99e48029e70c4f"} Jul 07 16:15:52.916930 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:52.916902 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:15:54.029108 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:54.028996 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerStarted","Data":"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738"} Jul 07 16:15:54.633391 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:54.633341 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" podUID="87cdf8f1-d74f-43a1-82e3-67ce9010390c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/readyz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jul 07 16:15:55.247783 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:55.247742 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67d447c6db-glgkj"] Jul 07 16:15:56.659377 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:15:56.659330 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" podUID="87cdf8f1-d74f-43a1-82e3-67ce9010390c" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.9:8000/healthz\": dial tcp 10.132.0.9:8000: connect: connection refused" Jul 07 16:16:01.059966 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.059881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-864fm" event={"ID":"352efe56-78bd-4354-a5a9-7b95869fd19d","Type":"ContainerStarted","Data":"cf54b40da99916f5d06fca6fbad9af072f91dd0eea916d7671b8e1c06f08f79c"} Jul 07 16:16:01.060461 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.060240 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-864fm" Jul 07 16:16:01.061659 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.061605 2581 patch_prober.go:28] interesting pod/downloads-685bfb5f64-864fm container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.14:8080/\": dial tcp 10.132.0.14:8080: connect: connection refused" start-of-body= Jul 07 16:16:01.061787 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.061652 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-864fm" podUID="352efe56-78bd-4354-a5a9-7b95869fd19d" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.14:8080/\": dial tcp 10.132.0.14:8080: connect: connection refused" Jul 07 16:16:01.061787 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.061696 2581 generic.go:356] "Generic (PLEG): container finished" podID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" exitCode=0 Jul 07 16:16:01.061787 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.061731 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerDied","Data":"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738"} Jul 07 16:16:01.064062 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.064044 2581 generic.go:356] "Generic (PLEG): container finished" podID="87cdf8f1-d74f-43a1-82e3-67ce9010390c" containerID="57d61b9d87e30b0bc44486102c850e42cdbe93aa3d1fe96289efa2b4760c8a1b" exitCode=1 Jul 07 16:16:01.064165 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.064128 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" event={"ID":"87cdf8f1-d74f-43a1-82e3-67ce9010390c","Type":"ContainerDied","Data":"57d61b9d87e30b0bc44486102c850e42cdbe93aa3d1fe96289efa2b4760c8a1b"} Jul 07 16:16:01.064226 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.064187 2581 scope.go:117] "RemoveContainer" containerID="8856da8725587564b0ee6ef6be2fb98ebf5f0ab4133389f45b3cdea83b613723" Jul 07 16:16:01.064576 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.064557 2581 scope.go:117] "RemoveContainer" containerID="57d61b9d87e30b0bc44486102c850e42cdbe93aa3d1fe96289efa2b4760c8a1b" Jul 07 16:16:01.064769 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:16:01.064742 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6cd5d848d8-t4m25_open-cluster-management-agent-addon(87cdf8f1-d74f-43a1-82e3-67ce9010390c)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" podUID="87cdf8f1-d74f-43a1-82e3-67ce9010390c" Jul 07 16:16:01.082962 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:01.082914 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-864fm" podStartSLOduration=1.910550127 podStartE2EDuration="29.082899318s" totalImagesPullingTime="27.172349191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:16:01.080671897 +0000 UTC m=+321.487874521" watchObservedRunningTime="2026-07-07 16:16:01.082899318 +0000 UTC m=+321.490101990" Jul 07 16:16:02.095593 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:02.095556 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-864fm" Jul 07 16:16:03.347681 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:03.347649 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79574fff44-vgbpj"] Jul 07 16:16:04.633646 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:04.633601 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:16:04.634170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:04.634143 2581 scope.go:117] "RemoveContainer" containerID="57d61b9d87e30b0bc44486102c850e42cdbe93aa3d1fe96289efa2b4760c8a1b" Jul 07 16:16:06.105118 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:06.105062 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerStarted","Data":"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54"} Jul 07 16:16:06.107535 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:06.107509 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" event={"ID":"87cdf8f1-d74f-43a1-82e3-67ce9010390c","Type":"ContainerStarted","Data":"ea7679a5bf932ddef8a78c7acfed309e9c00690db22dc551f7f984fd830bff59"} Jul 07 16:16:06.108483 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:06.108001 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:16:06.109026 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:06.108991 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6cd5d848d8-t4m25" Jul 07 16:16:07.116163 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:07.116016 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerStarted","Data":"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d"} Jul 07 16:16:10.133458 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:10.133426 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerStarted","Data":"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87"} Jul 07 16:16:10.133861 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:10.133490 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerStarted","Data":"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f"} Jul 07 16:16:10.133861 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:10.133517 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerStarted","Data":"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d"} Jul 07 16:16:10.133861 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:10.133542 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerStarted","Data":"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d"} Jul 07 16:16:10.167173 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:10.167082 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=10.232737146 podStartE2EDuration="19.167061112s" totalImagesPullingTime="8.916606513s" totalInitContainerRuntime="17.717453ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:15:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:16:10.166129966 +0000 UTC m=+330.573332588" watchObservedRunningTime="2026-07-07 16:16:10.167061112 +0000 UTC m=+330.574263736" Jul 07 16:16:11.559905 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:11.559865 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:16:20.269928 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.269884 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" podUID="6389363e-c5df-4cc3-b893-e6f7e8a93c7c" containerName="registry" containerID="cri-o://f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4" gracePeriod=30 Jul 07 16:16:20.541814 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.541737 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:16:20.561754 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.561724 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") pod \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " Jul 07 16:16:20.561937 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.561764 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2kdf\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-kube-api-access-m2kdf\") pod \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " Jul 07 16:16:20.561937 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.561783 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-certificates\") pod \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " Jul 07 16:16:20.561937 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.561808 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-ca-trust-extracted\") pod \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " Jul 07 16:16:20.561937 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.561831 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-image-registry-private-configuration\") pod \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " Jul 07 16:16:20.561937 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.561899 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-trusted-ca\") pod \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " Jul 07 16:16:20.561937 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.561926 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-installation-pull-secrets\") pod \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " Jul 07 16:16:20.561937 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.561989 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-bound-sa-token\") pod \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\" (UID: \"6389363e-c5df-4cc3-b893-e6f7e8a93c7c\") " Jul 07 16:16:20.563208 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.562650 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6389363e-c5df-4cc3-b893-e6f7e8a93c7c" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:16:20.563208 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.563162 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6389363e-c5df-4cc3-b893-e6f7e8a93c7c" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:16:20.565940 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.565915 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6389363e-c5df-4cc3-b893-e6f7e8a93c7c" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:16:20.566124 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.566057 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6389363e-c5df-4cc3-b893-e6f7e8a93c7c" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:16:20.566237 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.566118 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6389363e-c5df-4cc3-b893-e6f7e8a93c7c" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:16:20.566237 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.566148 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6389363e-c5df-4cc3-b893-e6f7e8a93c7c" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:16:20.566332 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.566252 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-kube-api-access-m2kdf" (OuterVolumeSpecName: "kube-api-access-m2kdf") pod "6389363e-c5df-4cc3-b893-e6f7e8a93c7c" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c"). InnerVolumeSpecName "kube-api-access-m2kdf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:16:20.574332 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.574304 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6389363e-c5df-4cc3-b893-e6f7e8a93c7c" (UID: "6389363e-c5df-4cc3-b893-e6f7e8a93c7c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:16:20.663337 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.663304 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2kdf\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-kube-api-access-m2kdf\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:20.663337 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.663331 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-certificates\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:20.663337 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.663342 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-ca-trust-extracted\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:20.663567 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.663350 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-image-registry-private-configuration\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:20.663567 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.663359 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-trusted-ca\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:20.663567 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.663369 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-installation-pull-secrets\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:20.663567 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.663377 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-bound-sa-token\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:20.663567 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:20.663385 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6389363e-c5df-4cc3-b893-e6f7e8a93c7c-registry-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:21.174642 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.174608 2581 generic.go:356] "Generic (PLEG): container finished" podID="6389363e-c5df-4cc3-b893-e6f7e8a93c7c" containerID="f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4" exitCode=0 Jul 07 16:16:21.174893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.174661 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" Jul 07 16:16:21.174893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.174664 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" event={"ID":"6389363e-c5df-4cc3-b893-e6f7e8a93c7c","Type":"ContainerDied","Data":"f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4"} Jul 07 16:16:21.174893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.174705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67d447c6db-glgkj" event={"ID":"6389363e-c5df-4cc3-b893-e6f7e8a93c7c","Type":"ContainerDied","Data":"787aaadbfae88c5c6d784a29d6db792c78577bbda1ddf5c7732a37e8111636e5"} Jul 07 16:16:21.174893 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.174724 2581 scope.go:117] "RemoveContainer" containerID="f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4" Jul 07 16:16:21.183486 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.183468 2581 scope.go:117] "RemoveContainer" containerID="f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4" Jul 07 16:16:21.183736 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:16:21.183712 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4\": container with ID starting with f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4 not found: ID does not exist" containerID="f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4" Jul 07 16:16:21.183811 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.183744 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4"} err="failed to get container status \"f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4\": rpc error: code = NotFound desc = could not find container \"f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4\": container with ID starting with f341161ae05cf189da7b0369300bf64b56af157a53f7ad120ee7741afe389cd4 not found: ID does not exist" Jul 07 16:16:21.196679 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.196655 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67d447c6db-glgkj"] Jul 07 16:16:21.200220 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:21.200200 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67d447c6db-glgkj"] Jul 07 16:16:22.067828 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:22.067794 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6389363e-c5df-4cc3-b893-e6f7e8a93c7c" path="/var/lib/kubelet/pods/6389363e-c5df-4cc3-b893-e6f7e8a93c7c/volumes" Jul 07 16:16:28.377605 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.377557 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79574fff44-vgbpj" podUID="d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" containerName="console" containerID="cri-o://e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292" gracePeriod=15 Jul 07 16:16:28.647930 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.647901 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:16:28.733961 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.733921 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-config\") pod \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " Jul 07 16:16:28.734169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.733985 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-oauth-serving-cert\") pod \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " Jul 07 16:16:28.734169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.734025 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rctgh\" (UniqueName: \"kubernetes.io/projected/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-kube-api-access-rctgh\") pod \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " Jul 07 16:16:28.734169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.734064 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-service-ca\") pod \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " Jul 07 16:16:28.734169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.734124 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-serving-cert\") pod \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " Jul 07 16:16:28.734169 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.734157 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-oauth-config\") pod \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\" (UID: \"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508\") " Jul 07 16:16:28.734449 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.734428 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-config" (OuterVolumeSpecName: "console-config") pod "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" (UID: "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:16:28.734516 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.734482 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" (UID: "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:16:28.734572 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.734543 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" (UID: "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:16:28.736513 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.736481 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" (UID: "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:16:28.736640 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.736511 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" (UID: "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:16:28.736640 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.736524 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-kube-api-access-rctgh" (OuterVolumeSpecName: "kube-api-access-rctgh") pod "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" (UID: "d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508"). InnerVolumeSpecName "kube-api-access-rctgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:16:28.835170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.835120 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-config\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:28.835170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.835165 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-oauth-serving-cert\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:28.835170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.835175 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rctgh\" (UniqueName: \"kubernetes.io/projected/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-kube-api-access-rctgh\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:28.835170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.835183 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-service-ca\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:28.835170 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.835192 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-serving-cert\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:28.835473 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:28.835200 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508-console-oauth-config\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:16:29.204960 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.204923 2581 generic.go:356] "Generic (PLEG): container finished" podID="d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" containerID="e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292" exitCode=0 Jul 07 16:16:29.205174 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.204967 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79574fff44-vgbpj" Jul 07 16:16:29.205174 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.205011 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79574fff44-vgbpj" event={"ID":"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508","Type":"ContainerDied","Data":"e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292"} Jul 07 16:16:29.205174 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.205064 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79574fff44-vgbpj" event={"ID":"d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508","Type":"ContainerDied","Data":"9523d36e6564d9e3b27c6796b4c5e4245b35c86c2d35969b2560e4478c1c2bbf"} Jul 07 16:16:29.205174 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.205090 2581 scope.go:117] "RemoveContainer" containerID="e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292" Jul 07 16:16:29.213560 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.213545 2581 scope.go:117] "RemoveContainer" containerID="e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292" Jul 07 16:16:29.213842 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:16:29.213824 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292\": container with ID starting with e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292 not found: ID does not exist" containerID="e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292" Jul 07 16:16:29.213892 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.213851 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292"} err="failed to get container status \"e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292\": rpc error: code = NotFound desc = could not find container \"e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292\": container with ID starting with e3b8946d2a58bb973ae8dfe7331655508db1dea18dfa281381d33d104784a292 not found: ID does not exist" Jul 07 16:16:29.225652 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.225625 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79574fff44-vgbpj"] Jul 07 16:16:29.228694 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:29.228674 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79574fff44-vgbpj"] Jul 07 16:16:30.066996 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:30.066963 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" path="/var/lib/kubelet/pods/d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508/volumes" Jul 07 16:16:51.560043 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:51.560004 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:16:51.624021 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:51.623992 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:16:52.302860 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:52.302834 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:16:54.061968 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:54.061921 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:16:54.064209 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:54.064179 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab32e5be-3eea-4303-98f9-247e50b9bf06-metrics-certs\") pod \"network-metrics-daemon-lfhn7\" (UID: \"ab32e5be-3eea-4303-98f9-247e50b9bf06\") " pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:16:54.166941 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:54.166905 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wvdn7\"" Jul 07 16:16:54.174487 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:54.174466 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lfhn7" Jul 07 16:16:54.307723 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:54.307691 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lfhn7"] Jul 07 16:16:54.310695 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:16:54.310669 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab32e5be_3eea_4303_98f9_247e50b9bf06.slice/crio-e409e41068d3f2243db3cc2de188d7bfd834b4d5e84d0d7d1272a4d0b823da21 WatchSource:0}: Error finding container e409e41068d3f2243db3cc2de188d7bfd834b4d5e84d0d7d1272a4d0b823da21: Status 404 returned error can't find the container with id e409e41068d3f2243db3cc2de188d7bfd834b4d5e84d0d7d1272a4d0b823da21 Jul 07 16:16:55.302067 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:55.302039 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lfhn7" event={"ID":"ab32e5be-3eea-4303-98f9-247e50b9bf06","Type":"ContainerStarted","Data":"e409e41068d3f2243db3cc2de188d7bfd834b4d5e84d0d7d1272a4d0b823da21"} Jul 07 16:16:56.307232 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:56.307196 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lfhn7" event={"ID":"ab32e5be-3eea-4303-98f9-247e50b9bf06","Type":"ContainerStarted","Data":"979ac8340953e3f7b4b0abbd2ade1b4093435b0e204601e4a33428d7c4960dd5"} Jul 07 16:16:56.307699 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:56.307246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lfhn7" event={"ID":"ab32e5be-3eea-4303-98f9-247e50b9bf06","Type":"ContainerStarted","Data":"6ea641d3f57253887940c55d62514fcc51fe600c432fe2f11089ee0a529a4735"} Jul 07 16:16:56.330850 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:16:56.330802 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lfhn7" podStartSLOduration=375.350704619 podStartE2EDuration="6m16.330786573s" totalImagesPullingTime="980.081954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 16:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:16:56.329718962 +0000 UTC m=+376.736921585" watchObservedRunningTime="2026-07-07 16:16:56.330786573 +0000 UTC m=+376.737989195" Jul 07 16:17:09.547032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.546995 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:17:09.547577 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.547347 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="prometheus" containerID="cri-o://c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" gracePeriod=600 Jul 07 16:17:09.547577 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.547377 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy" containerID="cri-o://23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" gracePeriod=600 Jul 07 16:17:09.547577 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.547438 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" gracePeriod=600 Jul 07 16:17:09.547577 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.547392 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="thanos-sidecar" containerID="cri-o://9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" gracePeriod=600 Jul 07 16:17:09.547577 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.547422 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="config-reloader" containerID="cri-o://8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" gracePeriod=600 Jul 07 16:17:09.547577 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.547430 2581 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy-web" containerID="cri-o://b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" gracePeriod=600 Jul 07 16:17:09.802913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.802838 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:09.988059 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988030 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-1\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988059 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988066 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-tls-assets\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988280 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988117 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988280 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988156 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-serving-certs-ca-bundle\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988280 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988202 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config-out\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988280 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988226 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-tls\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988280 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988250 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-trusted-ca-bundle\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988280 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988275 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-web-config\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988299 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-thanos-prometheus-http-client-file\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988328 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-metrics-client-ca\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988363 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-kube-rbac-proxy\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988392 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-db\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988427 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988441 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-2\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988464 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpcq9\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-kube-api-access-gpcq9\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988496 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988536 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-grpc-tls\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988561 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.988573 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988559 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988598 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-0\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988665 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-kubelet-serving-ca-bundle\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988682 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988697 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-metrics-client-certs\") pod \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\" (UID: \"67e8bcdf-547d-416f-b1a7-867c0b14ccbf\") " Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988922 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988942 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.988957 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.989317 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.989397 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:17:09.989855 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.989702 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:17:09.991984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.991954 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:17:09.992402 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992373 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:09.992511 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992418 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:09.992626 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992603 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:17:09.992696 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992659 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:09.992696 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992680 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:09.992814 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992742 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:09.992814 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992746 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config-out" (OuterVolumeSpecName: "config-out") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 16:17:09.992814 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992744 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 16:17:09.992814 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992797 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:09.992943 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.992828 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-kube-api-access-gpcq9" (OuterVolumeSpecName: "kube-api-access-gpcq9") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "kube-api-access-gpcq9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 16:17:09.993553 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.993532 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:09.994206 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:09.994183 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config" (OuterVolumeSpecName: "config") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:10.002950 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.002929 2581 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-web-config" (OuterVolumeSpecName: "web-config") pod "67e8bcdf-547d-416f-b1a7-867c0b14ccbf" (UID: "67e8bcdf-547d-416f-b1a7-867c0b14ccbf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 16:17:10.090087 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090056 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config-out\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090087 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090085 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090130 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-web-config\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090144 2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090159 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-metrics-client-ca\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090183 2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-kube-rbac-proxy\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090195 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-db\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090206 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090216 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpcq9\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-kube-api-access-gpcq9\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090224 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090235 2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-grpc-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090247 2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-config\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090258 2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090267 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090266 2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090604 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090274 2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-metrics-client-certs\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090604 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090283 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-tls-assets\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.090604 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.090292 2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/67e8bcdf-547d-416f-b1a7-867c0b14ccbf-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\"" Jul 07 16:17:10.362032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.361939 2581 generic.go:356] "Generic (PLEG): container finished" podID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" exitCode=0 Jul 07 16:17:10.362032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.361966 2581 generic.go:356] "Generic (PLEG): container finished" podID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" exitCode=0 Jul 07 16:17:10.362032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.361975 2581 generic.go:356] "Generic (PLEG): container finished" podID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" exitCode=0 Jul 07 16:17:10.362032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.361985 2581 generic.go:356] "Generic (PLEG): container finished" podID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" exitCode=0 Jul 07 16:17:10.362032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.361993 2581 generic.go:356] "Generic (PLEG): container finished" podID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" exitCode=0 Jul 07 16:17:10.362032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.361999 2581 generic.go:356] "Generic (PLEG): container finished" podID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" exitCode=0 Jul 07 16:17:10.362032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362020 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.362032 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362020 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerDied","Data":"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87"} Jul 07 16:17:10.362476 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362104 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerDied","Data":"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f"} Jul 07 16:17:10.362476 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362115 2581 scope.go:117] "RemoveContainer" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" Jul 07 16:17:10.362476 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362135 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerDied","Data":"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d"} Jul 07 16:17:10.362476 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerDied","Data":"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d"} Jul 07 16:17:10.362476 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerDied","Data":"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d"} Jul 07 16:17:10.362476 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362210 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerDied","Data":"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54"} Jul 07 16:17:10.362476 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.362236 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"67e8bcdf-547d-416f-b1a7-867c0b14ccbf","Type":"ContainerDied","Data":"03090bf2dc6180fea9e951905f3945850b21df6f854774e6ed99e48029e70c4f"} Jul 07 16:17:10.369805 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.369788 2581 scope.go:117] "RemoveContainer" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" Jul 07 16:17:10.376645 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.376625 2581 scope.go:117] "RemoveContainer" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" Jul 07 16:17:10.383378 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.383349 2581 scope.go:117] "RemoveContainer" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" Jul 07 16:17:10.385341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.385319 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:17:10.390081 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.390059 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:17:10.390724 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.390711 2581 scope.go:117] "RemoveContainer" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" Jul 07 16:17:10.397207 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.397192 2581 scope.go:117] "RemoveContainer" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" Jul 07 16:17:10.404662 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.404646 2581 scope.go:117] "RemoveContainer" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" Jul 07 16:17:10.411039 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.411019 2581 scope.go:117] "RemoveContainer" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" Jul 07 16:17:10.411283 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:17:10.411264 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": container with ID starting with 0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87 not found: ID does not exist" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" Jul 07 16:17:10.411367 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.411297 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87"} err="failed to get container status \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": rpc error: code = NotFound desc = could not find container \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": container with ID starting with 0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87 not found: ID does not exist" Jul 07 16:17:10.411367 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.411324 2581 scope.go:117] "RemoveContainer" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" Jul 07 16:17:10.411558 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:17:10.411542 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": container with ID starting with 23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f not found: ID does not exist" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" Jul 07 16:17:10.411598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.411565 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f"} err="failed to get container status \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": rpc error: code = NotFound desc = could not find container \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": container with ID starting with 23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f not found: ID does not exist" Jul 07 16:17:10.411598 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.411581 2581 scope.go:117] "RemoveContainer" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" Jul 07 16:17:10.411810 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:17:10.411791 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": container with ID starting with b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d not found: ID does not exist" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" Jul 07 16:17:10.411867 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.411817 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d"} err="failed to get container status \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": rpc error: code = NotFound desc = could not find container \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": container with ID starting with b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d not found: ID does not exist" Jul 07 16:17:10.411867 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.411837 2581 scope.go:117] "RemoveContainer" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" Jul 07 16:17:10.412088 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:17:10.412071 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": container with ID starting with 9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d not found: ID does not exist" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" Jul 07 16:17:10.412183 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.412106 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d"} err="failed to get container status \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": rpc error: code = NotFound desc = could not find container \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": container with ID starting with 9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d not found: ID does not exist" Jul 07 16:17:10.412183 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.412123 2581 scope.go:117] "RemoveContainer" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" Jul 07 16:17:10.412352 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:17:10.412337 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": container with ID starting with 8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d not found: ID does not exist" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" Jul 07 16:17:10.412395 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.412356 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d"} err="failed to get container status \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": rpc error: code = NotFound desc = could not find container \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": container with ID starting with 8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d not found: ID does not exist" Jul 07 16:17:10.412395 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.412380 2581 scope.go:117] "RemoveContainer" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" Jul 07 16:17:10.412596 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:17:10.412580 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": container with ID starting with c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54 not found: ID does not exist" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" Jul 07 16:17:10.412638 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.412600 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54"} err="failed to get container status \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": rpc error: code = NotFound desc = could not find container \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": container with ID starting with c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54 not found: ID does not exist" Jul 07 16:17:10.412638 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.412614 2581 scope.go:117] "RemoveContainer" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" Jul 07 16:17:10.412838 ip-10-0-134-97 kubenswrapper[2581]: E0707 16:17:10.412820 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": container with ID starting with c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738 not found: ID does not exist" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" Jul 07 16:17:10.412903 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.412854 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738"} err="failed to get container status \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": rpc error: code = NotFound desc = could not find container \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": container with ID starting with c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738 not found: ID does not exist" Jul 07 16:17:10.412903 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.412873 2581 scope.go:117] "RemoveContainer" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" Jul 07 16:17:10.413146 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413127 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87"} err="failed to get container status \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": rpc error: code = NotFound desc = could not find container \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": container with ID starting with 0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87 not found: ID does not exist" Jul 07 16:17:10.413199 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413147 2581 scope.go:117] "RemoveContainer" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" Jul 07 16:17:10.413354 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413337 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f"} err="failed to get container status \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": rpc error: code = NotFound desc = could not find container \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": container with ID starting with 23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f not found: ID does not exist" Jul 07 16:17:10.413409 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413355 2581 scope.go:117] "RemoveContainer" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" Jul 07 16:17:10.413565 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413549 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d"} err="failed to get container status \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": rpc error: code = NotFound desc = could not find container \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": container with ID starting with b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d not found: ID does not exist" Jul 07 16:17:10.413600 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413566 2581 scope.go:117] "RemoveContainer" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" Jul 07 16:17:10.413788 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413774 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d"} err="failed to get container status \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": rpc error: code = NotFound desc = could not find container \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": container with ID starting with 9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d not found: ID does not exist" Jul 07 16:17:10.413831 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413788 2581 scope.go:117] "RemoveContainer" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" Jul 07 16:17:10.413988 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413973 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d"} err="failed to get container status \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": rpc error: code = NotFound desc = could not find container \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": container with ID starting with 8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d not found: ID does not exist" Jul 07 16:17:10.414030 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.413989 2581 scope.go:117] "RemoveContainer" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" Jul 07 16:17:10.414210 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414191 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54"} err="failed to get container status \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": rpc error: code = NotFound desc = could not find container \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": container with ID starting with c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54 not found: ID does not exist" Jul 07 16:17:10.414256 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414211 2581 scope.go:117] "RemoveContainer" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" Jul 07 16:17:10.414427 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414408 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738"} err="failed to get container status \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": rpc error: code = NotFound desc = could not find container \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": container with ID starting with c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738 not found: ID does not exist" Jul 07 16:17:10.414468 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414428 2581 scope.go:117] "RemoveContainer" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" Jul 07 16:17:10.414642 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414627 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87"} err="failed to get container status \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": rpc error: code = NotFound desc = could not find container \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": container with ID starting with 0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87 not found: ID does not exist" Jul 07 16:17:10.414695 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414645 2581 scope.go:117] "RemoveContainer" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" Jul 07 16:17:10.414821 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414804 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f"} err="failed to get container status \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": rpc error: code = NotFound desc = could not find container \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": container with ID starting with 23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f not found: ID does not exist" Jul 07 16:17:10.414876 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414822 2581 scope.go:117] "RemoveContainer" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" Jul 07 16:17:10.415013 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.414999 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d"} err="failed to get container status \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": rpc error: code = NotFound desc = could not find container \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": container with ID starting with b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d not found: ID does not exist" Jul 07 16:17:10.415053 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415015 2581 scope.go:117] "RemoveContainer" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" Jul 07 16:17:10.415231 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415215 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d"} err="failed to get container status \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": rpc error: code = NotFound desc = could not find container \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": container with ID starting with 9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d not found: ID does not exist" Jul 07 16:17:10.415300 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415232 2581 scope.go:117] "RemoveContainer" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" Jul 07 16:17:10.415445 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415427 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d"} err="failed to get container status \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": rpc error: code = NotFound desc = could not find container \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": container with ID starting with 8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d not found: ID does not exist" Jul 07 16:17:10.415488 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415446 2581 scope.go:117] "RemoveContainer" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" Jul 07 16:17:10.415657 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415638 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54"} err="failed to get container status \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": rpc error: code = NotFound desc = could not find container \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": container with ID starting with c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54 not found: ID does not exist" Jul 07 16:17:10.415720 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415659 2581 scope.go:117] "RemoveContainer" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" Jul 07 16:17:10.415990 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415968 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738"} err="failed to get container status \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": rpc error: code = NotFound desc = could not find container \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": container with ID starting with c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738 not found: ID does not exist" Jul 07 16:17:10.416069 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.415991 2581 scope.go:117] "RemoveContainer" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" Jul 07 16:17:10.416282 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.416257 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87"} err="failed to get container status \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": rpc error: code = NotFound desc = could not find container \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": container with ID starting with 0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87 not found: ID does not exist" Jul 07 16:17:10.416282 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.416282 2581 scope.go:117] "RemoveContainer" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" Jul 07 16:17:10.416587 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.416566 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f"} err="failed to get container status \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": rpc error: code = NotFound desc = could not find container \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": container with ID starting with 23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f not found: ID does not exist" Jul 07 16:17:10.416677 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.416588 2581 scope.go:117] "RemoveContainer" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" Jul 07 16:17:10.416812 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.416794 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d"} err="failed to get container status \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": rpc error: code = NotFound desc = could not find container \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": container with ID starting with b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d not found: ID does not exist" Jul 07 16:17:10.416878 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.416814 2581 scope.go:117] "RemoveContainer" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" Jul 07 16:17:10.417016 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.416999 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d"} err="failed to get container status \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": rpc error: code = NotFound desc = could not find container \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": container with ID starting with 9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d not found: ID does not exist" Jul 07 16:17:10.417060 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417017 2581 scope.go:117] "RemoveContainer" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" Jul 07 16:17:10.417281 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417256 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d"} err="failed to get container status \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": rpc error: code = NotFound desc = could not find container \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": container with ID starting with 8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d not found: ID does not exist" Jul 07 16:17:10.417338 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417282 2581 scope.go:117] "RemoveContainer" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" Jul 07 16:17:10.417485 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417464 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54"} err="failed to get container status \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": rpc error: code = NotFound desc = could not find container \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": container with ID starting with c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54 not found: ID does not exist" Jul 07 16:17:10.417531 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417486 2581 scope.go:117] "RemoveContainer" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" Jul 07 16:17:10.417675 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417658 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738"} err="failed to get container status \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": rpc error: code = NotFound desc = could not find container \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": container with ID starting with c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738 not found: ID does not exist" Jul 07 16:17:10.417743 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417677 2581 scope.go:117] "RemoveContainer" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" Jul 07 16:17:10.417861 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417841 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87"} err="failed to get container status \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": rpc error: code = NotFound desc = could not find container \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": container with ID starting with 0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87 not found: ID does not exist" Jul 07 16:17:10.417911 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.417863 2581 scope.go:117] "RemoveContainer" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" Jul 07 16:17:10.418055 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418038 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f"} err="failed to get container status \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": rpc error: code = NotFound desc = could not find container \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": container with ID starting with 23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f not found: ID does not exist" Jul 07 16:17:10.418166 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418055 2581 scope.go:117] "RemoveContainer" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" Jul 07 16:17:10.418318 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418302 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d"} err="failed to get container status \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": rpc error: code = NotFound desc = could not find container \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": container with ID starting with b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d not found: ID does not exist" Jul 07 16:17:10.418318 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418318 2581 scope.go:117] "RemoveContainer" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" Jul 07 16:17:10.418540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418519 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d"} err="failed to get container status \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": rpc error: code = NotFound desc = could not find container \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": container with ID starting with 9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d not found: ID does not exist" Jul 07 16:17:10.418613 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418543 2581 scope.go:117] "RemoveContainer" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" Jul 07 16:17:10.418769 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418753 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d"} err="failed to get container status \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": rpc error: code = NotFound desc = could not find container \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": container with ID starting with 8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d not found: ID does not exist" Jul 07 16:17:10.418815 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418770 2581 scope.go:117] "RemoveContainer" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" Jul 07 16:17:10.418995 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418978 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54"} err="failed to get container status \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": rpc error: code = NotFound desc = could not find container \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": container with ID starting with c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54 not found: ID does not exist" Jul 07 16:17:10.419040 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.418996 2581 scope.go:117] "RemoveContainer" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" Jul 07 16:17:10.419224 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.419206 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738"} err="failed to get container status \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": rpc error: code = NotFound desc = could not find container \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": container with ID starting with c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738 not found: ID does not exist" Jul 07 16:17:10.419274 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.419224 2581 scope.go:117] "RemoveContainer" containerID="0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87" Jul 07 16:17:10.419436 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.419411 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87"} err="failed to get container status \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": rpc error: code = NotFound desc = could not find container \"0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87\": container with ID starting with 0fa443c61c8b51b9179cd5bdff9dd213216154f31cd0432d3d7e94e55db9ee87 not found: ID does not exist" Jul 07 16:17:10.419436 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.419429 2581 scope.go:117] "RemoveContainer" containerID="23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f" Jul 07 16:17:10.419630 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.419616 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f"} err="failed to get container status \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": rpc error: code = NotFound desc = could not find container \"23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f\": container with ID starting with 23f883463ac688dc9e9e3f1e80f11eeaf8f5bca9337fd64cd0ba82aa2618917f not found: ID does not exist" Jul 07 16:17:10.419630 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.419630 2581 scope.go:117] "RemoveContainer" containerID="b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d" Jul 07 16:17:10.419861 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.419843 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d"} err="failed to get container status \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": rpc error: code = NotFound desc = could not find container \"b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d\": container with ID starting with b9b63f61f37202f08121ca11af49590ce9cff046f715d635d00819fa4665611d not found: ID does not exist" Jul 07 16:17:10.419926 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.419862 2581 scope.go:117] "RemoveContainer" containerID="9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d" Jul 07 16:17:10.420113 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.420082 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d"} err="failed to get container status \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": rpc error: code = NotFound desc = could not find container \"9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d\": container with ID starting with 9396628ca3748c3a19d118e4d30ac9b206a6c18903abc6fa6215fb56483d619d not found: ID does not exist" Jul 07 16:17:10.420155 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.420114 2581 scope.go:117] "RemoveContainer" containerID="8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d" Jul 07 16:17:10.420300 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.420284 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d"} err="failed to get container status \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": rpc error: code = NotFound desc = could not find container \"8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d\": container with ID starting with 8b5ee91004bd0618cec70b62c74b28689b398ab1017cb4df57fdedb7ff315f9d not found: ID does not exist" Jul 07 16:17:10.420343 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.420300 2581 scope.go:117] "RemoveContainer" containerID="c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54" Jul 07 16:17:10.420470 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.420455 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54"} err="failed to get container status \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": rpc error: code = NotFound desc = could not find container \"c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54\": container with ID starting with c6655ba21a2c65827d18becb6f084cbfb98f0502e8587bea449f1383e05c9a54 not found: ID does not exist" Jul 07 16:17:10.420509 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.420470 2581 scope.go:117] "RemoveContainer" containerID="c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738" Jul 07 16:17:10.420661 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.420636 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738"} err="failed to get container status \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": rpc error: code = NotFound desc = could not find container \"c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738\": container with ID starting with c6b41d207204ec70f634300cf3a66b5f2a1f0c8fb23c6968a96112106b55c738 not found: ID does not exist" Jul 07 16:17:10.429772 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.429748 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:17:10.430010 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.429998 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="config-reloader" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430012 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="config-reloader" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430020 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy-web" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430025 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy-web" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430032 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="init-config-reloader" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430038 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="init-config-reloader" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430044 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy-thanos" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430049 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy-thanos" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430055 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6389363e-c5df-4cc3-b893-e6f7e8a93c7c" containerName="registry" Jul 07 16:17:10.430058 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430060 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6389363e-c5df-4cc3-b893-e6f7e8a93c7c" containerName="registry" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430068 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="prometheus" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430073 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="prometheus" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430084 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" containerName="console" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430089 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" containerName="console" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430113 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="thanos-sidecar" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430120 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="thanos-sidecar" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430130 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430135 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430173 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="config-reloader" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430181 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="thanos-sidecar" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430187 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="prometheus" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430192 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy-thanos" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430197 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy-web" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430202 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" containerName="kube-rbac-proxy" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430208 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7c8a02b-773a-48cb-ae7b-cbf6fe1c5508" containerName="console" Jul 07 16:17:10.430331 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.430214 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6389363e-c5df-4cc3-b893-e6f7e8a93c7c" containerName="registry" Jul 07 16:17:10.435250 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.435232 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.438184 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.438159 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tfpgc\"" Jul 07 16:17:10.438326 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.438312 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 16:17:10.438391 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.438372 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 16:17:10.440540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.440517 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 16:17:10.440650 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.440545 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 16:17:10.440650 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.440611 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 16:17:10.440768 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.440718 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 16:17:10.440768 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.440741 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 16:17:10.440862 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.440784 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 16:17:10.440862 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.440851 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 16:17:10.441168 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.441152 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 16:17:10.441247 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.441158 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 16:17:10.441247 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.441191 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bg86jvtgbl81c\"" Jul 07 16:17:10.441513 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.441497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 16:17:10.441553 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.441497 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 16:17:10.446628 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.446611 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 16:17:10.449121 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.449089 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 16:17:10.459414 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.459395 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:17:10.595020 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.594979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0410fdaf-f2ec-4238-882f-90b57ed76d14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595020 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595023 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595266 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0410fdaf-f2ec-4238-882f-90b57ed76d14-config-out\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595316 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595410 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595453 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595480 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-config\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595540 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595540 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-web-config\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595559 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595576 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595590 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdh59\" (UniqueName: \"kubernetes.io/projected/0410fdaf-f2ec-4238-882f-90b57ed76d14-kube-api-access-tdh59\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595638 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595666 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.595913 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.595703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696455 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0410fdaf-f2ec-4238-882f-90b57ed76d14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696551 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696551 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696551 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696512 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696551 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696537 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696730 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0410fdaf-f2ec-4238-882f-90b57ed76d14-config-out\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696730 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696730 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696730 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696653 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696730 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696730 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696705 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696733 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696759 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-config\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696783 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-web-config\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696866 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdh59\" (UniqueName: \"kubernetes.io/projected/0410fdaf-f2ec-4238-882f-90b57ed76d14-kube-api-access-tdh59\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696891 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696913 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.696984 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.696940 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.697435 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.697343 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.697435 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.697420 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.697536 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.697432 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.697536 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.697491 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.698012 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.697969 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.698201 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.698177 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.699897 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.699570 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0410fdaf-f2ec-4238-882f-90b57ed76d14-config-out\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.700016 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.699958 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.700225 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.700202 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-web-config\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.700977 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.700527 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.700977 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.700651 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.700977 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.700741 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-config\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.700977 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.700954 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0410fdaf-f2ec-4238-882f-90b57ed76d14-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.701306 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.701198 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0410fdaf-f2ec-4238-882f-90b57ed76d14-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.701933 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.701907 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.702392 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.702363 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.702522 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.702504 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.702901 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.702881 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.703039 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.703022 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0410fdaf-f2ec-4238-882f-90b57ed76d14-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.708021 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.707995 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdh59\" (UniqueName: \"kubernetes.io/projected/0410fdaf-f2ec-4238-882f-90b57ed76d14-kube-api-access-tdh59\") pod \"prometheus-k8s-0\" (UID: \"0410fdaf-f2ec-4238-882f-90b57ed76d14\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.744396 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.744357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:17:10.884179 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:10.884079 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 16:17:10.886627 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:17:10.886598 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0410fdaf_f2ec_4238_882f_90b57ed76d14.slice/crio-fa569a1406c5cb846919cdf209a4b117ef8df708b86f2a114ef4ca31dcc69ca9 WatchSource:0}: Error finding container fa569a1406c5cb846919cdf209a4b117ef8df708b86f2a114ef4ca31dcc69ca9: Status 404 returned error can't find the container with id fa569a1406c5cb846919cdf209a4b117ef8df708b86f2a114ef4ca31dcc69ca9 Jul 07 16:17:11.367897 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:11.367813 2581 generic.go:356] "Generic (PLEG): container finished" podID="0410fdaf-f2ec-4238-882f-90b57ed76d14" containerID="3d7a36ce019b96fbddb51644c34ecaa5069a0f7f8e288c3cd6621c42129ce5b2" exitCode=0 Jul 07 16:17:11.368036 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:11.367893 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0410fdaf-f2ec-4238-882f-90b57ed76d14","Type":"ContainerDied","Data":"3d7a36ce019b96fbddb51644c34ecaa5069a0f7f8e288c3cd6621c42129ce5b2"} Jul 07 16:17:11.368036 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:11.367964 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0410fdaf-f2ec-4238-882f-90b57ed76d14","Type":"ContainerStarted","Data":"fa569a1406c5cb846919cdf209a4b117ef8df708b86f2a114ef4ca31dcc69ca9"} Jul 07 16:17:12.068254 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:12.068218 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67e8bcdf-547d-416f-b1a7-867c0b14ccbf" path="/var/lib/kubelet/pods/67e8bcdf-547d-416f-b1a7-867c0b14ccbf/volumes" Jul 07 16:17:12.375285 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:12.375193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0410fdaf-f2ec-4238-882f-90b57ed76d14","Type":"ContainerStarted","Data":"3a607f9496b3d394743ca42f7433e551999eff25a8e14cab4a68697e9ddf6248"} Jul 07 16:17:12.375285 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:12.375262 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0410fdaf-f2ec-4238-882f-90b57ed76d14","Type":"ContainerStarted","Data":"3f2d9b3cb4b8a7b06f7b0ae5f58a420076677db2551e341e8b57a01a7066cae6"} Jul 07 16:17:12.375505 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:12.375291 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0410fdaf-f2ec-4238-882f-90b57ed76d14","Type":"ContainerStarted","Data":"b61dbb076417503d46a2403aa444edcd3f88da2488a75e6b306d99137adce9ae"} Jul 07 16:17:12.375505 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:12.375315 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0410fdaf-f2ec-4238-882f-90b57ed76d14","Type":"ContainerStarted","Data":"83714805b21d2b5a8a95d41db43e546f771b8949483710f0053fd6aa48655f34"} Jul 07 16:17:12.375505 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:12.375346 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0410fdaf-f2ec-4238-882f-90b57ed76d14","Type":"ContainerStarted","Data":"51775b1781e7f14f8700bfb32924c2e3a5b20e9d10ff7d0511b8e0102a9add2f"} Jul 07 16:17:12.375505 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:12.375373 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0410fdaf-f2ec-4238-882f-90b57ed76d14","Type":"ContainerStarted","Data":"2cbc9ab0174eabbdc4b8985345ce8a445bbc0a48ee5564d4feb5e7f4935e974a"} Jul 07 16:17:15.744961 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:17:15.744919 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:18:10.745363 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:18:10.745311 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:18:10.760630 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:18:10.760600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:18:10.791114 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:18:10.791043 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=60.771279091 podStartE2EDuration="1m0.791020657s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.741566ms" isStatefulPod=false podCreationTimestamp="2026-07-07 16:17:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:17:12.420956213 +0000 UTC m=+392.828158836" watchObservedRunningTime="2026-07-07 16:18:10.791020657 +0000 UTC m=+451.198223281" Jul 07 16:18:11.610743 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:18:11.610671 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 16:19:42.752991 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:42.752874 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rs5zd_9cd1b59b-3916-4651-a3ae-527595660f75/global-pull-secret-syncer/0.log" Jul 07 16:19:42.944574 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:42.944522 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gpqgr_5970b079-4ed8-4587-8055-0a12cd138cf7/konnectivity-agent/0.log" Jul 07 16:19:42.968132 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:42.968082 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-97.ec2.internal_069618fd9935d30ef59a0acde000b9cb/haproxy/0.log" Jul 07 16:19:46.850585 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:46.850485 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mg84d_4e1923bb-2f87-4936-b5f6-6d7ea79883d0/kube-state-metrics/0.log" Jul 07 16:19:46.869512 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:46.869488 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mg84d_4e1923bb-2f87-4936-b5f6-6d7ea79883d0/kube-rbac-proxy-main/0.log" Jul 07 16:19:46.890995 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:46.890952 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-mg84d_4e1923bb-2f87-4936-b5f6-6d7ea79883d0/kube-rbac-proxy-self/0.log" Jul 07 16:19:47.054664 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.054638 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fk79t_4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6/node-exporter/0.log" Jul 07 16:19:47.078236 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.078213 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fk79t_4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6/kube-rbac-proxy/0.log" Jul 07 16:19:47.099157 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.099131 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fk79t_4019f9ac-9ad2-4f48-ba1d-b82c32d58fe6/init-textfile/0.log" Jul 07 16:19:47.293421 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.293392 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0410fdaf-f2ec-4238-882f-90b57ed76d14/prometheus/0.log" Jul 07 16:19:47.312679 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.312652 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0410fdaf-f2ec-4238-882f-90b57ed76d14/config-reloader/0.log" Jul 07 16:19:47.339819 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.339789 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0410fdaf-f2ec-4238-882f-90b57ed76d14/thanos-sidecar/0.log" Jul 07 16:19:47.360571 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.360545 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0410fdaf-f2ec-4238-882f-90b57ed76d14/kube-rbac-proxy-web/0.log" Jul 07 16:19:47.383256 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.383235 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0410fdaf-f2ec-4238-882f-90b57ed76d14/kube-rbac-proxy/0.log" Jul 07 16:19:47.404876 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.404856 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0410fdaf-f2ec-4238-882f-90b57ed76d14/kube-rbac-proxy-thanos/0.log" Jul 07 16:19:47.430144 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.430117 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0410fdaf-f2ec-4238-882f-90b57ed76d14/init-config-reloader/0.log" Jul 07 16:19:47.455241 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.455213 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-kqjf9_02782260-75f6-449e-81ac-6673897c48be/prometheus-operator/0.log" Jul 07 16:19:47.478115 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.478076 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-kqjf9_02782260-75f6-449e-81ac-6673897c48be/kube-rbac-proxy/0.log" Jul 07 16:19:47.504259 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:47.504238 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-9wsbt_b1db7ec0-2947-405c-ba17-565867eb8de0/prometheus-operator-admission-webhook/0.log" Jul 07 16:19:49.842740 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:49.842711 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-864fm_352efe56-78bd-4354-a5a9-7b95869fd19d/download-server/0.log" Jul 07 16:19:50.439228 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.439193 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n"] Jul 07 16:19:50.442643 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.442621 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.445608 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.445585 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mrdb2\"/\"default-dockercfg-mh7z4\"" Jul 07 16:19:50.446847 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.446829 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mrdb2\"/\"kube-root-ca.crt\"" Jul 07 16:19:50.446907 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.446860 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mrdb2\"/\"openshift-service-ca.crt\"" Jul 07 16:19:50.452286 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.452261 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n"] Jul 07 16:19:50.538455 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.538422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-lib-modules\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.538455 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.538461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-sys\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.538672 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.538489 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-podres\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.538672 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.538533 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72674\" (UniqueName: \"kubernetes.io/projected/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-kube-api-access-72674\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.538672 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.538591 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-proc\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.639811 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.639766 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-sys\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.639985 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.639822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-podres\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.639985 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.639840 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72674\" (UniqueName: \"kubernetes.io/projected/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-kube-api-access-72674\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.639985 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.639903 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-sys\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.639985 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.639951 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-podres\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.639985 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.639963 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-proc\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.640289 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.640020 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-proc\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.640289 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.640080 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-lib-modules\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.640289 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.640179 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-lib-modules\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.647692 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.647667 2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72674\" (UniqueName: \"kubernetes.io/projected/4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9-kube-api-access-72674\") pod \"perf-node-gather-daemonset-7sc8n\" (UID: \"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9\") " pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.753740 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.753660 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.877064 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.877042 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n"] Jul 07 16:19:50.879793 ip-10-0-134-97 kubenswrapper[2581]: W0707 16:19:50.879757 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4c9790f6_17dd_44e2_ba2f_d7300a0a2ab9.slice/crio-86ec286d46af5d4773aaafd3f8b46bae0f0021a7678bf1a6e71a33b8652abb53 WatchSource:0}: Error finding container 86ec286d46af5d4773aaafd3f8b46bae0f0021a7678bf1a6e71a33b8652abb53: Status 404 returned error can't find the container with id 86ec286d46af5d4773aaafd3f8b46bae0f0021a7678bf1a6e71a33b8652abb53 Jul 07 16:19:50.966724 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.966691 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" event={"ID":"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9","Type":"ContainerStarted","Data":"601ecc639ef899b99194cbf3d4a1183b787d3060d6eec9da13d9ee33f00c9fd4"} Jul 07 16:19:50.966845 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.966747 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" event={"ID":"4c9790f6-17dd-44e2-ba2f-d7300a0a2ab9","Type":"ContainerStarted","Data":"86ec286d46af5d4773aaafd3f8b46bae0f0021a7678bf1a6e71a33b8652abb53"} Jul 07 16:19:50.966845 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.966826 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:50.983416 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:50.983373 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" podStartSLOduration=0.983358931 podStartE2EDuration="983.358931ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 16:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 16:19:50.98214508 +0000 UTC m=+551.389347710" watchObservedRunningTime="2026-07-07 16:19:50.983358931 +0000 UTC m=+551.390561552" Jul 07 16:19:51.156567 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:51.156489 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dzf7_e16f8521-2cd1-4e56-b923-17af5ec091bb/dns/0.log" Jul 07 16:19:51.176488 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:51.176468 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4dzf7_e16f8521-2cd1-4e56-b923-17af5ec091bb/kube-rbac-proxy/0.log" Jul 07 16:19:51.313839 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:51.313815 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hjxzx_8a2d0cb9-a4f1-46a2-b838-6c92146f9677/dns-node-resolver/0.log" Jul 07 16:19:51.779559 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:51.779526 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wxvmj_82e05262-7701-4d63-a4d8-1a53e6eec64c/node-ca/0.log" Jul 07 16:19:52.703844 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:52.703800 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2twqz_d8efd57e-7db3-43b5-8db1-1c3228d84e70/serve-healthcheck-canary/0.log" Jul 07 16:19:53.219560 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:53.219535 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlcj5_cfef5166-d088-4911-8b94-94ac6082968e/kube-rbac-proxy/0.log" Jul 07 16:19:53.240114 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:53.240078 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlcj5_cfef5166-d088-4911-8b94-94ac6082968e/exporter/0.log" Jul 07 16:19:53.259213 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:53.259181 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlcj5_cfef5166-d088-4911-8b94-94ac6082968e/extractor/0.log" Jul 07 16:19:56.979853 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:56.979823 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mrdb2/perf-node-gather-daemonset-7sc8n" Jul 07 16:19:57.032075 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:57.032049 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-z6l4q_32489081-30a2-49a3-b315-bf73c0164aba/migrator/0.log" Jul 07 16:19:57.053140 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:57.053109 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-z6l4q_32489081-30a2-49a3-b315-bf73c0164aba/graceful-termination/0.log" Jul 07 16:19:58.126566 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.126537 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4bsww_b753600e-c525-4724-853a-cfc03c9cf260/kube-multus/0.log" Jul 07 16:19:58.459955 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.459928 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4rps_c8423cec-c965-4e4b-b366-050dfdf1ce59/kube-multus-additional-cni-plugins/0.log" Jul 07 16:19:58.483858 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.483832 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4rps_c8423cec-c965-4e4b-b366-050dfdf1ce59/egress-router-binary-copy/0.log" Jul 07 16:19:58.509227 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.509199 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4rps_c8423cec-c965-4e4b-b366-050dfdf1ce59/cni-plugins/0.log" Jul 07 16:19:58.530977 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.530952 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4rps_c8423cec-c965-4e4b-b366-050dfdf1ce59/bond-cni-plugin/0.log" Jul 07 16:19:58.550545 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.550523 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4rps_c8423cec-c965-4e4b-b366-050dfdf1ce59/routeoverride-cni/0.log" Jul 07 16:19:58.571782 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.571756 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4rps_c8423cec-c965-4e4b-b366-050dfdf1ce59/whereabouts-cni-bincopy/0.log" Jul 07 16:19:58.591724 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.591703 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-z4rps_c8423cec-c965-4e4b-b366-050dfdf1ce59/whereabouts-cni/0.log" Jul 07 16:19:58.768081 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.768010 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lfhn7_ab32e5be-3eea-4303-98f9-247e50b9bf06/network-metrics-daemon/0.log" Jul 07 16:19:58.788752 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:58.788726 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lfhn7_ab32e5be-3eea-4303-98f9-247e50b9bf06/kube-rbac-proxy/0.log" Jul 07 16:19:59.808017 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:59.807926 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcfqv_5fb1537f-e9bf-4dd6-8c39-326102d64292/ovn-controller/0.log" Jul 07 16:19:59.828497 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:59.828468 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcfqv_5fb1537f-e9bf-4dd6-8c39-326102d64292/ovn-acl-logging/0.log" Jul 07 16:19:59.853848 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:59.853819 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcfqv_5fb1537f-e9bf-4dd6-8c39-326102d64292/kube-rbac-proxy-node/0.log" Jul 07 16:19:59.875935 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:59.875910 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcfqv_5fb1537f-e9bf-4dd6-8c39-326102d64292/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 16:19:59.899195 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:59.899169 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcfqv_5fb1537f-e9bf-4dd6-8c39-326102d64292/northd/0.log" Jul 07 16:19:59.924042 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:59.924015 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcfqv_5fb1537f-e9bf-4dd6-8c39-326102d64292/nbdb/0.log" Jul 07 16:19:59.947302 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:59.947279 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcfqv_5fb1537f-e9bf-4dd6-8c39-326102d64292/sbdb/0.log" Jul 07 16:19:59.983533 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:19:59.983506 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hcfqv_5fb1537f-e9bf-4dd6-8c39-326102d64292/ovnkube-controller/0.log" Jul 07 16:20:01.159361 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:01.159329 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-cgssn_90a26398-a0e3-408b-ba0d-c064636f8061/check-endpoints/0.log" Jul 07 16:20:01.227900 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:01.227873 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-zjldg_052ce891-8d50-4448-83f3-6a0f543b1aa3/network-check-target-container/0.log" Jul 07 16:20:02.076309 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:02.076282 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-2f6xm_ec9111c6-a987-4a9b-8454-3b8cc2c56d53/iptables-alerter/0.log" Jul 07 16:20:02.752694 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:02.752664 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-mvxdk_19eac631-0134-4955-8305-3ab387223cf9/tuned/0.log" Jul 07 16:20:04.339570 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:04.339542 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-h82c6_7cba9074-e21c-4946-be89-afbde1896780/cluster-samples-operator/0.log" Jul 07 16:20:04.355341 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:04.355313 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-56fcf86bf-h82c6_7cba9074-e21c-4946-be89-afbde1896780/cluster-samples-operator-watch/0.log" Jul 07 16:20:06.005750 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:06.005725 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-t4ccw_1149ea79-0147-4e20-b44d-84c518e99ccb/csi-driver/0.log" Jul 07 16:20:06.026525 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:06.026503 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-t4ccw_1149ea79-0147-4e20-b44d-84c518e99ccb/csi-node-driver-registrar/0.log" Jul 07 16:20:06.046375 ip-10-0-134-97 kubenswrapper[2581]: I0707 16:20:06.046344 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-t4ccw_1149ea79-0147-4e20-b44d-84c518e99ccb/csi-liveness-probe/0.log"