Jul 06 15:25:28.101813 ip-10-0-128-213 systemd[1]: Starting Kubernetes Kubelet... Jul 06 15:25:28.463320 ip-10-0-128-213 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:28.463320 ip-10-0-128-213 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 15:25:28.463320 ip-10-0-128-213 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:28.463320 ip-10-0-128-213 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 15:25:28.463320 ip-10-0-128-213 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:28.464156 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.464057 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 15:25:28.468936 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468921 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:28.468936 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468936 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468940 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468943 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468946 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468949 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468952 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468955 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468957 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468960 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468962 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468965 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468968 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468970 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468973 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468975 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468978 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468982 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468984 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468987 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:28.468998 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468989 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468992 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468994 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.468997 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469000 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469003 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469005 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469008 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469011 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469017 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469019 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469022 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469025 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469027 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469030 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469032 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469035 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469038 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469040 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469043 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:28.469464 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469045 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469049 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469053 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469056 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469059 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469062 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469064 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469067 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469070 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469072 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469074 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469077 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469079 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469082 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469086 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469088 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469091 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469093 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469096 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469099 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:28.469955 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469101 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469104 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469107 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469109 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469112 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469114 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469117 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469120 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469122 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469125 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469127 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469130 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469132 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469136 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469140 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469143 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469146 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469149 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469151 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:28.470445 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469154 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469157 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469159 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469162 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469164 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469167 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469169 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469173 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469175 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469178 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469180 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469183 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469186 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469190 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469193 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469195 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469198 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469200 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469204 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469206 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:28.470911 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469896 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469903 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469906 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469909 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469911 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469914 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469916 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469919 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469922 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469924 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469927 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469929 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469932 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469934 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469937 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469940 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469942 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469945 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469948 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469951 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:28.471382 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469954 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469956 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469959 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469962 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469964 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469967 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469970 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469972 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469975 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469977 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469980 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469982 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469985 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469987 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469990 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469992 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469995 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.469997 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470000 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470002 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:28.471915 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470004 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470007 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470009 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470014 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470018 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470021 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470024 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470041 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470046 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470049 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470052 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470055 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470058 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470061 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470064 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470067 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470069 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470071 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470074 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:28.472428 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470077 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470079 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470082 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470084 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470087 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470090 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470093 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470095 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470097 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470101 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470104 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470107 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470110 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470112 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470115 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470117 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470120 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470122 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470125 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:28.472923 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470128 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470131 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470134 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470136 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470139 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470142 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470145 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470147 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470149 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470152 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470156 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470159 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470162 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470165 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470167 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470170 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470174 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470177 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470180 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470182 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:28.473376 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470185 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470565 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470572 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470575 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470579 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470581 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470585 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470588 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470591 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470593 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470596 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470598 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470601 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470604 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470607 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470610 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470613 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470615 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470618 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:28.473877 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470621 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470623 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470626 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470629 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470631 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470634 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470636 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470639 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470641 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470644 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470646 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470651 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470654 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470656 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470659 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470662 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470664 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470666 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470669 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:28.474340 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470671 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470674 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470676 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470679 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470681 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470684 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470687 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470689 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470692 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470695 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470697 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470700 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470703 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470705 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470708 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470710 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470713 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470715 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470717 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470720 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:28.474817 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470723 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470725 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470742 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470746 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470750 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470752 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470755 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470759 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470761 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470764 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470767 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470769 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470772 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470774 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470777 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470779 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470782 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470784 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470787 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:28.475294 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470789 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470793 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470798 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470802 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470806 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470809 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470811 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470814 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470817 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470820 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470822 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470825 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470827 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470829 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470832 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470834 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470837 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470839 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470842 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470844 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:28.475761 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470847 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470849 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.470852 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470916 2561 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470923 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470929 2561 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470934 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470937 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470940 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470944 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470948 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470955 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470958 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470961 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470964 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470967 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470971 2561 flags.go:64] FLAG: --cgroup-root="" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470974 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470977 2561 flags.go:64] FLAG: --client-ca-file="" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470979 2561 flags.go:64] FLAG: --cloud-provider="external" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470982 2561 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470987 2561 flags.go:64] FLAG: --cluster-domain="" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470990 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470993 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 15:25:28.476242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470996 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.470999 2561 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471003 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471006 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471009 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471012 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471015 2561 flags.go:64] FLAG: --contention-profiling="false" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471018 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471020 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471023 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471026 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471030 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471033 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471036 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471039 2561 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471042 2561 flags.go:64] FLAG: --enable-server="true" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471046 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471051 2561 flags.go:64] FLAG: --event-burst="100" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471053 2561 flags.go:64] FLAG: --event-qps="50" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471057 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471060 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471063 2561 flags.go:64] FLAG: --eviction-hard="" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471067 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471069 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471072 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 15:25:28.476827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471076 2561 flags.go:64] FLAG: --eviction-soft="" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471079 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471081 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471084 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471087 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471090 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471093 2561 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471095 2561 flags.go:64] FLAG: --feature-gates="" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471102 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471105 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471108 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471111 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471114 2561 flags.go:64] FLAG: --healthz-port="10248" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471117 2561 flags.go:64] FLAG: --help="false" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471120 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471122 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471125 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471128 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471131 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471134 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471137 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471140 2561 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471142 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 15:25:28.477425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471146 2561 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471149 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471152 2561 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471156 2561 flags.go:64] FLAG: --kube-reserved="" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471159 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471162 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471165 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471168 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471171 2561 flags.go:64] FLAG: --lock-file="" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471173 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471177 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471180 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471185 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471187 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471190 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471193 2561 flags.go:64] FLAG: --logging-format="text" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471196 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471199 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471201 2561 flags.go:64] FLAG: --manifest-url="" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471204 2561 flags.go:64] FLAG: --manifest-url-header="" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471208 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471211 2561 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471214 2561 flags.go:64] FLAG: --max-pods="110" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471218 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471220 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 15:25:28.478152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471223 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471226 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471229 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471232 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471234 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471241 2561 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471244 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471248 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471251 2561 flags.go:64] FLAG: --pod-cidr="" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471254 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471259 2561 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471263 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471267 2561 flags.go:64] FLAG: --pods-per-core="0" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471269 2561 flags.go:64] FLAG: --port="10250" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471273 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471275 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a0238cda0c5dd74a" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471278 2561 flags.go:64] FLAG: --qos-reserved="" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471281 2561 flags.go:64] FLAG: --read-only-port="10255" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471285 2561 flags.go:64] FLAG: --register-node="true" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471288 2561 flags.go:64] FLAG: --register-with-taints="" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471292 2561 flags.go:64] FLAG: --registry-burst="10" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471294 2561 flags.go:64] FLAG: --registry-qps="5" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471297 2561 flags.go:64] FLAG: --reserved-cpus="" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471299 2561 flags.go:64] FLAG: --reserved-memory="" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471303 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 15:25:28.478772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471306 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471309 2561 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471311 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471314 2561 flags.go:64] FLAG: --runonce="false" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471317 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471320 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471323 2561 flags.go:64] FLAG: --seccomp-default="false" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471325 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471328 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471331 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471334 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471337 2561 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471340 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471343 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471347 2561 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471350 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471353 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471355 2561 flags.go:64] FLAG: --system-cgroups="" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471359 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471364 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471367 2561 flags.go:64] FLAG: --tls-cert-file="" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471370 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471374 2561 flags.go:64] FLAG: --tls-min-version="" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471377 2561 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471380 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 15:25:28.479370 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471383 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471386 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471389 2561 flags.go:64] FLAG: --v="2" Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471393 2561 flags.go:64] FLAG: --version="false" Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471397 2561 flags.go:64] FLAG: --vmodule="" Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471400 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471403 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471509 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471512 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471515 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471518 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471520 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471523 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471525 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471528 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471531 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471548 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471551 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471556 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471559 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471563 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:28.480009 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471567 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471570 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471573 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471576 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471580 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471583 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471586 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471588 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471591 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471593 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471596 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471598 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471601 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471604 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471607 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471609 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471611 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471614 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471616 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471619 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:28.480520 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471622 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471624 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471627 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471629 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471632 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471634 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471637 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471639 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471642 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471645 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471647 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471651 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471655 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471658 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471660 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471663 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471666 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471669 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471671 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471674 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:28.481023 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471677 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471680 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471682 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471685 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471687 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471690 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471693 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471696 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471698 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471700 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471703 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471706 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471708 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471710 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471713 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471716 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471718 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471720 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471723 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:28.481554 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471725 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471730 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471733 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471736 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471739 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471743 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471746 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471748 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471751 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471755 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471758 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471761 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471763 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471766 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471769 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471772 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471774 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471777 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471780 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471782 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:28.482020 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471785 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471787 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471790 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471792 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471795 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.471797 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.471803 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.478086 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.478100 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.478120 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.478127 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478180 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478185 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478189 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478192 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:28.482505 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478195 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478198 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478200 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478203 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478206 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478209 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478211 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478214 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478216 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478219 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478222 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478224 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478227 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478229 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478233 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478237 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478241 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478243 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478246 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478249 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:28.482886 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478251 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478254 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478256 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478259 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478262 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478265 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478268 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478271 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478273 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478276 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478278 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478281 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478284 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478286 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478289 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478291 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478294 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478296 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478299 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:28.483361 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478301 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478304 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478306 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478309 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478311 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478314 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478317 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478319 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478322 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478324 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478326 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478330 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478334 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478338 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478341 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478343 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478346 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478349 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478352 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478355 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:28.483829 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478358 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478360 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478363 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478365 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478368 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478370 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478373 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478375 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478377 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478380 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478384 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478387 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478389 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478392 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478394 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478397 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478400 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478403 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478406 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:28.484327 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478409 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478412 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478414 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478417 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478420 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478422 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478425 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478428 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478430 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478433 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478435 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478438 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478441 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478444 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478446 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478449 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:28.484855 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478451 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.478456 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478596 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478602 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478605 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478607 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478610 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478613 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478616 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478618 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478621 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478623 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478626 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478628 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478631 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:28.485240 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478633 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478636 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478638 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478641 2561 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478643 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478646 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478648 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478651 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478653 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478656 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478659 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478661 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478664 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478667 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478670 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478673 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478676 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478678 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478681 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478683 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:28.485695 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478686 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478688 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478690 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478693 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478697 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478700 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478702 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478705 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478709 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478712 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478715 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478718 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478720 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478723 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478726 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478729 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478731 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478734 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478737 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:28.486390 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478739 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478742 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478745 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478747 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478750 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478753 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478755 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478758 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478760 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478763 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478766 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478768 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478771 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478773 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478776 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478778 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478781 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478783 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478787 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:28.487100 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478789 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478792 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478795 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478797 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478799 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478802 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478804 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478807 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478809 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478813 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478816 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478818 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478821 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478824 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478826 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478829 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478831 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478834 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478836 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478839 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:28.487585 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478841 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478844 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478846 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478849 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478851 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478854 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478856 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:28.478859 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.478863 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.478960 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.480834 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.482087 2561 server.go:1019] "Starting client certificate rotation" Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.482184 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:25:28.488061 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.482220 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:25:28.488392 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.484343 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:25:28.488392 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.485740 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:25:28.496255 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.496239 2561 log.go:25] "Validated CRI v1 runtime API" Jul 06 15:25:28.500360 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.500346 2561 log.go:25] "Validated CRI v1 image API" Jul 06 15:25:28.501831 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.501811 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 15:25:28.504131 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.504107 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a2d154c9-e8b2-4d6d-9aae-5d16db571807:/dev/nvme0n1p3 ec914f53-f979-4696-860c-246b9a8751d8:/dev/nvme0n1p4] Jul 06 15:25:28.504226 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.504127 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 15:25:28.510390 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.510242 2561 manager.go:216] Machine: {Timestamp:2026-07-06 15:25:28.508878091 +0000 UTC m=+0.297947092 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099744 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec240dfbcaab9ee8e3af2ee05ed0c3f2 SystemUUID:ec240dfb-caab-9ee8-e3af-2ee05ed0c3f2 BootID:ba1e2050-4f0d-425d-aa87-e2938c9d8f3a Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8d:fe:13:83:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8d:fe:13:83:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:a1:98:be:6b:4b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 15:25:28.510390 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.510388 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 15:25:28.510520 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.510466 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 15:25:28.513328 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.513298 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 15:25:28.513456 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.513329 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 15:25:28.514066 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.514055 2561 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 15:25:28.514102 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.514068 2561 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 15:25:28.514102 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.514076 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:25:28.514102 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.514090 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:25:28.515368 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.515357 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 15:25:28.518064 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.518038 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:25:28.518767 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.518748 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:25:28.518881 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.518871 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 15:25:28.518926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.518900 2561 kubelet.go:486] "Attempting to sync node with API server" Jul 06 15:25:28.518926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.518911 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 15:25:28.518926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.518922 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 15:25:28.519016 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.518932 2561 kubelet.go:398] "Adding apiserver pod source" Jul 06 15:25:28.519016 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.518942 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 15:25:28.519246 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.519226 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:25:28.519246 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.519248 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:25:28.521262 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.521233 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 15:25:28.523037 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.523020 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 15:25:28.523108 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.523052 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 15:25:28.524244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524231 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524247 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524254 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524259 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524268 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524273 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524281 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524286 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524294 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 15:25:28.524299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524299 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 15:25:28.524559 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524308 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 15:25:28.524559 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.524313 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 15:25:28.525021 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.525010 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 15:25:28.525021 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.525020 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 15:25:28.528304 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.528289 2561 server.go:1268] "Started kubelet" Jul 06 15:25:28.528421 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.528376 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 15:25:28.529788 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.529754 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 15:25:28.529865 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.529822 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 15:25:28.529899 ip-10-0-128-213 systemd[1]: Started Kubernetes Kubelet. Jul 06 15:25:28.530877 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.530749 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 15:25:28.530877 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.530824 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 15:25:28.531006 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.530931 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 15:25:28.532823 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.532795 2561 server.go:310] "Adding debug handlers to kubelet server" Jul 06 15:25:28.534989 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.534970 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 15:25:28.535515 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.535497 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 15:25:28.538026 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.537119 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-213.ec2.internal.18bfbcc43f93b650 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-213.ec2.internal,UID:ip-10-0-128-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-213.ec2.internal,},FirstTimestamp:2026-07-06 15:25:28.528262736 +0000 UTC m=+0.317331736,LastTimestamp:2026-07-06 15:25:28.528262736 +0000 UTC m=+0.317331736,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-213.ec2.internal,}" Jul 06 15:25:28.539352 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.539335 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 15:25:28.539352 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.539348 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 15:25:28.539487 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.539437 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:28.540055 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540036 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 15:25:28.540151 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540066 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 15:25:28.540151 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540036 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 15:25:28.540151 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540146 2561 factory.go:55] Registering systemd factory Jul 06 15:25:28.540302 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540161 2561 factory.go:223] Registration of the systemd container factory successfully Jul 06 15:25:28.540302 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540174 2561 reconstruct.go:97] "Volume reconstruction finished" Jul 06 15:25:28.540302 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540182 2561 reconciler.go:29] "Reconciler: start to sync state" Jul 06 15:25:28.540408 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540382 2561 factory.go:153] Registering CRI-O factory Jul 06 15:25:28.540408 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540397 2561 factory.go:223] Registration of the crio container factory successfully Jul 06 15:25:28.540502 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540468 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 15:25:28.540502 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540490 2561 factory.go:103] Registering Raw factory Jul 06 15:25:28.540502 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.540500 2561 manager.go:1196] Started watching for new ooms in manager Jul 06 15:25:28.542970 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.541140 2561 manager.go:349] Starting recovery of all containers Jul 06 15:25:28.549318 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.549277 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 15:25:28.551629 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.551591 2561 manager.go:354] Recovery completed Jul 06 15:25:28.552154 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.552121 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 15:25:28.552965 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.552813 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 15:25:28.553456 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.553438 2561 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 06 15:25:28.556850 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.556836 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:28.558157 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.558140 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8ptsz" Jul 06 15:25:28.558678 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.558663 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:28.558771 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.558689 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:28.558771 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.558699 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:28.559263 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.559245 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 15:25:28.559263 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.559261 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 15:25:28.559359 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.559283 2561 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:25:28.559359 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.559282 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:28.560183 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.560167 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:28.560240 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.560201 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:28.560240 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.560215 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:28.560634 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.560608 2561 policy_none.go:49] "None policy: Start" Jul 06 15:25:28.560634 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.560628 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 15:25:28.560738 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.560643 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 15:25:28.561885 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.561871 2561 policy_none.go:47] "Start" Jul 06 15:25:28.569533 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.569518 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8ptsz" Jul 06 15:25:28.570089 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.570008 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-213.ec2.internal.18bfbcc44163ca02 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-213.ec2.internal,UID:ip-10-0-128-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-213.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-213.ec2.internal,},FirstTimestamp:2026-07-06 15:25:28.558676482 +0000 UTC m=+0.347745483,LastTimestamp:2026-07-06 15:25:28.558676482 +0000 UTC m=+0.347745483,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-213.ec2.internal,}" Jul 06 15:25:28.574336 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.574270 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-213.ec2.internal.18bfbcc441640f51 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-213.ec2.internal,UID:ip-10-0-128-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-213.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-213.ec2.internal,},FirstTimestamp:2026-07-06 15:25:28.558694225 +0000 UTC m=+0.347763225,LastTimestamp:2026-07-06 15:25:28.558694225 +0000 UTC m=+0.347763225,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-213.ec2.internal,}" Jul 06 15:25:28.597192 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.597177 2561 manager.go:337] "Starting Device Plugin manager" Jul 06 15:25:28.597299 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.597220 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 15:25:28.597299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.597233 2561 server.go:87] "Starting device plugin registration server" Jul 06 15:25:28.597474 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.597461 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 15:25:28.597570 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.597476 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 15:25:28.597639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.597582 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 15:25:28.597692 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.597679 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 15:25:28.597742 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.597693 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 15:25:28.598172 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.598153 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 15:25:28.598253 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.598199 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:28.698362 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.698327 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:28.700035 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.700019 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:28.700124 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.700059 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:28.700124 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.700074 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:28.700124 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.700108 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.711147 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.711128 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.711214 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.711147 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-213.ec2.internal\": node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:28.714784 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.714738 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 15:25:28.714784 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.714775 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 15:25:28.714915 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.714794 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 15:25:28.714915 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.714824 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 15:25:28.717167 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.717146 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:28.759678 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.759660 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:28.817643 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.817608 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal"] Jul 06 15:25:28.817743 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.817678 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:28.818446 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.818432 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:28.818507 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.818459 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:28.818507 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.818473 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:28.819957 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.819945 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:28.820067 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.820053 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.820109 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.820084 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:28.820674 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.820654 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:28.820757 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.820684 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:28.820757 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.820694 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:28.820757 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.820662 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:28.820902 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.820766 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:28.820902 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.820778 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:28.821832 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.821819 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.821885 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.821843 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:28.822568 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.822554 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:28.822631 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.822579 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:28.822631 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.822589 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:28.841846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.841823 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d32b06a52fe2c12e89c7b42a8cc8f0b1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"d32b06a52fe2c12e89c7b42a8cc8f0b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.841910 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.841858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/683549c5cb15901e8f0af8813277f06a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"683549c5cb15901e8f0af8813277f06a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.841910 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.841887 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683549c5cb15901e8f0af8813277f06a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"683549c5cb15901e8f0af8813277f06a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.846244 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.846228 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-213.ec2.internal\" not found" node="ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.850638 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.850608 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-213.ec2.internal\" not found" node="ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.860728 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.860706 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:28.942800 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.942780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/683549c5cb15901e8f0af8813277f06a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"683549c5cb15901e8f0af8813277f06a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.942908 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.942805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683549c5cb15901e8f0af8813277f06a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"683549c5cb15901e8f0af8813277f06a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.942908 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.942822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d32b06a52fe2c12e89c7b42a8cc8f0b1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"d32b06a52fe2c12e89c7b42a8cc8f0b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.942908 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.942858 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d32b06a52fe2c12e89c7b42a8cc8f0b1-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"d32b06a52fe2c12e89c7b42a8cc8f0b1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.942908 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.942884 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/683549c5cb15901e8f0af8813277f06a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"683549c5cb15901e8f0af8813277f06a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.943061 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:28.942909 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/683549c5cb15901e8f0af8813277f06a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"683549c5cb15901e8f0af8813277f06a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:28.961456 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:28.961435 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:29.062035 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.061981 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:29.148885 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.148860 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:29.153448 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.153253 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 06 15:25:29.163100 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.163081 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:29.263601 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.263570 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:29.364244 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.364179 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 06 15:25:29.368227 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.368212 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:29.442222 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.442185 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 06 15:25:29.453922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.453898 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:25:29.455604 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.455590 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 06 15:25:29.473525 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.473505 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:25:29.481191 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.481171 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 15:25:29.481317 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.481301 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 15:25:29.481364 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.481345 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 15:25:29.521467 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.521447 2561 apiserver.go:52] "Watching apiserver" Jul 06 15:25:29.537721 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.537698 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 15:25:29.538839 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.538818 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-vmft6","openshift-network-operator/iptables-alerter-ml6wb","openshift-ovn-kubernetes/ovnkube-node-7szf4","kube-system/global-pull-secret-syncer-kp5vs","kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25","openshift-cluster-node-tuning-operator/tuned-lwvwc","openshift-image-registry/node-ca-jz4xk","openshift-multus/multus-additional-cni-plugins-fc89x","kube-system/konnectivity-agent-84rs8","openshift-dns/node-resolver-vf6rv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal","openshift-multus/multus-mm4b4","openshift-multus/network-metrics-daemon-bchrm"] Jul 06 15:25:29.540263 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.540248 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 15:25:29.540394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.540378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.541625 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.541609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.543104 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.543080 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f26r2\"" Jul 06 15:25:29.543428 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.543405 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:25:29.544235 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.543542 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 15:25:29.544235 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.543969 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 15:25:29.544235 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.544066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.545173 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.545153 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m57td\"" Jul 06 15:25:29.545272 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.545254 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 15:25:29.545642 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.545622 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.545775 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.545728 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:29.546272 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546259 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 15:25:29.546318 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546272 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 15:25:29.546686 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-modprobe-d\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.546733 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-kubernetes\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.546733 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546715 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-systemd\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.546733 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546730 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-run\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.546868 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546749 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-var-lib-kubelet\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.546868 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-tmp-dir\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.546868 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysctl-d\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.546868 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysctl-conf\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.546868 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-sys\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.547054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-host\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.547054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546903 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-tuned\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.547054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-hosts-file\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.547054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546958 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98gk8\" (UniqueName: \"kubernetes.io/projected/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-kube-api-access-98gk8\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.547054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.546994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysconfig\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.547054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-lib-modules\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.547258 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547067 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:29.547258 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.547120 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:29.547258 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9612719a-68a6-41b3-8d4b-aee1255e9127-tmp\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.547258 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4srl\" (UniqueName: \"kubernetes.io/projected/9612719a-68a6-41b3-8d4b-aee1255e9127-kube-api-access-s4srl\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.547505 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547490 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fs9x9\"" Jul 06 15:25:29.547600 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547583 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 15:25:29.547678 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547642 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 15:25:29.547678 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547642 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 15:25:29.547762 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.547705 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 15:25:29.548606 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.548590 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.549857 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.549839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.550340 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.550325 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vgx4k\"" Jul 06 15:25:29.550533 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.550514 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 15:25:29.550680 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.550666 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 15:25:29.550761 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.550748 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 15:25:29.551235 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.551220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.552005 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.551988 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 15:25:29.552157 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.552141 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 15:25:29.552238 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.552223 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 15:25:29.552291 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.552264 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8ktrs\"" Jul 06 15:25:29.552456 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.552444 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 15:25:29.552674 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.552657 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 15:25:29.552748 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.552700 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.553101 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.553085 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 15:25:29.553472 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.553457 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vjj89\"" Jul 06 15:25:29.554187 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.554170 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:29.555062 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.555041 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 15:25:29.555165 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.555093 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:25:29.555165 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.555046 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tf6bz\"" Jul 06 15:25:29.555643 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.555623 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 15:25:29.555863 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.555844 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:29.555987 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.555907 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:29.556135 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.556118 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 15:25:29.556556 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.556538 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zw4vq\"" Jul 06 15:25:29.556656 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.556536 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:25:29.556656 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.556629 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 15:25:29.557161 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.557147 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.559489 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.559464 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 15:25:29.559595 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.559528 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-s7827\"" Jul 06 15:25:29.559595 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.559561 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 15:25:29.559710 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.559594 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 15:25:29.573060 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.573021 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 15:20:29 +0000 UTC" deadline="2028-02-14 23:41:59.508043886 +0000 UTC" Jul 06 15:25:29.573060 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.573058 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14120h16m29.934990122s" Jul 06 15:25:29.585720 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.585698 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jx89c" Jul 06 15:25:29.604658 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.604634 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:29.609130 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.609113 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jx89c" Jul 06 15:25:29.640943 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.640922 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 15:25:29.647338 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-kubelet\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.647438 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-node-log\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.647438 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1682aa2-dba0-4750-a417-fc1242edec08-ovn-node-metrics-cert\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.647438 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647418 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.647550 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647454 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-cnibin\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.647550 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647505 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-daemon-config\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.647638 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647555 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.647638 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4srl\" (UniqueName: \"kubernetes.io/projected/9612719a-68a6-41b3-8d4b-aee1255e9127-kube-api-access-s4srl\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647703 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-log-socket\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.647703 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647665 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.647703 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647687 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-netns\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.647791 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-registration-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.647791 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-modprobe-d\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647791 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-run\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647791 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-var-lib-kubelet\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-system-cni-dir\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-etc-kubernetes\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647855 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-modprobe-d\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647863 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-host\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647887 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-var-lib-kubelet\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-host\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647899 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-ovnkube-config\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647901 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-run\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tdrj\" (UniqueName: \"kubernetes.io/projected/b1682aa2-dba0-4750-a417-fc1242edec08-kube-api-access-8tdrj\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.647952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647949 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647964 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.647983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98gk8\" (UniqueName: \"kubernetes.io/projected/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-kube-api-access-98gk8\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648003 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-etc-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-cni-bin\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-env-overrides\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648048 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-iptables-alerter-script\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frhcw\" (UniqueName: \"kubernetes.io/projected/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-kube-api-access-frhcw\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysconfig\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648110 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-lib-modules\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-var-lib-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648161 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-ovn\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648167 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysconfig\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-system-cni-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-hostroot\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhlr9\" (UniqueName: \"kubernetes.io/projected/b42039fd-c943-44c3-a5bd-c795168f76e0-kube-api-access-lhlr9\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.648261 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648248 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-kubernetes\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-kubelet\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648301 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-lib-modules\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648310 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-kubernetes\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648318 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-multus-certs\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/10be061c-3b18-4684-bfe1-82c7766627b5-konnectivity-ca\") pod \"konnectivity-agent-84rs8\" (UID: \"10be061c-3b18-4684-bfe1-82c7766627b5\") " pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-systemd-units\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648384 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-run-netns\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-ovnkube-script-lib\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648428 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cnibin\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648466 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648501 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l2wp\" (UniqueName: \"kubernetes.io/projected/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-kube-api-access-2l2wp\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648529 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-cni-multus\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648575 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/10be061c-3b18-4684-bfe1-82c7766627b5-agent-certs\") pod \"konnectivity-agent-84rs8\" (UID: \"10be061c-3b18-4684-bfe1-82c7766627b5\") " pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648604 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-run-ovn-kubernetes\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.648914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b42039fd-c943-44c3-a5bd-c795168f76e0-host\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-etc-selinux\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648660 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9612719a-68a6-41b3-8d4b-aee1255e9127-tmp\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648676 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-device-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-tmp-dir\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648783 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnpn2\" (UniqueName: \"kubernetes.io/projected/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-kube-api-access-fnpn2\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648812 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6277c056-1e8b-4601-8715-9a8860e666c5-kubelet-config\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8qnp\" (UniqueName: \"kubernetes.io/projected/dd1fefaf-9f67-46b6-875e-1546a1a24a92-kube-api-access-p8qnp\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648868 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysctl-conf\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648894 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-sys\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-os-release\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648921 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648940 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-os-release\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648965 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6277c056-1e8b-4601-8715-9a8860e666c5-dbus\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648989 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-sys\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.648996 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysctl-conf\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.649734 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-tmp-dir\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-446x4\" (UniqueName: \"kubernetes.io/projected/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-kube-api-access-446x4\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649036 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-sys-fs\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-tuned\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649120 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-hosts-file\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649143 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-cni-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-systemd\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-cni-netd\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649197 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-hosts-file\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-k8s-cni-cncf-io\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649236 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-cni-bin\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649262 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-socket-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-systemd\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649350 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-cni-binary-copy\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-systemd\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.650244 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-conf-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.650781 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b42039fd-c943-44c3-a5bd-c795168f76e0-serviceca\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.650781 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysctl-d\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.650781 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-slash\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.650781 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-host-slash\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.650781 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-socket-dir-parent\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.650781 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.649524 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-sysctl-d\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.651712 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.651692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9612719a-68a6-41b3-8d4b-aee1255e9127-tmp\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.651780 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.651714 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9612719a-68a6-41b3-8d4b-aee1255e9127-etc-tuned\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.659037 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.659017 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98gk8\" (UniqueName: \"kubernetes.io/projected/95ac59e6-67c8-4d98-96a1-1c51db82cf3f-kube-api-access-98gk8\") pod \"node-resolver-vf6rv\" (UID: \"95ac59e6-67c8-4d98-96a1-1c51db82cf3f\") " pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.659124 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.659051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4srl\" (UniqueName: \"kubernetes.io/projected/9612719a-68a6-41b3-8d4b-aee1255e9127-kube-api-access-s4srl\") pod \"tuned-lwvwc\" (UID: \"9612719a-68a6-41b3-8d4b-aee1255e9127\") " pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.749727 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-ovnkube-config\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.749727 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749718 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tdrj\" (UniqueName: \"kubernetes.io/projected/b1682aa2-dba0-4750-a417-fc1242edec08-kube-api-access-8tdrj\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749786 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749807 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-etc-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-cni-bin\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-env-overrides\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-iptables-alerter-script\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749905 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frhcw\" (UniqueName: \"kubernetes.io/projected/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-kube-api-access-frhcw\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749912 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-var-lib-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749965 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.749979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-ovn\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750027 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-system-cni-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750051 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-hostroot\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.749902 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-etc-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhlr9\" (UniqueName: \"kubernetes.io/projected/b42039fd-c943-44c3-a5bd-c795168f76e0-kube-api-access-lhlr9\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750112 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-ovn\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750151 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-kubelet\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750153 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750210 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-cni-bin\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750209 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-system-cni-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750229 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-multus-certs\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750240 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-hostroot\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750262 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-var-lib-openvswitch\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/10be061c-3b18-4684-bfe1-82c7766627b5-konnectivity-ca\") pod \"konnectivity-agent-84rs8\" (UID: \"10be061c-3b18-4684-bfe1-82c7766627b5\") " pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750291 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-kubelet\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-systemd-units\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-run-netns\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.750394 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-multus-certs\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750346 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-env-overrides\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-ovnkube-script-lib\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750384 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-systemd-units\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750387 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cnibin\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750409 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-ovnkube-config\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750431 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cnibin\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l2wp\" (UniqueName: \"kubernetes.io/projected/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-kube-api-access-2l2wp\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750479 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-run-netns\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-cni-multus\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750538 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/10be061c-3b18-4684-bfe1-82c7766627b5-agent-certs\") pod \"konnectivity-agent-84rs8\" (UID: \"10be061c-3b18-4684-bfe1-82c7766627b5\") " pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750558 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-iptables-alerter-script\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750657 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-run-ovn-kubernetes\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750665 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-cni-multus\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b42039fd-c943-44c3-a5bd-c795168f76e0-host\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-etc-selinux\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.751278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750754 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-run-ovn-kubernetes\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750782 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b42039fd-c943-44c3-a5bd-c795168f76e0-host\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750841 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-etc-selinux\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750878 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-device-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnpn2\" (UniqueName: \"kubernetes.io/projected/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-kube-api-access-fnpn2\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750937 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/10be061c-3b18-4684-bfe1-82c7766627b5-konnectivity-ca\") pod \"konnectivity-agent-84rs8\" (UID: \"10be061c-3b18-4684-bfe1-82c7766627b5\") " pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6277c056-1e8b-4601-8715-9a8860e666c5-kubelet-config\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8qnp\" (UniqueName: \"kubernetes.io/projected/dd1fefaf-9f67-46b6-875e-1546a1a24a92-kube-api-access-p8qnp\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-os-release\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751025 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6277c056-1e8b-4601-8715-9a8860e666c5-kubelet-config\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751039 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-os-release\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751072 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cni-binary-copy\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751065 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6277c056-1e8b-4601-8715-9a8860e666c5-dbus\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446x4\" (UniqueName: \"kubernetes.io/projected/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-kube-api-access-446x4\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-os-release\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751147 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-sys-fs\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.752079 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.750984 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-device-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751178 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-cni-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6277c056-1e8b-4601-8715-9a8860e666c5-dbus\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751287 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-cni-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751307 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-sys-fs\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751338 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b1682aa2-dba0-4750-a417-fc1242edec08-ovnkube-script-lib\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751146 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-os-release\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-systemd\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751454 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-run-systemd\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751469 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-cni-netd\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751497 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-k8s-cni-cncf-io\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751516 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-cni-netd\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-cni-bin\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751577 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751582 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-k8s-cni-cncf-io\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751582 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-var-lib-cni-bin\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-socket-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.751668 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:29.752922 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751698 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-socket-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751716 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.751751 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs podName:fd1b5d06-7c5e-4573-ab93-793c9895ebfd nodeName:}" failed. No retries permitted until 2026-07-06 15:25:30.251718502 +0000 UTC m=+2.040787507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs") pod "network-metrics-daemon-bchrm" (UID: "fd1b5d06-7c5e-4573-ab93-793c9895ebfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-cni-binary-copy\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751796 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-conf-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751830 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-conf-dir\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751829 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b42039fd-c943-44c3-a5bd-c795168f76e0-serviceca\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751881 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-slash\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751906 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-host-slash\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751930 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-socket-dir-parent\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751956 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-kubelet\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-slash\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751981 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-node-log\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.751994 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-host-slash\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1682aa2-dba0-4750-a417-fc1242edec08-ovn-node-metrics-cert\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752023 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-socket-dir-parent\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.753811 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-cnibin\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752109 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-daemon-config\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752140 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-node-log\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-log-socket\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752180 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752362 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-netns\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-registration-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752197 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-cnibin\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752228 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752431 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-host-run-netns\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.752267 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752490 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/dd1fefaf-9f67-46b6-875e-1546a1a24a92-registration-dir\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752051 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-host-kubelet\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.752503 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret podName:6277c056-1e8b-4601-8715-9a8860e666c5 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:30.252484361 +0000 UTC m=+2.041553362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret") pod "global-pull-secret-syncer-kp5vs" (UID: "6277c056-1e8b-4601-8715-9a8860e666c5") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752491 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-system-cni-dir\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.754639 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752255 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b42039fd-c943-44c3-a5bd-c795168f76e0-serviceca\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752261 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b1682aa2-dba0-4750-a417-fc1242edec08-log-socket\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-system-cni-dir\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752567 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752603 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-etc-kubernetes\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.752572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-etc-kubernetes\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.753331 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-multus-daemon-config\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.753535 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-cni-binary-copy\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.753765 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/10be061c-3b18-4684-bfe1-82c7766627b5-agent-certs\") pod \"konnectivity-agent-84rs8\" (UID: \"10be061c-3b18-4684-bfe1-82c7766627b5\") " pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:29.755405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.754940 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b1682aa2-dba0-4750-a417-fc1242edec08-ovn-node-metrics-cert\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.766236 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.766209 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:29.766236 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.766238 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:29.766407 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.766253 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zwkmc for pod openshift-network-diagnostics/network-check-target-vmft6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:29.766407 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:29.766326 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc podName:c46556ec-7f1b-4a8e-839a-73de8b27c336 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:30.266306903 +0000 UTC m=+2.055375894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zwkmc" (UniqueName: "kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc") pod "network-check-target-vmft6" (UID: "c46556ec-7f1b-4a8e-839a-73de8b27c336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:29.766537 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.766487 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhlr9\" (UniqueName: \"kubernetes.io/projected/b42039fd-c943-44c3-a5bd-c795168f76e0-kube-api-access-lhlr9\") pod \"node-ca-jz4xk\" (UID: \"b42039fd-c943-44c3-a5bd-c795168f76e0\") " pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.766594 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.766505 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-frhcw\" (UniqueName: \"kubernetes.io/projected/a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e-kube-api-access-frhcw\") pod \"iptables-alerter-ml6wb\" (UID: \"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e\") " pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.766906 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.766875 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l2wp\" (UniqueName: \"kubernetes.io/projected/76784ea9-d8df-41ff-b9c7-dfff7084ec6c-kube-api-access-2l2wp\") pod \"multus-additional-cni-plugins-fc89x\" (UID: \"76784ea9-d8df-41ff-b9c7-dfff7084ec6c\") " pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.767024 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.767002 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-446x4\" (UniqueName: \"kubernetes.io/projected/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-kube-api-access-446x4\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:29.768273 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.768254 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tdrj\" (UniqueName: \"kubernetes.io/projected/b1682aa2-dba0-4750-a417-fc1242edec08-kube-api-access-8tdrj\") pod \"ovnkube-node-7szf4\" (UID: \"b1682aa2-dba0-4750-a417-fc1242edec08\") " pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.768667 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.768646 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnpn2\" (UniqueName: \"kubernetes.io/projected/d22ebd99-bbd6-4b5c-9372-134d3299e2f5-kube-api-access-fnpn2\") pod \"multus-mm4b4\" (UID: \"d22ebd99-bbd6-4b5c-9372-134d3299e2f5\") " pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.768742 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.768685 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8qnp\" (UniqueName: \"kubernetes.io/projected/dd1fefaf-9f67-46b6-875e-1546a1a24a92-kube-api-access-p8qnp\") pod \"aws-ebs-csi-driver-node-4wt25\" (UID: \"dd1fefaf-9f67-46b6-875e-1546a1a24a92\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.781264 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.781240 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod683549c5cb15901e8f0af8813277f06a.slice/crio-a241fb657472d51f97332897bffc5e8d135862a695a8ffd15f8d4dfcd246d2a9 WatchSource:0}: Error finding container a241fb657472d51f97332897bffc5e8d135862a695a8ffd15f8d4dfcd246d2a9: Status 404 returned error can't find the container with id a241fb657472d51f97332897bffc5e8d135862a695a8ffd15f8d4dfcd246d2a9 Jul 06 15:25:29.781504 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.781491 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd32b06a52fe2c12e89c7b42a8cc8f0b1.slice/crio-ed3477a280aedff89ca79063cda9d8cb5703045226a8587c9f6640cdaceddca3 WatchSource:0}: Error finding container ed3477a280aedff89ca79063cda9d8cb5703045226a8587c9f6640cdaceddca3: Status 404 returned error can't find the container with id ed3477a280aedff89ca79063cda9d8cb5703045226a8587c9f6640cdaceddca3 Jul 06 15:25:29.786539 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.786523 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:25:29.873769 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.873709 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" Jul 06 15:25:29.880547 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.880528 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vf6rv" Jul 06 15:25:29.881705 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.881685 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9612719a_68a6_41b3_8d4b_aee1255e9127.slice/crio-ee0b24246401a9ca1336519c04c2a74f6983d5ef43fc44e5e36e4f514c41a96c WatchSource:0}: Error finding container ee0b24246401a9ca1336519c04c2a74f6983d5ef43fc44e5e36e4f514c41a96c: Status 404 returned error can't find the container with id ee0b24246401a9ca1336519c04c2a74f6983d5ef43fc44e5e36e4f514c41a96c Jul 06 15:25:29.887672 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.887651 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95ac59e6_67c8_4d98_96a1_1c51db82cf3f.slice/crio-42d10b86289798aafe6f4091c9ccd262508b3454fbb940ad2a6ad6d887aec5e6 WatchSource:0}: Error finding container 42d10b86289798aafe6f4091c9ccd262508b3454fbb940ad2a6ad6d887aec5e6: Status 404 returned error can't find the container with id 42d10b86289798aafe6f4091c9ccd262508b3454fbb940ad2a6ad6d887aec5e6 Jul 06 15:25:29.897392 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.897374 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:29.900412 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.900394 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" Jul 06 15:25:29.906276 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.906255 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1682aa2_dba0_4750_a417_fc1242edec08.slice/crio-345fd59679d0f4a6907a5b53d1be0414cf460b43a057ecd60d8ad496f4084e57 WatchSource:0}: Error finding container 345fd59679d0f4a6907a5b53d1be0414cf460b43a057ecd60d8ad496f4084e57: Status 404 returned error can't find the container with id 345fd59679d0f4a6907a5b53d1be0414cf460b43a057ecd60d8ad496f4084e57 Jul 06 15:25:29.909928 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.909911 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd1fefaf_9f67_46b6_875e_1546a1a24a92.slice/crio-5957c00534be8acbf91ce46086d1a37abdf38c6c6f9b8bfc2cf9f2b718300f6f WatchSource:0}: Error finding container 5957c00534be8acbf91ce46086d1a37abdf38c6c6f9b8bfc2cf9f2b718300f6f: Status 404 returned error can't find the container with id 5957c00534be8acbf91ce46086d1a37abdf38c6c6f9b8bfc2cf9f2b718300f6f Jul 06 15:25:29.915678 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.915650 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fc89x" Jul 06 15:25:29.923752 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.923730 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76784ea9_d8df_41ff_b9c7_dfff7084ec6c.slice/crio-a72668f2d36e18ef603b1ee57efd9eaf5193aa52098557acb2d5e889f08c6509 WatchSource:0}: Error finding container a72668f2d36e18ef603b1ee57efd9eaf5193aa52098557acb2d5e889f08c6509: Status 404 returned error can't find the container with id a72668f2d36e18ef603b1ee57efd9eaf5193aa52098557acb2d5e889f08c6509 Jul 06 15:25:29.943378 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.943361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mm4b4" Jul 06 15:25:29.950344 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.950326 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd22ebd99_bbd6_4b5c_9372_134d3299e2f5.slice/crio-8f6a3c6ce8a44f38b26e6bfe37e8ec1816e8f4827fc836a490f918d6b60b6936 WatchSource:0}: Error finding container 8f6a3c6ce8a44f38b26e6bfe37e8ec1816e8f4827fc836a490f918d6b60b6936: Status 404 returned error can't find the container with id 8f6a3c6ce8a44f38b26e6bfe37e8ec1816e8f4827fc836a490f918d6b60b6936 Jul 06 15:25:29.960690 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.960669 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ml6wb" Jul 06 15:25:29.967796 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.967779 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda342dff9_7c98_4d9e_a5a0_f7a4ffbd0c5e.slice/crio-7f2f44e228992b33d6c42788d5530d83ef7a123cab5e63a3825f865d01babf69 WatchSource:0}: Error finding container 7f2f44e228992b33d6c42788d5530d83ef7a123cab5e63a3825f865d01babf69: Status 404 returned error can't find the container with id 7f2f44e228992b33d6c42788d5530d83ef7a123cab5e63a3825f865d01babf69 Jul 06 15:25:29.977539 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.977523 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:29.982727 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:29.982699 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jz4xk" Jul 06 15:25:29.988341 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.988318 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10be061c_3b18_4684_bfe1_82c7766627b5.slice/crio-7e779b27f65674c93e2f31c484c3909f210f3bc5f2689aaa7540648e9f621549 WatchSource:0}: Error finding container 7e779b27f65674c93e2f31c484c3909f210f3bc5f2689aaa7540648e9f621549: Status 404 returned error can't find the container with id 7e779b27f65674c93e2f31c484c3909f210f3bc5f2689aaa7540648e9f621549 Jul 06 15:25:29.990399 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:25:29.990383 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb42039fd_c943_44c3_a5bd_c795168f76e0.slice/crio-5e88d38ba4b6f054c293b6d270811d4647f11d2215ec45dab4b1fcb45543c86c WatchSource:0}: Error finding container 5e88d38ba4b6f054c293b6d270811d4647f11d2215ec45dab4b1fcb45543c86c: Status 404 returned error can't find the container with id 5e88d38ba4b6f054c293b6d270811d4647f11d2215ec45dab4b1fcb45543c86c Jul 06 15:25:30.056631 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.056605 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:30.256207 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.256127 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:30.256207 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.256175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:30.256406 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.256297 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:30.256406 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.256321 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:30.256406 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.256360 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret podName:6277c056-1e8b-4601-8715-9a8860e666c5 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:31.256340351 +0000 UTC m=+3.045409340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret") pod "global-pull-secret-syncer-kp5vs" (UID: "6277c056-1e8b-4601-8715-9a8860e666c5") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:30.256406 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.256381 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs podName:fd1b5d06-7c5e-4573-ab93-793c9895ebfd nodeName:}" failed. No retries permitted until 2026-07-06 15:25:31.256371371 +0000 UTC m=+3.045440359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs") pod "network-metrics-daemon-bchrm" (UID: "fd1b5d06-7c5e-4573-ab93-793c9895ebfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:30.298181 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.298159 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:30.357395 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.357363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:30.357553 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.357490 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:30.357553 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.357513 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:30.357553 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.357536 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zwkmc for pod openshift-network-diagnostics/network-check-target-vmft6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:30.357763 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.357592 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc podName:c46556ec-7f1b-4a8e-839a-73de8b27c336 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:31.357573195 +0000 UTC m=+3.146642185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwkmc" (UniqueName: "kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc") pod "network-check-target-vmft6" (UID: "c46556ec-7f1b-4a8e-839a-73de8b27c336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:30.611827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.611698 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:20:30 +0000 UTC" deadline="2028-04-15 03:45:53.090980524 +0000 UTC" Jul 06 15:25:30.611827 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.611729 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15564h20m22.479256072s" Jul 06 15:25:30.718813 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.718782 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:30.718980 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:30.718923 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:30.745701 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.745647 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jz4xk" event={"ID":"b42039fd-c943-44c3-a5bd-c795168f76e0","Type":"ContainerStarted","Data":"5e88d38ba4b6f054c293b6d270811d4647f11d2215ec45dab4b1fcb45543c86c"} Jul 06 15:25:30.766940 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.766909 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-84rs8" event={"ID":"10be061c-3b18-4684-bfe1-82c7766627b5","Type":"ContainerStarted","Data":"7e779b27f65674c93e2f31c484c3909f210f3bc5f2689aaa7540648e9f621549"} Jul 06 15:25:30.791289 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.791252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ml6wb" event={"ID":"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e","Type":"ContainerStarted","Data":"7f2f44e228992b33d6c42788d5530d83ef7a123cab5e63a3825f865d01babf69"} Jul 06 15:25:30.825252 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.825148 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mm4b4" event={"ID":"d22ebd99-bbd6-4b5c-9372-134d3299e2f5","Type":"ContainerStarted","Data":"8f6a3c6ce8a44f38b26e6bfe37e8ec1816e8f4827fc836a490f918d6b60b6936"} Jul 06 15:25:30.837213 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.836820 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fc89x" event={"ID":"76784ea9-d8df-41ff-b9c7-dfff7084ec6c","Type":"ContainerStarted","Data":"a72668f2d36e18ef603b1ee57efd9eaf5193aa52098557acb2d5e889f08c6509"} Jul 06 15:25:30.867961 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.867644 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"345fd59679d0f4a6907a5b53d1be0414cf460b43a057ecd60d8ad496f4084e57"} Jul 06 15:25:30.888003 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.887976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vf6rv" event={"ID":"95ac59e6-67c8-4d98-96a1-1c51db82cf3f","Type":"ContainerStarted","Data":"42d10b86289798aafe6f4091c9ccd262508b3454fbb940ad2a6ad6d887aec5e6"} Jul 06 15:25:30.918690 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.918531 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" event={"ID":"9612719a-68a6-41b3-8d4b-aee1255e9127","Type":"ContainerStarted","Data":"ee0b24246401a9ca1336519c04c2a74f6983d5ef43fc44e5e36e4f514c41a96c"} Jul 06 15:25:30.936211 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.936182 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" event={"ID":"dd1fefaf-9f67-46b6-875e-1546a1a24a92","Type":"ContainerStarted","Data":"5957c00534be8acbf91ce46086d1a37abdf38c6c6f9b8bfc2cf9f2b718300f6f"} Jul 06 15:25:30.949751 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.949725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"683549c5cb15901e8f0af8813277f06a","Type":"ContainerStarted","Data":"a241fb657472d51f97332897bffc5e8d135862a695a8ffd15f8d4dfcd246d2a9"} Jul 06 15:25:30.975580 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:30.975549 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" event={"ID":"d32b06a52fe2c12e89c7b42a8cc8f0b1","Type":"ContainerStarted","Data":"ed3477a280aedff89ca79063cda9d8cb5703045226a8587c9f6640cdaceddca3"} Jul 06 15:25:31.267529 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:31.267447 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:31.267529 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:31.267501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:31.267789 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.267646 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:31.267789 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.267708 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret podName:6277c056-1e8b-4601-8715-9a8860e666c5 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:33.267689573 +0000 UTC m=+5.056758574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret") pod "global-pull-secret-syncer-kp5vs" (UID: "6277c056-1e8b-4601-8715-9a8860e666c5") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:31.268265 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.268136 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:31.268265 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.268191 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs podName:fd1b5d06-7c5e-4573-ab93-793c9895ebfd nodeName:}" failed. No retries permitted until 2026-07-06 15:25:33.26817434 +0000 UTC m=+5.057243332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs") pod "network-metrics-daemon-bchrm" (UID: "fd1b5d06-7c5e-4573-ab93-793c9895ebfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:31.368907 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:31.368865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:31.369103 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.369085 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:31.369183 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.369106 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:31.369183 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.369120 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zwkmc for pod openshift-network-diagnostics/network-check-target-vmft6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:31.369280 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.369188 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc podName:c46556ec-7f1b-4a8e-839a-73de8b27c336 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:33.369166203 +0000 UTC m=+5.158235211 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwkmc" (UniqueName: "kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc") pod "network-check-target-vmft6" (UID: "c46556ec-7f1b-4a8e-839a-73de8b27c336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:31.612444 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:31.612327 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:20:30 +0000 UTC" deadline="2027-12-18 07:08:40.544294092 +0000 UTC" Jul 06 15:25:31.612444 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:31.612394 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12711h43m8.93190391s" Jul 06 15:25:31.718646 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:31.715664 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:31.718646 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.715813 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:31.718646 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:31.716227 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:31.718646 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:31.716346 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:32.093238 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:32.093117 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:32.718878 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:32.718334 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:32.718878 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:32.718484 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:33.285633 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:33.285596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:33.285824 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:33.285701 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:33.285902 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.285839 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:33.285954 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.285907 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs podName:fd1b5d06-7c5e-4573-ab93-793c9895ebfd nodeName:}" failed. No retries permitted until 2026-07-06 15:25:37.285885391 +0000 UTC m=+9.074954386 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs") pod "network-metrics-daemon-bchrm" (UID: "fd1b5d06-7c5e-4573-ab93-793c9895ebfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:33.286333 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.286315 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:33.286410 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.286367 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret podName:6277c056-1e8b-4601-8715-9a8860e666c5 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:37.286350698 +0000 UTC m=+9.075419700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret") pod "global-pull-secret-syncer-kp5vs" (UID: "6277c056-1e8b-4601-8715-9a8860e666c5") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:33.386292 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:33.386249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:33.386484 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.386430 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:33.386484 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.386448 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:33.386484 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.386462 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zwkmc for pod openshift-network-diagnostics/network-check-target-vmft6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:33.386685 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.386521 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc podName:c46556ec-7f1b-4a8e-839a-73de8b27c336 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:37.386501336 +0000 UTC m=+9.175570326 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwkmc" (UniqueName: "kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc") pod "network-check-target-vmft6" (UID: "c46556ec-7f1b-4a8e-839a-73de8b27c336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:33.715217 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:33.715136 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:33.715393 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.715295 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:33.715917 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:33.715707 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:33.715917 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:33.715816 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:34.718519 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:34.718313 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:34.718519 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:34.718446 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:35.716319 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:35.715587 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:35.716319 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:35.715749 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:35.716319 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:35.716177 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:35.716319 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:35.716268 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:36.715201 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:36.715162 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:36.715690 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:36.715400 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:37.318887 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:37.318848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:37.319095 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:37.318945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:37.319095 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.319072 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:37.319222 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.319129 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs podName:fd1b5d06-7c5e-4573-ab93-793c9895ebfd nodeName:}" failed. No retries permitted until 2026-07-06 15:25:45.319110226 +0000 UTC m=+17.108179217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs") pod "network-metrics-daemon-bchrm" (UID: "fd1b5d06-7c5e-4573-ab93-793c9895ebfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:37.319606 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.319517 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:37.319606 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.319574 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret podName:6277c056-1e8b-4601-8715-9a8860e666c5 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:45.31955739 +0000 UTC m=+17.108626379 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret") pod "global-pull-secret-syncer-kp5vs" (UID: "6277c056-1e8b-4601-8715-9a8860e666c5") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:37.419884 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:37.419846 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:37.420066 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.420000 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:37.420066 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.420019 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:37.420066 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.420030 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zwkmc for pod openshift-network-diagnostics/network-check-target-vmft6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:37.420276 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.420084 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc podName:c46556ec-7f1b-4a8e-839a-73de8b27c336 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:45.420070106 +0000 UTC m=+17.209139093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwkmc" (UniqueName: "kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc") pod "network-check-target-vmft6" (UID: "c46556ec-7f1b-4a8e-839a-73de8b27c336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:37.716480 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:37.715740 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:37.716480 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.715875 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:37.716480 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:37.716271 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:37.716480 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:37.716392 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:38.716757 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:38.716727 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:38.717194 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:38.716844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:39.716308 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:39.715968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:39.716308 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:39.716297 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:39.716554 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:39.716033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:39.716554 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:39.716400 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:40.715579 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:40.715532 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:40.716028 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:40.715673 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:41.714990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:41.714961 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:41.715152 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:41.714960 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:41.715152 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:41.715089 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:41.715286 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:41.715191 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:42.715222 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:42.715184 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:42.715693 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:42.715329 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:43.715229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:43.715194 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:43.715685 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:43.715314 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:43.715685 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:43.715360 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:43.715685 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:43.715495 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:44.715600 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:44.715567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:44.716048 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:44.715676 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:45.380428 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:45.380394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:45.380650 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:45.380442 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:45.380650 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.380584 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:45.380826 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.380660 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs podName:fd1b5d06-7c5e-4573-ab93-793c9895ebfd nodeName:}" failed. No retries permitted until 2026-07-06 15:26:01.380638889 +0000 UTC m=+33.169707874 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs") pod "network-metrics-daemon-bchrm" (UID: "fd1b5d06-7c5e-4573-ab93-793c9895ebfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:45.380826 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.380591 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:45.380826 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.380734 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret podName:6277c056-1e8b-4601-8715-9a8860e666c5 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:01.380719815 +0000 UTC m=+33.169788818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret") pod "global-pull-secret-syncer-kp5vs" (UID: "6277c056-1e8b-4601-8715-9a8860e666c5") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:45.481390 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:45.481357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:45.481525 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.481481 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:45.481525 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.481494 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:45.481525 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.481503 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zwkmc for pod openshift-network-diagnostics/network-check-target-vmft6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:45.481646 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.481563 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc podName:c46556ec-7f1b-4a8e-839a-73de8b27c336 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:01.481550629 +0000 UTC m=+33.270619626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwkmc" (UniqueName: "kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc") pod "network-check-target-vmft6" (UID: "c46556ec-7f1b-4a8e-839a-73de8b27c336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:45.715278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:45.715182 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:45.715278 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:45.715233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:45.715476 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.715320 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:45.715531 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:45.715479 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:46.715780 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:46.715748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:46.716270 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:46.715880 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:47.715188 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:47.715154 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:47.715373 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:47.715287 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:47.715373 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:47.715296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:47.715512 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:47.715382 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:48.716356 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:48.716323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:48.716849 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:48.716437 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:49.715718 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:49.715690 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:49.715718 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:49.715710 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:49.715953 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:49.715804 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:49.715953 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:49.715930 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:50.715973 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:50.715819 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:50.716519 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:50.716050 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:51.037184 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.037154 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mm4b4" event={"ID":"d22ebd99-bbd6-4b5c-9372-134d3299e2f5","Type":"ContainerStarted","Data":"32c0148e20c38fa1eb9029b00dcd1b5bf20b969cee6ff0863324082197b6590d"} Jul 06 15:25:51.039957 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.039934 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:25:51.040289 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.040269 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1682aa2-dba0-4750-a417-fc1242edec08" containerID="59f25b2a93de341e7a1b22dd69a288b3bbfd25dfbbd078d10297587c32283cda" exitCode=1 Jul 06 15:25:51.040356 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.040331 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"d5c64d9d3cfb3c1bfa812bd3a41f3eda73c2fe3fdfb5896ba3d78606e672ed63"} Jul 06 15:25:51.040420 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.040398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"cb19a34f7ca46604ac881b0f0e419924f6626d9f7c75c707c9ec0f809b77a725"} Jul 06 15:25:51.040516 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.040455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"97cffd13ec12d44aabfbfabd71b4a7db81f78e62cbe2362a3fc545d135c2ba42"} Jul 06 15:25:51.040516 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.040502 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"ff8462ebb394c9d68cdb8c774ae398a9bc02a4f453c08c194561e2b9e3039877"} Jul 06 15:25:51.040675 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.040580 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerDied","Data":"59f25b2a93de341e7a1b22dd69a288b3bbfd25dfbbd078d10297587c32283cda"} Jul 06 15:25:51.040675 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.040624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"6a56bf28b174064ec0219d9cb182b48ce2e93bb6c2dbbfc74e5630c34d4772ca"} Jul 06 15:25:51.042323 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.042300 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" event={"ID":"9612719a-68a6-41b3-8d4b-aee1255e9127","Type":"ContainerStarted","Data":"0aff5a560102c08728aeb7decc4a6688a1fb987a503bc7aef3e396cf123946c2"} Jul 06 15:25:51.046099 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.046068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" event={"ID":"d32b06a52fe2c12e89c7b42a8cc8f0b1","Type":"ContainerStarted","Data":"ab6e77aa478b50fe47d82fce932eeebd527fb7dd4a0c3524150c399435cde920"} Jul 06 15:25:51.059607 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.059558 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mm4b4" podStartSLOduration=1.7318825759999998 podStartE2EDuration="22.059521505s" totalImagesPullingTime="20.327638929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:51.058773696 +0000 UTC m=+22.847842703" watchObservedRunningTime="2026-07-06 15:25:51.059521505 +0000 UTC m=+22.848590507" Jul 06 15:25:51.102676 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.102617 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lwvwc" podStartSLOduration=2.09358231 podStartE2EDuration="22.102596249s" totalImagesPullingTime="20.009013939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:51.102061301 +0000 UTC m=+22.891130299" watchObservedRunningTime="2026-07-06 15:25:51.102596249 +0000 UTC m=+22.891665257" Jul 06 15:25:51.125337 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.125246 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" podStartSLOduration=21.125227955 podStartE2EDuration="21.125227955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:51.122342471 +0000 UTC m=+22.911411490" watchObservedRunningTime="2026-07-06 15:25:51.125227955 +0000 UTC m=+22.914296965" Jul 06 15:25:51.715703 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.715444 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:51.715843 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:51.715490 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:51.715843 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:51.715733 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:51.715843 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:51.715784 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:52.049959 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.049768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vf6rv" event={"ID":"95ac59e6-67c8-4d98-96a1-1c51db82cf3f","Type":"ContainerStarted","Data":"74225b742e41f0479362a08970c1341a142fc5ae45c21c2f3d55ed9665e536dc"} Jul 06 15:25:52.051262 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.051244 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" event={"ID":"dd1fefaf-9f67-46b6-875e-1546a1a24a92","Type":"ContainerStarted","Data":"33e23c599dbfc2a5a568e5b35220df2a53b77c0b0285d7ed6f3f56097ba4b080"} Jul 06 15:25:52.052810 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.052787 2561 generic.go:356] "Generic (PLEG): container finished" podID="683549c5cb15901e8f0af8813277f06a" containerID="d72a68c773061c6b1623903cde61c7f0b377d704b5610e53091bd6b4b58d30ae" exitCode=0 Jul 06 15:25:52.052941 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.052864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"683549c5cb15901e8f0af8813277f06a","Type":"ContainerDied","Data":"d72a68c773061c6b1623903cde61c7f0b377d704b5610e53091bd6b4b58d30ae"} Jul 06 15:25:52.054318 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.054296 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jz4xk" event={"ID":"b42039fd-c943-44c3-a5bd-c795168f76e0","Type":"ContainerStarted","Data":"52d0e84fba0a264cfa34d404ba41b206323613acabd83a88fbef3e0d3c608b9d"} Jul 06 15:25:52.055742 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.055722 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-84rs8" event={"ID":"10be061c-3b18-4684-bfe1-82c7766627b5","Type":"ContainerStarted","Data":"c71e4b10e3252abf65572db7c86a9aa6d2cfbec930356e7aa918c7a4f4aa14c8"} Jul 06 15:25:52.056909 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.056889 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ml6wb" event={"ID":"a342dff9-7c98-4d9e-a5a0-f7a4ffbd0c5e","Type":"ContainerStarted","Data":"e6a509034326c81fd1edb4144c4398c74cca65fb451b4767c6d0ce581ba9f537"} Jul 06 15:25:52.058186 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.058168 2561 generic.go:356] "Generic (PLEG): container finished" podID="76784ea9-d8df-41ff-b9c7-dfff7084ec6c" containerID="68309ab757f20d34c67947eb8e81dad82244404b2f4df1292064db799c8cae3c" exitCode=0 Jul 06 15:25:52.058287 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.058267 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fc89x" event={"ID":"76784ea9-d8df-41ff-b9c7-dfff7084ec6c","Type":"ContainerDied","Data":"68309ab757f20d34c67947eb8e81dad82244404b2f4df1292064db799c8cae3c"} Jul 06 15:25:52.093309 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.093153 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vf6rv" podStartSLOduration=7.487985558 podStartE2EDuration="23.093135725s" totalImagesPullingTime="15.605150167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:52.06824807 +0000 UTC m=+23.857317076" watchObservedRunningTime="2026-07-06 15:25:52.093135725 +0000 UTC m=+23.882204733" Jul 06 15:25:52.108792 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.108754 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-84rs8" podStartSLOduration=3.334656189 podStartE2EDuration="23.108740495s" totalImagesPullingTime="19.774084306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:52.10869104 +0000 UTC m=+23.897760048" watchObservedRunningTime="2026-07-06 15:25:52.108740495 +0000 UTC m=+23.897809503" Jul 06 15:25:52.140469 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.140434 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ml6wb" podStartSLOduration=3.218303991 podStartE2EDuration="23.140421861s" totalImagesPullingTime="19.92211787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:52.140305476 +0000 UTC m=+23.929374483" watchObservedRunningTime="2026-07-06 15:25:52.140421861 +0000 UTC m=+23.929490889" Jul 06 15:25:52.158919 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.158882 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jz4xk" podStartSLOduration=3.270212798 podStartE2EDuration="23.158868135s" totalImagesPullingTime="19.888655337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:52.158338487 +0000 UTC m=+23.947407501" watchObservedRunningTime="2026-07-06 15:25:52.158868135 +0000 UTC m=+23.947937142" Jul 06 15:25:52.231376 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.231341 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:52.231981 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.231964 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:52.715723 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.715648 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:52.715894 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:52.715780 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:52.793518 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:52.793376 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 15:25:53.063951 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.063475 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:25:53.066355 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.066313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"d082142cd724b31b9a12a4366a23a258edd66b74a60c85e7351933d2f0a91eff"} Jul 06 15:25:53.067991 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.067970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" event={"ID":"dd1fefaf-9f67-46b6-875e-1546a1a24a92","Type":"ContainerStarted","Data":"b3eebe6ea5f60ab0a5110e7af6bb0f9bd90a8c636ce09f1065b60c81d54f0389"} Jul 06 15:25:53.069704 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.069678 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"683549c5cb15901e8f0af8813277f06a","Type":"ContainerStarted","Data":"dd3c19840234d0760db976d28449c11b474696a85b5a1ba65eeb1aa7888f5f77"} Jul 06 15:25:53.069944 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.069915 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:53.070441 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.070426 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-84rs8" Jul 06 15:25:53.088528 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.088492 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" podStartSLOduration=23.088481844 podStartE2EDuration="23.088481844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:53.08826412 +0000 UTC m=+24.877333127" watchObservedRunningTime="2026-07-06 15:25:53.088481844 +0000 UTC m=+24.877550851" Jul 06 15:25:53.610684 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.610570 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T15:25:52.793389443Z","UUID":"7fb34b00-9334-4721-8db1-6fe5cbf9b1e3","Handler":null,"Name":"","Endpoint":""} Jul 06 15:25:53.612584 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.612561 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 15:25:53.612740 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.612605 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 15:25:53.715947 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.715916 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:53.716083 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:53.716032 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:53.716188 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:53.716089 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:53.716188 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:53.716173 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:54.715668 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:54.715641 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:54.716033 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:54.715736 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:55.077325 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.077185 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:25:55.077750 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.077729 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"c8b863c9ab3449b191587ee6e232e8ee64a99513e3d00485785ca04236b44640"} Jul 06 15:25:55.077970 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.077955 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:55.078203 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.078183 2561 scope.go:117] "RemoveContainer" containerID="59f25b2a93de341e7a1b22dd69a288b3bbfd25dfbbd078d10297587c32283cda" Jul 06 15:25:55.079915 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.079892 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" event={"ID":"dd1fefaf-9f67-46b6-875e-1546a1a24a92","Type":"ContainerStarted","Data":"37912db3cdbaf232f3c85e1e2eb27b83063a87b4d5db772ca878c4929c9ac362"} Jul 06 15:25:55.093748 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.093727 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:55.155348 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.155312 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4wt25" podStartSLOduration=3.511238532 podStartE2EDuration="26.155297727s" totalImagesPullingTime="22.644059195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:55.154666512 +0000 UTC m=+26.943735518" watchObservedRunningTime="2026-07-06 15:25:55.155297727 +0000 UTC m=+26.944366734" Jul 06 15:25:55.715484 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.715458 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:55.715484 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:55.715491 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:55.715685 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:55.715581 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:55.716152 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:55.715699 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:56.089935 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.089850 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:25:56.090397 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.090321 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" event={"ID":"b1682aa2-dba0-4750-a417-fc1242edec08","Type":"ContainerStarted","Data":"907443edc7c77f25d171996987429289bc481fd56d0b1219696d671604087943"} Jul 06 15:25:56.090704 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.090680 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:56.090859 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.090756 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:56.113997 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.113901 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:25:56.121669 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.121618 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" podStartSLOduration=7.097479373 podStartE2EDuration="27.121602638s" totalImagesPullingTime="20.024123265s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:25:56.121463741 +0000 UTC m=+27.910532752" watchObservedRunningTime="2026-07-06 15:25:56.121602638 +0000 UTC m=+27.910671644" Jul 06 15:25:56.715777 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.715602 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:56.716192 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:56.715898 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:56.877915 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.877397 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vmft6"] Jul 06 15:25:56.877915 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.877582 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:56.877915 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:56.877714 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:56.878239 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.878214 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kp5vs"] Jul 06 15:25:56.879821 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.879396 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bchrm"] Jul 06 15:25:56.879821 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:56.879516 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:56.879821 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:56.879666 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:57.092909 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:57.092806 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:57.093068 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:57.092910 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:58.716390 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:58.716361 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:25:58.716846 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:58.716430 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:25:58.716846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:58.716510 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:25:58.716846 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:58.716618 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:25:58.716846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:58.716653 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:25:58.716846 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:25:58.716725 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:25:59.098730 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:59.098701 2561 generic.go:356] "Generic (PLEG): container finished" podID="76784ea9-d8df-41ff-b9c7-dfff7084ec6c" containerID="e1b75e702f0e29ff7dc32297910cb952404447a85b5113fad6fe82b352fdc818" exitCode=0 Jul 06 15:25:59.098833 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:25:59.098740 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fc89x" event={"ID":"76784ea9-d8df-41ff-b9c7-dfff7084ec6c","Type":"ContainerDied","Data":"e1b75e702f0e29ff7dc32297910cb952404447a85b5113fad6fe82b352fdc818"} Jul 06 15:26:00.103250 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:00.103165 2561 generic.go:356] "Generic (PLEG): container finished" podID="76784ea9-d8df-41ff-b9c7-dfff7084ec6c" containerID="e0907fd83fd1f1cb4f8a51b8a98bf7f274c814ab183494c7b19c3e5c9a3cb79b" exitCode=0 Jul 06 15:26:00.103250 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:00.103224 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fc89x" event={"ID":"76784ea9-d8df-41ff-b9c7-dfff7084ec6c","Type":"ContainerDied","Data":"e0907fd83fd1f1cb4f8a51b8a98bf7f274c814ab183494c7b19c3e5c9a3cb79b"} Jul 06 15:26:00.715190 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:00.715161 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:26:00.715361 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:00.715161 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:26:00.715361 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:00.715267 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:26:00.715361 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:00.715281 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:26:00.715482 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:00.715359 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:26:00.715482 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:00.715420 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:26:01.107373 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:01.107290 2561 generic.go:356] "Generic (PLEG): container finished" podID="76784ea9-d8df-41ff-b9c7-dfff7084ec6c" containerID="8df386dcb1eff67d4f0ce04ae9c8e74ddece6115650561b01cbaf4adfc3704bd" exitCode=0 Jul 06 15:26:01.107373 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:01.107348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fc89x" event={"ID":"76784ea9-d8df-41ff-b9c7-dfff7084ec6c","Type":"ContainerDied","Data":"8df386dcb1eff67d4f0ce04ae9c8e74ddece6115650561b01cbaf4adfc3704bd"} Jul 06 15:26:01.406338 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:01.406275 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:26:01.406338 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:01.406309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:26:01.406480 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:01.406383 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:26:01.406480 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:01.406404 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:26:01.406480 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:01.406437 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret podName:6277c056-1e8b-4601-8715-9a8860e666c5 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:33.406413336 +0000 UTC m=+65.195482326 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret") pod "global-pull-secret-syncer-kp5vs" (UID: "6277c056-1e8b-4601-8715-9a8860e666c5") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:26:01.406480 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:01.406454 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs podName:fd1b5d06-7c5e-4573-ab93-793c9895ebfd nodeName:}" failed. No retries permitted until 2026-07-06 15:26:33.40644197 +0000 UTC m=+65.195510956 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs") pod "network-metrics-daemon-bchrm" (UID: "fd1b5d06-7c5e-4573-ab93-793c9895ebfd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:26:01.507172 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:01.507148 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:26:01.507273 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:01.507250 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:26:01.507273 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:01.507262 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:26:01.507273 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:01.507270 2561 projected.go:196] Error preparing data for projected volume kube-api-access-zwkmc for pod openshift-network-diagnostics/network-check-target-vmft6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:26:01.507373 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:01.507311 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc podName:c46556ec-7f1b-4a8e-839a-73de8b27c336 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:33.507295062 +0000 UTC m=+65.296364049 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwkmc" (UniqueName: "kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc") pod "network-check-target-vmft6" (UID: "c46556ec-7f1b-4a8e-839a-73de8b27c336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:26:02.716121 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:02.715961 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:26:02.716511 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:02.715987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:26:02.716511 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:02.716207 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kp5vs" podUID="6277c056-1e8b-4601-8715-9a8860e666c5" Jul 06 15:26:02.716511 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:02.715987 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:26:02.716511 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:02.716296 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmft6" podUID="c46556ec-7f1b-4a8e-839a-73de8b27c336" Jul 06 15:26:02.716511 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:02.716421 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bchrm" podUID="fd1b5d06-7c5e-4573-ab93-793c9895ebfd" Jul 06 15:26:02.973325 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:02.973258 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeReady" Jul 06 15:26:02.973477 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:02.973463 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 15:26:03.026206 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.026174 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n5dst"] Jul 06 15:26:03.028100 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.028081 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l5ns2"] Jul 06 15:26:03.028215 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.028198 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.029713 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.029694 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l5ns2" Jul 06 15:26:03.030217 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.030191 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wcqjf\"" Jul 06 15:26:03.030314 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.030228 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 15:26:03.030314 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.030256 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 15:26:03.031594 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.031573 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 15:26:03.031704 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.031687 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hzlr8\"" Jul 06 15:26:03.031792 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.031773 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 15:26:03.031906 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.031890 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 15:26:03.040185 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.040141 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l5ns2"] Jul 06 15:26:03.043053 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.042992 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n5dst"] Jul 06 15:26:03.118956 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.118927 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.119090 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.118966 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db5f3cb-d772-4494-be17-f43fc1935a49-tmp-dir\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.119090 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.118989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6hwq\" (UniqueName: \"kubernetes.io/projected/0db5f3cb-d772-4494-be17-f43fc1935a49-kube-api-access-x6hwq\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.119090 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.119011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aea71b93-7d9c-4e69-8bd2-433234c6bcb0-cert\") pod \"ingress-canary-l5ns2\" (UID: \"aea71b93-7d9c-4e69-8bd2-433234c6bcb0\") " pod="openshift-ingress-canary/ingress-canary-l5ns2" Jul 06 15:26:03.119090 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.119031 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl4zt\" (UniqueName: \"kubernetes.io/projected/aea71b93-7d9c-4e69-8bd2-433234c6bcb0-kube-api-access-tl4zt\") pod \"ingress-canary-l5ns2\" (UID: \"aea71b93-7d9c-4e69-8bd2-433234c6bcb0\") " pod="openshift-ingress-canary/ingress-canary-l5ns2" Jul 06 15:26:03.119307 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.119166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db5f3cb-d772-4494-be17-f43fc1935a49-config-volume\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.220397 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.220363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.220603 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.220453 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db5f3cb-d772-4494-be17-f43fc1935a49-tmp-dir\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.220603 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.220505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6hwq\" (UniqueName: \"kubernetes.io/projected/0db5f3cb-d772-4494-be17-f43fc1935a49-kube-api-access-x6hwq\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.220603 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:03.220577 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:03.220766 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:03.220650 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls podName:0db5f3cb-d772-4494-be17-f43fc1935a49 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:03.720627592 +0000 UTC m=+35.509696583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls") pod "dns-default-n5dst" (UID: "0db5f3cb-d772-4494-be17-f43fc1935a49") : secret "dns-default-metrics-tls" not found Jul 06 15:26:03.220766 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.220584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aea71b93-7d9c-4e69-8bd2-433234c6bcb0-cert\") pod \"ingress-canary-l5ns2\" (UID: \"aea71b93-7d9c-4e69-8bd2-433234c6bcb0\") " pod="openshift-ingress-canary/ingress-canary-l5ns2" Jul 06 15:26:03.220766 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.220709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl4zt\" (UniqueName: \"kubernetes.io/projected/aea71b93-7d9c-4e69-8bd2-433234c6bcb0-kube-api-access-tl4zt\") pod \"ingress-canary-l5ns2\" (UID: \"aea71b93-7d9c-4e69-8bd2-433234c6bcb0\") " pod="openshift-ingress-canary/ingress-canary-l5ns2" Jul 06 15:26:03.220888 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.220801 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db5f3cb-d772-4494-be17-f43fc1935a49-config-volume\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.221206 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.221178 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0db5f3cb-d772-4494-be17-f43fc1935a49-tmp-dir\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.221396 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.221371 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0db5f3cb-d772-4494-be17-f43fc1935a49-config-volume\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.225721 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.225668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aea71b93-7d9c-4e69-8bd2-433234c6bcb0-cert\") pod \"ingress-canary-l5ns2\" (UID: \"aea71b93-7d9c-4e69-8bd2-433234c6bcb0\") " pod="openshift-ingress-canary/ingress-canary-l5ns2" Jul 06 15:26:03.233687 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.233651 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6hwq\" (UniqueName: \"kubernetes.io/projected/0db5f3cb-d772-4494-be17-f43fc1935a49-kube-api-access-x6hwq\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.233906 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.233889 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl4zt\" (UniqueName: \"kubernetes.io/projected/aea71b93-7d9c-4e69-8bd2-433234c6bcb0-kube-api-access-tl4zt\") pod \"ingress-canary-l5ns2\" (UID: \"aea71b93-7d9c-4e69-8bd2-433234c6bcb0\") " pod="openshift-ingress-canary/ingress-canary-l5ns2" Jul 06 15:26:03.347770 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.347737 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l5ns2" Jul 06 15:26:03.497117 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.497053 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l5ns2"] Jul 06 15:26:03.501624 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:26:03.501601 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea71b93_7d9c_4e69_8bd2_433234c6bcb0.slice/crio-f47198ee3e80c0fb0f7886d7633dce29031a9308b1100e8a45dfe07a18db3d9d WatchSource:0}: Error finding container f47198ee3e80c0fb0f7886d7633dce29031a9308b1100e8a45dfe07a18db3d9d: Status 404 returned error can't find the container with id f47198ee3e80c0fb0f7886d7633dce29031a9308b1100e8a45dfe07a18db3d9d Jul 06 15:26:03.725050 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:03.725013 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:03.725892 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:03.725197 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:03.725892 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:03.725264 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls podName:0db5f3cb-d772-4494-be17-f43fc1935a49 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:04.725244436 +0000 UTC m=+36.514313420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls") pod "dns-default-n5dst" (UID: "0db5f3cb-d772-4494-be17-f43fc1935a49") : secret "dns-default-metrics-tls" not found Jul 06 15:26:04.116112 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.116071 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l5ns2" event={"ID":"aea71b93-7d9c-4e69-8bd2-433234c6bcb0","Type":"ContainerStarted","Data":"f47198ee3e80c0fb0f7886d7633dce29031a9308b1100e8a45dfe07a18db3d9d"} Jul 06 15:26:04.715610 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.715577 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:26:04.715823 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.715623 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:26:04.715823 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.715577 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:26:04.717989 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.717928 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:26:04.717989 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.717963 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:26:04.718512 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.718493 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8gbcw\"" Jul 06 15:26:04.718643 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.718524 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:26:04.718643 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.718612 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:26:04.718763 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.718643 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lwgnr\"" Jul 06 15:26:04.733648 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:04.733623 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:04.734012 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:04.733781 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:04.734012 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:04.733846 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls podName:0db5f3cb-d772-4494-be17-f43fc1935a49 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:06.733827725 +0000 UTC m=+38.522896725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls") pod "dns-default-n5dst" (UID: "0db5f3cb-d772-4494-be17-f43fc1935a49") : secret "dns-default-metrics-tls" not found Jul 06 15:26:06.748127 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:06.747934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:06.748442 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:06.748071 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:06.748442 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:06.748256 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls podName:0db5f3cb-d772-4494-be17-f43fc1935a49 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:10.748237835 +0000 UTC m=+42.537306822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls") pod "dns-default-n5dst" (UID: "0db5f3cb-d772-4494-be17-f43fc1935a49") : secret "dns-default-metrics-tls" not found Jul 06 15:26:07.125625 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:07.125592 2561 generic.go:356] "Generic (PLEG): container finished" podID="76784ea9-d8df-41ff-b9c7-dfff7084ec6c" containerID="6251183e0fd05504d3d79fa337c8dcbae9c4546ab6400fd4e1f2f3cbd25c338c" exitCode=0 Jul 06 15:26:07.125825 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:07.125684 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fc89x" event={"ID":"76784ea9-d8df-41ff-b9c7-dfff7084ec6c","Type":"ContainerDied","Data":"6251183e0fd05504d3d79fa337c8dcbae9c4546ab6400fd4e1f2f3cbd25c338c"} Jul 06 15:26:07.127092 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:07.127069 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l5ns2" event={"ID":"aea71b93-7d9c-4e69-8bd2-433234c6bcb0","Type":"ContainerStarted","Data":"24d3fbf043d8ad6243fddf84aeb3f2040de840300c1630688fe2823b674a5ea0"} Jul 06 15:26:07.172902 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:07.172848 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l5ns2" podStartSLOduration=0.89963672 podStartE2EDuration="4.172824556s" totalImagesPullingTime="3.273187836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:07.17256732 +0000 UTC m=+38.961636322" watchObservedRunningTime="2026-07-06 15:26:07.172824556 +0000 UTC m=+38.961893564" Jul 06 15:26:08.132339 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:08.132301 2561 generic.go:356] "Generic (PLEG): container finished" podID="76784ea9-d8df-41ff-b9c7-dfff7084ec6c" containerID="db52849e1e89ab27a76c559ff75b1037acf23c326f3eb3b77dfde8d959fba679" exitCode=0 Jul 06 15:26:08.132853 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:08.132375 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fc89x" event={"ID":"76784ea9-d8df-41ff-b9c7-dfff7084ec6c","Type":"ContainerDied","Data":"db52849e1e89ab27a76c559ff75b1037acf23c326f3eb3b77dfde8d959fba679"} Jul 06 15:26:09.137820 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:09.137771 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fc89x" event={"ID":"76784ea9-d8df-41ff-b9c7-dfff7084ec6c","Type":"ContainerStarted","Data":"fa6bc6d38826f8fae454e422493577d9ab8ff404083af60933eed9310cae6757"} Jul 06 15:26:09.164240 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:09.164194 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fc89x" podStartSLOduration=7.156480627 podStartE2EDuration="40.164180798s" totalImagesPullingTime="33.007700171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:09.163769643 +0000 UTC m=+40.952838650" watchObservedRunningTime="2026-07-06 15:26:09.164180798 +0000 UTC m=+40.953249804" Jul 06 15:26:10.776429 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:10.776394 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:10.776894 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:10.776510 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:10.776894 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:10.776598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls podName:0db5f3cb-d772-4494-be17-f43fc1935a49 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:18.776575813 +0000 UTC m=+50.565644802 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls") pod "dns-default-n5dst" (UID: "0db5f3cb-d772-4494-be17-f43fc1935a49") : secret "dns-default-metrics-tls" not found Jul 06 15:26:18.832056 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:18.832020 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:18.832437 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:18.832159 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:18.832437 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:18.832229 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls podName:0db5f3cb-d772-4494-be17-f43fc1935a49 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:34.832212074 +0000 UTC m=+66.621281058 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls") pod "dns-default-n5dst" (UID: "0db5f3cb-d772-4494-be17-f43fc1935a49") : secret "dns-default-metrics-tls" not found Jul 06 15:26:28.105141 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:28.105112 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7szf4" Jul 06 15:26:33.429259 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.429209 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:26:33.429259 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.429267 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:26:33.431681 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.431661 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:26:33.431750 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.431715 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:26:33.440432 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:33.440408 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:26:33.440490 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:33.440478 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs podName:fd1b5d06-7c5e-4573-ab93-793c9895ebfd nodeName:}" failed. No retries permitted until 2026-07-06 15:27:37.440460156 +0000 UTC m=+129.229529146 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs") pod "network-metrics-daemon-bchrm" (UID: "fd1b5d06-7c5e-4573-ab93-793c9895ebfd") : secret "metrics-daemon-secret" not found Jul 06 15:26:33.443565 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.443528 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6277c056-1e8b-4601-8715-9a8860e666c5-original-pull-secret\") pod \"global-pull-secret-syncer-kp5vs\" (UID: \"6277c056-1e8b-4601-8715-9a8860e666c5\") " pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:26:33.530286 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.530262 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:26:33.532533 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.532517 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:26:33.536123 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.536108 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kp5vs" Jul 06 15:26:33.542957 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.542939 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:26:33.552892 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.552869 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwkmc\" (UniqueName: \"kubernetes.io/projected/c46556ec-7f1b-4a8e-839a-73de8b27c336-kube-api-access-zwkmc\") pod \"network-check-target-vmft6\" (UID: \"c46556ec-7f1b-4a8e-839a-73de8b27c336\") " pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:26:33.669985 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.669951 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kp5vs"] Jul 06 15:26:33.674375 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:26:33.674342 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6277c056_1e8b_4601_8715_9a8860e666c5.slice/crio-d1359e1f4d8f271888aa645e728126eec3fe07e3ac4cf2e638329b228900faaa WatchSource:0}: Error finding container d1359e1f4d8f271888aa645e728126eec3fe07e3ac4cf2e638329b228900faaa: Status 404 returned error can't find the container with id d1359e1f4d8f271888aa645e728126eec3fe07e3ac4cf2e638329b228900faaa Jul 06 15:26:33.845402 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.845381 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8gbcw\"" Jul 06 15:26:33.852965 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.852951 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:26:33.969404 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:33.969336 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vmft6"] Jul 06 15:26:33.973021 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:26:33.972997 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46556ec_7f1b_4a8e_839a_73de8b27c336.slice/crio-26118ff179a435f0189308fbe1447732e0d9c9046fed849e92d1a1eb01810183 WatchSource:0}: Error finding container 26118ff179a435f0189308fbe1447732e0d9c9046fed849e92d1a1eb01810183: Status 404 returned error can't find the container with id 26118ff179a435f0189308fbe1447732e0d9c9046fed849e92d1a1eb01810183 Jul 06 15:26:34.192869 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:34.192787 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vmft6" event={"ID":"c46556ec-7f1b-4a8e-839a-73de8b27c336","Type":"ContainerStarted","Data":"26118ff179a435f0189308fbe1447732e0d9c9046fed849e92d1a1eb01810183"} Jul 06 15:26:34.193749 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:34.193726 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kp5vs" event={"ID":"6277c056-1e8b-4601-8715-9a8860e666c5","Type":"ContainerStarted","Data":"d1359e1f4d8f271888aa645e728126eec3fe07e3ac4cf2e638329b228900faaa"} Jul 06 15:26:34.839677 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:34.839616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:26:34.840129 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:34.839745 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:34.840129 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:26:34.839818 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls podName:0db5f3cb-d772-4494-be17-f43fc1935a49 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:06.839797784 +0000 UTC m=+98.628866772 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls") pod "dns-default-n5dst" (UID: "0db5f3cb-d772-4494-be17-f43fc1935a49") : secret "dns-default-metrics-tls" not found Jul 06 15:26:39.208019 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:39.207978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vmft6" event={"ID":"c46556ec-7f1b-4a8e-839a-73de8b27c336","Type":"ContainerStarted","Data":"3d4352f26507f9a7597460246b18cd52de8165d458c8979d1774ce7732537056"} Jul 06 15:26:39.208468 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:39.208113 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:26:39.209647 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:39.209605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kp5vs" event={"ID":"6277c056-1e8b-4601-8715-9a8860e666c5","Type":"ContainerStarted","Data":"b5a2768995f1735d2ecf869d144a51df030b4835b6544f68a15f3e0f7b28d1ff"} Jul 06 15:26:39.227513 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:39.227473 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vmft6" podStartSLOduration=65.395058078 podStartE2EDuration="1m10.227460022s" totalImagesPullingTime="4.832401944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:39.22680688 +0000 UTC m=+71.015875890" watchObservedRunningTime="2026-07-06 15:26:39.227460022 +0000 UTC m=+71.016529026" Jul 06 15:26:39.243170 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:26:39.243132 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kp5vs" podStartSLOduration=65.108106801 podStartE2EDuration="1m10.24311994s" totalImagesPullingTime="5.135013139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:39.242103367 +0000 UTC m=+71.031172375" watchObservedRunningTime="2026-07-06 15:26:39.24311994 +0000 UTC m=+71.032188947" Jul 06 15:27:05.054775 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.054742 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f8b69dd9f-dsvfp"] Jul 06 15:27:05.057530 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.057512 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.059705 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.059673 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 15:27:05.059831 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.059746 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 15:27:05.059831 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.059826 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 15:27:05.060062 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.060042 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 15:27:05.060184 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.060168 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9hcx7\"" Jul 06 15:27:05.060283 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.060257 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 15:27:05.060283 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.060272 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 15:27:05.070823 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.070802 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f8b69dd9f-dsvfp"] Jul 06 15:27:05.143658 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.143635 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-default-certificate\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.143779 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.143664 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.143779 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.143685 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls4pl\" (UniqueName: \"kubernetes.io/projected/86af66de-2278-4ec5-9aee-4690e2b83310-kube-api-access-ls4pl\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.143779 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.143717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-stats-auth\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.143779 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.143734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.157730 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.157704 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p"] Jul 06 15:27:05.159484 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.159470 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.162374 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.162231 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 15:27:05.162525 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.162424 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:27:05.162525 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.162469 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 15:27:05.162813 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.162617 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nvtnf\"" Jul 06 15:27:05.162813 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.162742 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 15:27:05.163039 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.163020 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hh9xt"] Jul 06 15:27:05.164786 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.164771 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t"] Jul 06 15:27:05.164885 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.164872 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.166567 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.166487 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.167572 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.167556 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 06 15:27:05.168072 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.168057 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:27:05.168711 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.168697 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 06 15:27:05.169074 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.169060 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 06 15:27:05.169146 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.169108 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 15:27:05.169815 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.169798 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-k49j4\"" Jul 06 15:27:05.169927 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.169826 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8jpvs\"" Jul 06 15:27:05.170897 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.170878 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p"] Jul 06 15:27:05.171002 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.170964 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 15:27:05.171071 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.171028 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:27:05.171795 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.171771 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 15:27:05.176123 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.176103 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 06 15:27:05.180983 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.180963 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t"] Jul 06 15:27:05.186451 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.186431 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hh9xt"] Jul 06 15:27:05.244722 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.244695 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls4pl\" (UniqueName: \"kubernetes.io/projected/86af66de-2278-4ec5-9aee-4690e2b83310-kube-api-access-ls4pl\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.244823 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.244731 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63f36c0a-f49d-4774-97aa-2350a846ce5d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.244882 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.244848 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vf57\" (UniqueName: \"kubernetes.io/projected/3ec71521-02e1-4028-9c7e-5f6840c46af8-kube-api-access-7vf57\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.244936 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.244877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs6v6\" (UniqueName: \"kubernetes.io/projected/6e298480-975b-4afc-b9f4-d71876085a19-kube-api-access-xs6v6\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.244936 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.244900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ec71521-02e1-4028-9c7e-5f6840c46af8-serving-cert\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.245013 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.244963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ec71521-02e1-4028-9c7e-5f6840c46af8-config\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.245013 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-stats-auth\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.245102 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245020 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63f36c0a-f49d-4774-97aa-2350a846ce5d-config\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.245102 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245038 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.245102 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6hhr\" (UniqueName: \"kubernetes.io/projected/63f36c0a-f49d-4774-97aa-2350a846ce5d-kube-api-access-h6hhr\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.245102 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e298480-975b-4afc-b9f4-d71876085a19-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.245288 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:05.245168 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:05.745150524 +0000 UTC m=+97.534219530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:05.245288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-default-certificate\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.245288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.245288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e298480-975b-4afc-b9f4-d71876085a19-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.245288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.245253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec71521-02e1-4028-9c7e-5f6840c46af8-trusted-ca\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.245288 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:05.245284 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:05.245513 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:05.245320 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:05.745311879 +0000 UTC m=+97.534380864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : secret "router-metrics-certs-default" not found Jul 06 15:27:05.247369 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.247350 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-default-certificate\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.247449 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.247381 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-stats-auth\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.255161 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.255139 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls4pl\" (UniqueName: \"kubernetes.io/projected/86af66de-2278-4ec5-9aee-4690e2b83310-kube-api-access-ls4pl\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.346282 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346257 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ec71521-02e1-4028-9c7e-5f6840c46af8-config\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.346380 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63f36c0a-f49d-4774-97aa-2350a846ce5d-config\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.346380 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346311 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6hhr\" (UniqueName: \"kubernetes.io/projected/63f36c0a-f49d-4774-97aa-2350a846ce5d-kube-api-access-h6hhr\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.346380 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346329 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e298480-975b-4afc-b9f4-d71876085a19-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.346380 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346368 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e298480-975b-4afc-b9f4-d71876085a19-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.346579 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec71521-02e1-4028-9c7e-5f6840c46af8-trusted-ca\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.346579 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63f36c0a-f49d-4774-97aa-2350a846ce5d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.346579 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vf57\" (UniqueName: \"kubernetes.io/projected/3ec71521-02e1-4028-9c7e-5f6840c46af8-kube-api-access-7vf57\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.346579 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs6v6\" (UniqueName: \"kubernetes.io/projected/6e298480-975b-4afc-b9f4-d71876085a19-kube-api-access-xs6v6\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.346579 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.346476 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ec71521-02e1-4028-9c7e-5f6840c46af8-serving-cert\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.347147 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.347011 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/63f36c0a-f49d-4774-97aa-2350a846ce5d-config\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.347147 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.347093 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6e298480-975b-4afc-b9f4-d71876085a19-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.347147 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.347138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3ec71521-02e1-4028-9c7e-5f6840c46af8-config\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.347907 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.347886 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3ec71521-02e1-4028-9c7e-5f6840c46af8-trusted-ca\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.348739 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.348718 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/63f36c0a-f49d-4774-97aa-2350a846ce5d-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.349087 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.349061 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6e298480-975b-4afc-b9f4-d71876085a19-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.349250 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.349230 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3ec71521-02e1-4028-9c7e-5f6840c46af8-serving-cert\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.356970 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.356950 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vf57\" (UniqueName: \"kubernetes.io/projected/3ec71521-02e1-4028-9c7e-5f6840c46af8-kube-api-access-7vf57\") pod \"console-operator-68b757fb67-hh9xt\" (UID: \"3ec71521-02e1-4028-9c7e-5f6840c46af8\") " pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.357089 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.357072 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs6v6\" (UniqueName: \"kubernetes.io/projected/6e298480-975b-4afc-b9f4-d71876085a19-kube-api-access-xs6v6\") pod \"kube-storage-version-migrator-operator-846bf668f7-xwm4t\" (UID: \"6e298480-975b-4afc-b9f4-d71876085a19\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.359273 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.359249 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6hhr\" (UniqueName: \"kubernetes.io/projected/63f36c0a-f49d-4774-97aa-2350a846ce5d-kube-api-access-h6hhr\") pod \"service-ca-operator-5d46d9ffd4-nmn2p\" (UID: \"63f36c0a-f49d-4774-97aa-2350a846ce5d\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.470316 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.470283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" Jul 06 15:27:05.477648 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.477626 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:05.482483 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.482464 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" Jul 06 15:27:05.616467 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.616397 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p"] Jul 06 15:27:05.619870 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:05.619846 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f36c0a_f49d_4774_97aa_2350a846ce5d.slice/crio-ffa89565e0c71ba574995bc910ee06606c12ec02c42a8a5a4a9d682fe028971a WatchSource:0}: Error finding container ffa89565e0c71ba574995bc910ee06606c12ec02c42a8a5a4a9d682fe028971a: Status 404 returned error can't find the container with id ffa89565e0c71ba574995bc910ee06606c12ec02c42a8a5a4a9d682fe028971a Jul 06 15:27:05.749717 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.749682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.749826 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.749736 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:05.749866 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:05.749832 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:05.749866 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:05.749848 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:06.74983041 +0000 UTC m=+98.538899405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:05.749934 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:05.749870 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:06.749863383 +0000 UTC m=+98.538932368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : secret "router-metrics-certs-default" not found Jul 06 15:27:05.831122 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.831098 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-hh9xt"] Jul 06 15:27:05.833654 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:05.833636 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t"] Jul 06 15:27:05.834180 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:05.834149 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec71521_02e1_4028_9c7e_5f6840c46af8.slice/crio-1455b618fc289d230f9b7542b889f2ccac5b2c7dab0421e713e7336792b7bdcf WatchSource:0}: Error finding container 1455b618fc289d230f9b7542b889f2ccac5b2c7dab0421e713e7336792b7bdcf: Status 404 returned error can't find the container with id 1455b618fc289d230f9b7542b889f2ccac5b2c7dab0421e713e7336792b7bdcf Jul 06 15:27:06.278130 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:06.278090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" event={"ID":"63f36c0a-f49d-4774-97aa-2350a846ce5d","Type":"ContainerStarted","Data":"ffa89565e0c71ba574995bc910ee06606c12ec02c42a8a5a4a9d682fe028971a"} Jul 06 15:27:06.279316 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:06.279279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" event={"ID":"6e298480-975b-4afc-b9f4-d71876085a19","Type":"ContainerStarted","Data":"bd8979cab3ab278685acee3e9e2db28675d80dc1b775461d2b89f707849a99e3"} Jul 06 15:27:06.280427 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:06.280397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" event={"ID":"3ec71521-02e1-4028-9c7e-5f6840c46af8","Type":"ContainerStarted","Data":"1455b618fc289d230f9b7542b889f2ccac5b2c7dab0421e713e7336792b7bdcf"} Jul 06 15:27:06.760413 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:06.760218 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:06.760413 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:06.760322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:06.760645 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:06.760417 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:08.760395886 +0000 UTC m=+100.549464873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:06.760645 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:06.760486 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:06.760645 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:06.760579 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:08.760563962 +0000 UTC m=+100.549632968 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : secret "router-metrics-certs-default" not found Jul 06 15:27:06.861456 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:06.861419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:27:06.861659 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:06.861557 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:27:06.861659 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:06.861627 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls podName:0db5f3cb-d772-4494-be17-f43fc1935a49 nodeName:}" failed. No retries permitted until 2026-07-06 15:28:10.861608403 +0000 UTC m=+162.650677401 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls") pod "dns-default-n5dst" (UID: "0db5f3cb-d772-4494-be17-f43fc1935a49") : secret "dns-default-metrics-tls" not found Jul 06 15:27:08.776630 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:08.776595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:08.777082 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:08.776683 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:08.777082 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:08.776739 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:08.777082 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:08.776813 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:12.776793183 +0000 UTC m=+104.565862182 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : secret "router-metrics-certs-default" not found Jul 06 15:27:08.777082 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:08.776830 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:12.776823132 +0000 UTC m=+104.565892117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:09.290440 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.290382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" event={"ID":"63f36c0a-f49d-4774-97aa-2350a846ce5d","Type":"ContainerStarted","Data":"d9513f16323e655f6940ba6955c45a6e33aaa9f156544115089c4728b56081da"} Jul 06 15:27:09.291920 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.291896 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" event={"ID":"6e298480-975b-4afc-b9f4-d71876085a19","Type":"ContainerStarted","Data":"7d7ebd92e407d04c5ce8120df1c440dd39765ec81ba270964d4e7457e7c3b08c"} Jul 06 15:27:09.293449 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.293430 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/0.log" Jul 06 15:27:09.293530 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.293469 2561 generic.go:356] "Generic (PLEG): container finished" podID="3ec71521-02e1-4028-9c7e-5f6840c46af8" containerID="df91195eddce1e73f4225d7e3d411ce69450b12a5195572be54900d560841837" exitCode=255 Jul 06 15:27:09.293530 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.293515 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" event={"ID":"3ec71521-02e1-4028-9c7e-5f6840c46af8","Type":"ContainerDied","Data":"df91195eddce1e73f4225d7e3d411ce69450b12a5195572be54900d560841837"} Jul 06 15:27:09.293732 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.293717 2561 scope.go:117] "RemoveContainer" containerID="df91195eddce1e73f4225d7e3d411ce69450b12a5195572be54900d560841837" Jul 06 15:27:09.308039 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.307994 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" podStartSLOduration=0.875357847 podStartE2EDuration="4.307977488s" totalImagesPullingTime="3.432619641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:09.307429503 +0000 UTC m=+101.096498511" watchObservedRunningTime="2026-07-06 15:27:09.307977488 +0000 UTC m=+101.097046497" Jul 06 15:27:09.345595 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.345484 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" podStartSLOduration=1.1339335720000001 podStartE2EDuration="4.345465108s" totalImagesPullingTime="3.211531536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:09.344765868 +0000 UTC m=+101.133834876" watchObservedRunningTime="2026-07-06 15:27:09.345465108 +0000 UTC m=+101.134534120" Jul 06 15:27:09.739285 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.739253 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l9jx9"] Jul 06 15:27:09.742277 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.742260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.744486 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.744462 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 15:27:09.744627 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.744491 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 15:27:09.747068 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.747048 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 15:27:09.747205 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.747187 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 15:27:09.747743 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.747723 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4fb7x\"" Jul 06 15:27:09.759427 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.759404 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l9jx9"] Jul 06 15:27:09.884463 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.884433 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-data-volume\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.884463 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.884464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btg59\" (UniqueName: \"kubernetes.io/projected/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-api-access-btg59\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.884977 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.884517 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.884977 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.884554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.884977 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.884578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-crio-socket\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.985397 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.985369 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.985407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.985433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-crio-socket\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.985472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-data-volume\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.985488 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btg59\" (UniqueName: \"kubernetes.io/projected/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-api-access-btg59\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:09.985504 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:09.985523 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:09.985594 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:10.485572401 +0000 UTC m=+102.274641387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : configmap "kube-rbac-proxy" not found Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.985600 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-crio-socket\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.985623 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:09.985613 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:10.485604118 +0000 UTC m=+102.274673102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:09.985936 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.985856 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-data-volume\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:09.995991 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:09.995947 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btg59\" (UniqueName: \"kubernetes.io/projected/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-api-access-btg59\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:10.214256 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.214223 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vmft6" Jul 06 15:27:10.298038 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.297981 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/1.log" Jul 06 15:27:10.298378 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.298364 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/0.log" Jul 06 15:27:10.298431 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.298395 2561 generic.go:356] "Generic (PLEG): container finished" podID="3ec71521-02e1-4028-9c7e-5f6840c46af8" containerID="ec8ca28155be88da55e9ea772811e346f4b03d99ad0beeaf7f30f41d1b4b4f5c" exitCode=255 Jul 06 15:27:10.298481 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.298467 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" event={"ID":"3ec71521-02e1-4028-9c7e-5f6840c46af8","Type":"ContainerDied","Data":"ec8ca28155be88da55e9ea772811e346f4b03d99ad0beeaf7f30f41d1b4b4f5c"} Jul 06 15:27:10.298562 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.298520 2561 scope.go:117] "RemoveContainer" containerID="df91195eddce1e73f4225d7e3d411ce69450b12a5195572be54900d560841837" Jul 06 15:27:10.298761 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.298742 2561 scope.go:117] "RemoveContainer" containerID="ec8ca28155be88da55e9ea772811e346f4b03d99ad0beeaf7f30f41d1b4b4f5c" Jul 06 15:27:10.298928 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:10.298909 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hh9xt_openshift-console-operator(3ec71521-02e1-4028-9c7e-5f6840c46af8)\"" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" podUID="3ec71521-02e1-4028-9c7e-5f6840c46af8" Jul 06 15:27:10.490468 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.490437 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:10.490635 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:10.490478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:10.490635 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:10.490595 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:10.490745 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:10.490634 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:10.490745 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:10.490656 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:11.490641668 +0000 UTC m=+103.279710653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:10.490745 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:10.490692 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:11.490674615 +0000 UTC m=+103.279743623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : configmap "kube-rbac-proxy" not found Jul 06 15:27:11.302497 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:11.302472 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/1.log" Jul 06 15:27:11.302899 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:11.302780 2561 scope.go:117] "RemoveContainer" containerID="ec8ca28155be88da55e9ea772811e346f4b03d99ad0beeaf7f30f41d1b4b4f5c" Jul 06 15:27:11.302939 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:11.302920 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hh9xt_openshift-console-operator(3ec71521-02e1-4028-9c7e-5f6840c46af8)\"" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" podUID="3ec71521-02e1-4028-9c7e-5f6840c46af8" Jul 06 15:27:11.497822 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:11.497785 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:11.497963 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:11.497839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:11.497963 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:11.497895 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:11.497963 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:11.497925 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:11.497963 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:11.497945 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:13.497933161 +0000 UTC m=+105.287002149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:11.498100 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:11.497977 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:13.497961098 +0000 UTC m=+105.287030087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : configmap "kube-rbac-proxy" not found Jul 06 15:27:11.934956 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:11.934647 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vf6rv_95ac59e6-67c8-4d98-96a1-1c51db82cf3f/dns-node-resolver/0.log" Jul 06 15:27:12.308567 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.308484 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vtvld"] Jul 06 15:27:12.344775 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.344747 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vtvld"] Jul 06 15:27:12.344899 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.344827 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.356941 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.356920 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 06 15:27:12.357041 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.356926 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 06 15:27:12.357041 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.356972 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 06 15:27:12.357616 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.357604 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 06 15:27:12.357691 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.357669 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zjgc5\"" Jul 06 15:27:12.404327 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.404309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/892457ed-0fca-48d6-817c-dfc5f707469d-signing-cabundle\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.404439 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.404332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/892457ed-0fca-48d6-817c-dfc5f707469d-signing-key\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.404439 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.404349 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp5hm\" (UniqueName: \"kubernetes.io/projected/892457ed-0fca-48d6-817c-dfc5f707469d-kube-api-access-rp5hm\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.505067 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.505044 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/892457ed-0fca-48d6-817c-dfc5f707469d-signing-cabundle\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.505181 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.505075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/892457ed-0fca-48d6-817c-dfc5f707469d-signing-key\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.505181 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.505111 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp5hm\" (UniqueName: \"kubernetes.io/projected/892457ed-0fca-48d6-817c-dfc5f707469d-kube-api-access-rp5hm\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.505658 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.505637 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/892457ed-0fca-48d6-817c-dfc5f707469d-signing-cabundle\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.507360 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.507330 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/892457ed-0fca-48d6-817c-dfc5f707469d-signing-key\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.525607 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.525587 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp5hm\" (UniqueName: \"kubernetes.io/projected/892457ed-0fca-48d6-817c-dfc5f707469d-kube-api-access-rp5hm\") pod \"service-ca-758f599c5-vtvld\" (UID: \"892457ed-0fca-48d6-817c-dfc5f707469d\") " pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.653609 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.653583 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-vtvld" Jul 06 15:27:12.735430 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.735404 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jz4xk_b42039fd-c943-44c3-a5bd-c795168f76e0/node-ca/0.log" Jul 06 15:27:12.793227 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.793196 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-vtvld"] Jul 06 15:27:12.796718 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:12.796691 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod892457ed_0fca_48d6_817c_dfc5f707469d.slice/crio-9033a462cacb7aee21868b109687fa5a4f783bf2deb5ae8bbdcd2bf46e67627d WatchSource:0}: Error finding container 9033a462cacb7aee21868b109687fa5a4f783bf2deb5ae8bbdcd2bf46e67627d: Status 404 returned error can't find the container with id 9033a462cacb7aee21868b109687fa5a4f783bf2deb5ae8bbdcd2bf46e67627d Jul 06 15:27:12.807409 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.807389 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:12.807498 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:12.807448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:12.807557 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:12.807525 2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:12.807557 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:12.807551 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:20.807522481 +0000 UTC m=+112.596591465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:12.807648 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:12.807592 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs podName:86af66de-2278-4ec5-9aee-4690e2b83310 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:20.807579632 +0000 UTC m=+112.596648616 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs") pod "router-default-6f8b69dd9f-dsvfp" (UID: "86af66de-2278-4ec5-9aee-4690e2b83310") : secret "router-metrics-certs-default" not found Jul 06 15:27:13.310806 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:13.310773 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vtvld" event={"ID":"892457ed-0fca-48d6-817c-dfc5f707469d","Type":"ContainerStarted","Data":"ea56b1f6bbcb93713dcbc4e12c190102fee1448de7b913aea0d91b4c5a2bce60"} Jul 06 15:27:13.311251 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:13.310818 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-vtvld" event={"ID":"892457ed-0fca-48d6-817c-dfc5f707469d","Type":"ContainerStarted","Data":"9033a462cacb7aee21868b109687fa5a4f783bf2deb5ae8bbdcd2bf46e67627d"} Jul 06 15:27:13.328122 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:13.328075 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-vtvld" podStartSLOduration=1.328061517 podStartE2EDuration="1.328061517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:13.327141068 +0000 UTC m=+105.116210077" watchObservedRunningTime="2026-07-06 15:27:13.328061517 +0000 UTC m=+105.117130557" Jul 06 15:27:13.335140 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:13.335119 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l5ns2_aea71b93-7d9c-4e69-8bd2-433234c6bcb0/serve-healthcheck-canary/0.log" Jul 06 15:27:13.512302 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:13.512270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:13.512443 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:13.512312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:13.512443 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:13.512408 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:13.512528 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:13.512447 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:13.512528 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:13.512480 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:17.512462348 +0000 UTC m=+109.301531341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:13.512528 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:13.512497 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:17.512490318 +0000 UTC m=+109.301559302 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : configmap "kube-rbac-proxy" not found Jul 06 15:27:15.478284 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:15.478254 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:15.478654 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:15.478307 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:15.478654 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:15.478602 2561 scope.go:117] "RemoveContainer" containerID="ec8ca28155be88da55e9ea772811e346f4b03d99ad0beeaf7f30f41d1b4b4f5c" Jul 06 15:27:15.478750 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:15.478731 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-hh9xt_openshift-console-operator(3ec71521-02e1-4028-9c7e-5f6840c46af8)\"" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" podUID="3ec71521-02e1-4028-9c7e-5f6840c46af8" Jul 06 15:27:17.545513 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:17.545480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:17.545932 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:17.545521 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:17.545932 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:17.545611 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:17.545932 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:17.545621 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:17.545932 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:17.545662 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:25.545648519 +0000 UTC m=+117.334717504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : configmap "kube-rbac-proxy" not found Jul 06 15:27:17.545932 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:17.545675 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls podName:bcf57e8f-db9e-43fc-9c55-16f60b7930d2 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:25.545669132 +0000 UTC m=+117.334738117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l9jx9" (UID: "bcf57e8f-db9e-43fc-9c55-16f60b7930d2") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:20.869003 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:20.868967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:20.869744 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:20.869041 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:20.869840 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:20.869766 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86af66de-2278-4ec5-9aee-4690e2b83310-service-ca-bundle\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:20.871422 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:20.871396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86af66de-2278-4ec5-9aee-4690e2b83310-metrics-certs\") pod \"router-default-6f8b69dd9f-dsvfp\" (UID: \"86af66de-2278-4ec5-9aee-4690e2b83310\") " pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:20.967567 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:20.967524 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:21.100832 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:21.100801 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f8b69dd9f-dsvfp"] Jul 06 15:27:21.103931 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:21.103907 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86af66de_2278_4ec5_9aee_4690e2b83310.slice/crio-0d0c2e0635aa10f7d3cf52a0b7f67c09dd767b5db72f17178a7d7f9e1ab4a944 WatchSource:0}: Error finding container 0d0c2e0635aa10f7d3cf52a0b7f67c09dd767b5db72f17178a7d7f9e1ab4a944: Status 404 returned error can't find the container with id 0d0c2e0635aa10f7d3cf52a0b7f67c09dd767b5db72f17178a7d7f9e1ab4a944 Jul 06 15:27:21.335488 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:21.335453 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" event={"ID":"86af66de-2278-4ec5-9aee-4690e2b83310","Type":"ContainerStarted","Data":"ea881181fc449d34ce7e16b3a5c5855907f3250ceee9380b81a08804281ebda3"} Jul 06 15:27:21.335648 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:21.335552 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" event={"ID":"86af66de-2278-4ec5-9aee-4690e2b83310","Type":"ContainerStarted","Data":"0d0c2e0635aa10f7d3cf52a0b7f67c09dd767b5db72f17178a7d7f9e1ab4a944"} Jul 06 15:27:21.371685 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:21.371639 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" podStartSLOduration=16.37162589 podStartE2EDuration="16.37162589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:21.371565618 +0000 UTC m=+113.160634637" watchObservedRunningTime="2026-07-06 15:27:21.37162589 +0000 UTC m=+113.160694896" Jul 06 15:27:21.968637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:21.968597 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:21.971161 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:21.971138 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:22.338834 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:22.338810 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:22.340041 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:22.340018 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f8b69dd9f-dsvfp" Jul 06 15:27:25.603398 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:25.603365 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:25.603398 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:25.603399 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:25.603977 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:25.603957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:25.605671 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:25.605643 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bcf57e8f-db9e-43fc-9c55-16f60b7930d2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l9jx9\" (UID: \"bcf57e8f-db9e-43fc-9c55-16f60b7930d2\") " pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:25.651772 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:25.651749 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l9jx9" Jul 06 15:27:25.788257 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:25.788226 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l9jx9"] Jul 06 15:27:25.791419 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:25.791391 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf57e8f_db9e_43fc_9c55_16f60b7930d2.slice/crio-3ba7d49d0c00558431851962bec899384b4ebb0df2a2f542fcc8afd67eade691 WatchSource:0}: Error finding container 3ba7d49d0c00558431851962bec899384b4ebb0df2a2f542fcc8afd67eade691: Status 404 returned error can't find the container with id 3ba7d49d0c00558431851962bec899384b4ebb0df2a2f542fcc8afd67eade691 Jul 06 15:27:26.350672 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:26.350636 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9jx9" event={"ID":"bcf57e8f-db9e-43fc-9c55-16f60b7930d2","Type":"ContainerStarted","Data":"3ba7d49d0c00558431851962bec899384b4ebb0df2a2f542fcc8afd67eade691"} Jul 06 15:27:29.715735 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:29.715705 2561 scope.go:117] "RemoveContainer" containerID="ec8ca28155be88da55e9ea772811e346f4b03d99ad0beeaf7f30f41d1b4b4f5c" Jul 06 15:27:30.368728 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:30.368701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/2.log" Jul 06 15:27:30.369076 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:30.369063 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/1.log" Jul 06 15:27:30.369151 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:30.369092 2561 generic.go:356] "Generic (PLEG): container finished" podID="3ec71521-02e1-4028-9c7e-5f6840c46af8" containerID="62fae81a8010d3f9b4548ef1064f6202ee4eddf3d68d42d48c81ed4c72d7ecda" exitCode=255 Jul 06 15:27:30.369200 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:30.369171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" event={"ID":"3ec71521-02e1-4028-9c7e-5f6840c46af8","Type":"ContainerDied","Data":"62fae81a8010d3f9b4548ef1064f6202ee4eddf3d68d42d48c81ed4c72d7ecda"} Jul 06 15:27:30.369280 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:30.369249 2561 scope.go:117] "RemoveContainer" containerID="ec8ca28155be88da55e9ea772811e346f4b03d99ad0beeaf7f30f41d1b4b4f5c" Jul 06 15:27:30.369638 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:30.369619 2561 scope.go:117] "RemoveContainer" containerID="62fae81a8010d3f9b4548ef1064f6202ee4eddf3d68d42d48c81ed4c72d7ecda" Jul 06 15:27:30.369825 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:30.369802 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-hh9xt_openshift-console-operator(3ec71521-02e1-4028-9c7e-5f6840c46af8)\"" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" podUID="3ec71521-02e1-4028-9c7e-5f6840c46af8" Jul 06 15:27:30.370989 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:30.370971 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9jx9" event={"ID":"bcf57e8f-db9e-43fc-9c55-16f60b7930d2","Type":"ContainerStarted","Data":"4f47d1e83d16320e464bb247685ab531f538867bf1ce07b4f3ba8f9302888929"} Jul 06 15:27:30.371062 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:30.371012 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9jx9" event={"ID":"bcf57e8f-db9e-43fc-9c55-16f60b7930d2","Type":"ContainerStarted","Data":"f7950287f0932074af156af9fae3bdbf7a8ce6e87f87b4207c7dd344ebb1df14"} Jul 06 15:27:31.376615 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:31.376574 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/2.log" Jul 06 15:27:33.384378 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:33.384341 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l9jx9" event={"ID":"bcf57e8f-db9e-43fc-9c55-16f60b7930d2","Type":"ContainerStarted","Data":"319d0b0703327d117f3cf6edaec2f10a2bece6969ad0fe2529568230668c8972"} Jul 06 15:27:33.407064 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:33.407015 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l9jx9" podStartSLOduration=17.513495531 podStartE2EDuration="24.407001492s" totalImagesPullingTime="6.893505961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:27:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:33.405942431 +0000 UTC m=+125.195011438" watchObservedRunningTime="2026-07-06 15:27:33.407001492 +0000 UTC m=+125.196070500" Jul 06 15:27:34.067354 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.067321 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d9fdf89c-n4jht"] Jul 06 15:27:34.070337 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.070317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.072670 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.072628 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 15:27:34.073132 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.073114 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 15:27:34.073343 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.073327 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4gvxh\"" Jul 06 15:27:34.073393 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.073369 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 15:27:34.078520 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.078496 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 15:27:34.085197 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.085176 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d9fdf89c-n4jht"] Jul 06 15:27:34.168104 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.168046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3511d93-8155-477f-a02f-1af85814c63e-registry-certificates\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.168104 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.168073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rjs4\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-kube-api-access-8rjs4\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.168259 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.168119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3511d93-8155-477f-a02f-1af85814c63e-image-registry-private-configuration\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.168259 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.168196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-registry-tls\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.168259 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.168228 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3511d93-8155-477f-a02f-1af85814c63e-ca-trust-extracted\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.168406 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.168258 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-bound-sa-token\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.168406 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.168316 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3511d93-8155-477f-a02f-1af85814c63e-trusted-ca\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.168406 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.168344 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3511d93-8155-477f-a02f-1af85814c63e-installation-pull-secrets\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269096 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269071 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3511d93-8155-477f-a02f-1af85814c63e-image-registry-private-configuration\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269193 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269117 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-registry-tls\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269193 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3511d93-8155-477f-a02f-1af85814c63e-ca-trust-extracted\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269193 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269168 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-bound-sa-token\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269358 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3511d93-8155-477f-a02f-1af85814c63e-trusted-ca\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269480 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269459 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3511d93-8155-477f-a02f-1af85814c63e-installation-pull-secrets\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269681 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3511d93-8155-477f-a02f-1af85814c63e-registry-certificates\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269681 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269661 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3511d93-8155-477f-a02f-1af85814c63e-ca-trust-extracted\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.269681 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.269681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rjs4\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-kube-api-access-8rjs4\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.270162 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.270142 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3511d93-8155-477f-a02f-1af85814c63e-trusted-ca\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.270505 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.270482 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3511d93-8155-477f-a02f-1af85814c63e-registry-certificates\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.271665 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.271633 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-registry-tls\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.271747 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.271692 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3511d93-8155-477f-a02f-1af85814c63e-image-registry-private-configuration\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.271804 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.271786 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3511d93-8155-477f-a02f-1af85814c63e-installation-pull-secrets\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.283184 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.283161 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rjs4\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-kube-api-access-8rjs4\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.284137 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.284118 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3511d93-8155-477f-a02f-1af85814c63e-bound-sa-token\") pod \"image-registry-d9fdf89c-n4jht\" (UID: \"c3511d93-8155-477f-a02f-1af85814c63e\") " pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.379020 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.378997 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:34.516937 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:34.516911 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d9fdf89c-n4jht"] Jul 06 15:27:34.521317 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:34.521293 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3511d93_8155_477f_a02f_1af85814c63e.slice/crio-949c24355ec95ed5acfca0d453951d7198224874ad7e906173232d32ec85c8f2 WatchSource:0}: Error finding container 949c24355ec95ed5acfca0d453951d7198224874ad7e906173232d32ec85c8f2: Status 404 returned error can't find the container with id 949c24355ec95ed5acfca0d453951d7198224874ad7e906173232d32ec85c8f2 Jul 06 15:27:35.392356 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:35.392312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" event={"ID":"c3511d93-8155-477f-a02f-1af85814c63e","Type":"ContainerStarted","Data":"aab06ee7f713bf7354f6ae7aed18c0dffd64ba3fe1cc846d0b64c0eea0a2aa8d"} Jul 06 15:27:35.392567 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:35.392407 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" event={"ID":"c3511d93-8155-477f-a02f-1af85814c63e","Type":"ContainerStarted","Data":"949c24355ec95ed5acfca0d453951d7198224874ad7e906173232d32ec85c8f2"} Jul 06 15:27:35.392567 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:35.392480 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:27:35.452771 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:35.452721 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" podStartSLOduration=1.4527047610000001 podStartE2EDuration="1.452704761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:35.444733498 +0000 UTC m=+127.233802507" watchObservedRunningTime="2026-07-06 15:27:35.452704761 +0000 UTC m=+127.241773786" Jul 06 15:27:35.478680 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:35.478654 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:35.478795 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:35.478697 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:27:35.479068 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:35.479048 2561 scope.go:117] "RemoveContainer" containerID="62fae81a8010d3f9b4548ef1064f6202ee4eddf3d68d42d48c81ed4c72d7ecda" Jul 06 15:27:35.479248 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:35.479218 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-hh9xt_openshift-console-operator(3ec71521-02e1-4028-9c7e-5f6840c46af8)\"" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" podUID="3ec71521-02e1-4028-9c7e-5f6840c46af8" Jul 06 15:27:37.491591 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:37.491557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:27:37.493732 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:37.493714 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fd1b5d06-7c5e-4573-ab93-793c9895ebfd-metrics-certs\") pod \"network-metrics-daemon-bchrm\" (UID: \"fd1b5d06-7c5e-4573-ab93-793c9895ebfd\") " pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:27:37.731478 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:37.731454 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lwgnr\"" Jul 06 15:27:37.739402 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:37.739385 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bchrm" Jul 06 15:27:37.885998 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:37.885968 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bchrm"] Jul 06 15:27:37.890473 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:37.890440 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1b5d06_7c5e_4573_ab93_793c9895ebfd.slice/crio-f79f03d0ed3bf3cae5d6b94c9036b9a5bf6e42564f5f828f9deb21b7ac064bd1 WatchSource:0}: Error finding container f79f03d0ed3bf3cae5d6b94c9036b9a5bf6e42564f5f828f9deb21b7ac064bd1: Status 404 returned error can't find the container with id f79f03d0ed3bf3cae5d6b94c9036b9a5bf6e42564f5f828f9deb21b7ac064bd1 Jul 06 15:27:38.403763 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:38.403732 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bchrm" event={"ID":"fd1b5d06-7c5e-4573-ab93-793c9895ebfd","Type":"ContainerStarted","Data":"f79f03d0ed3bf3cae5d6b94c9036b9a5bf6e42564f5f828f9deb21b7ac064bd1"} Jul 06 15:27:39.408828 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:39.408793 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bchrm" event={"ID":"fd1b5d06-7c5e-4573-ab93-793c9895ebfd","Type":"ContainerStarted","Data":"23607a16e377b1b85bb7667119ee4aa9928cebc107f3db36fa55fdac686526ce"} Jul 06 15:27:39.409247 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:39.408870 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bchrm" event={"ID":"fd1b5d06-7c5e-4573-ab93-793c9895ebfd","Type":"ContainerStarted","Data":"df1f58bb114e71f33cca5c928f5c45917994c074efab6bf8c96da8e30ad81486"} Jul 06 15:27:39.430974 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:39.430922 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bchrm" podStartSLOduration=129.589177895 podStartE2EDuration="2m10.430903497s" totalImagesPullingTime="841.725602ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:39.429896117 +0000 UTC m=+131.218965124" watchObservedRunningTime="2026-07-06 15:27:39.430903497 +0000 UTC m=+131.219972504" Jul 06 15:27:40.183247 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.183214 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm"] Jul 06 15:27:40.204908 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.204884 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm"] Jul 06 15:27:40.205031 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.204968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" Jul 06 15:27:40.207221 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.207198 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 15:27:40.207339 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.207197 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mv95t\"" Jul 06 15:27:40.310753 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.310727 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aae0522d-9bfb-46ef-8836-47386ea203e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gj8sm\" (UID: \"aae0522d-9bfb-46ef-8836-47386ea203e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" Jul 06 15:27:40.411451 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.411414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aae0522d-9bfb-46ef-8836-47386ea203e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gj8sm\" (UID: \"aae0522d-9bfb-46ef-8836-47386ea203e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" Jul 06 15:27:40.411924 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:40.411566 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 15:27:40.411924 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:40.411630 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae0522d-9bfb-46ef-8836-47386ea203e1-tls-certificates podName:aae0522d-9bfb-46ef-8836-47386ea203e1 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:40.911611462 +0000 UTC m=+132.700680449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/aae0522d-9bfb-46ef-8836-47386ea203e1-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-gj8sm" (UID: "aae0522d-9bfb-46ef-8836-47386ea203e1") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 15:27:40.914741 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.914711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aae0522d-9bfb-46ef-8836-47386ea203e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gj8sm\" (UID: \"aae0522d-9bfb-46ef-8836-47386ea203e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" Jul 06 15:27:40.917040 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:40.917004 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aae0522d-9bfb-46ef-8836-47386ea203e1-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-gj8sm\" (UID: \"aae0522d-9bfb-46ef-8836-47386ea203e1\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" Jul 06 15:27:41.114514 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:41.114481 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" Jul 06 15:27:41.253958 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:41.253927 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm"] Jul 06 15:27:41.257168 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:41.257138 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae0522d_9bfb_46ef_8836_47386ea203e1.slice/crio-5508fd68af6d9b769e675912d7be6ee7d0e83c01789ca7965d22b89515c49d6c WatchSource:0}: Error finding container 5508fd68af6d9b769e675912d7be6ee7d0e83c01789ca7965d22b89515c49d6c: Status 404 returned error can't find the container with id 5508fd68af6d9b769e675912d7be6ee7d0e83c01789ca7965d22b89515c49d6c Jul 06 15:27:41.416633 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:41.416601 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" event={"ID":"aae0522d-9bfb-46ef-8836-47386ea203e1","Type":"ContainerStarted","Data":"5508fd68af6d9b769e675912d7be6ee7d0e83c01789ca7965d22b89515c49d6c"} Jul 06 15:27:42.420565 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:42.420521 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" event={"ID":"aae0522d-9bfb-46ef-8836-47386ea203e1","Type":"ContainerStarted","Data":"a3dc87df3a5a080032200dc73124c1d184d43543aed96ae818456d8c2c40302c"} Jul 06 15:27:42.420928 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:42.420710 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" Jul 06 15:27:42.425347 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:42.425328 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" Jul 06 15:27:42.436412 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:42.436373 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-gj8sm" podStartSLOduration=1.3628121100000001 podStartE2EDuration="2.436359364s" totalImagesPullingTime="1.073547254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:42.435943224 +0000 UTC m=+134.225012241" watchObservedRunningTime="2026-07-06 15:27:42.436359364 +0000 UTC m=+134.225428371" Jul 06 15:27:46.739701 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.739667 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fr2tc"] Jul 06 15:27:46.742501 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.742478 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.742674 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.742617 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p"] Jul 06 15:27:46.744960 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.744942 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 15:27:46.745096 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.744960 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 15:27:46.745311 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.745292 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 15:27:46.745382 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.744991 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 15:27:46.745382 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.745348 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 15:27:46.745487 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.745296 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 15:27:46.745487 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.745157 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.745611 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.744960 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-n8pd9\"" Jul 06 15:27:46.747961 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.747867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6jnxg\"" Jul 06 15:27:46.747961 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.747883 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 15:27:46.748117 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.747867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 15:27:46.748117 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.747870 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 15:27:46.764681 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.764662 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p"] Jul 06 15:27:46.857569 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.857759 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.857759 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857677 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvn77\" (UniqueName: \"kubernetes.io/projected/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-api-access-lvn77\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.857759 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-accelerators-collector-config\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.857892 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndtlz\" (UniqueName: \"kubernetes.io/projected/6450ad14-4080-431a-a2ec-903bc4e08807-kube-api-access-ndtlz\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.857892 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-sys\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.857892 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-root\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.857892 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-wtmp\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.858029 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857895 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/10b0cb33-7846-4d1b-bb3e-a681a4944c30-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.858029 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.858029 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857970 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-textfile\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.858029 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.857991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-tls\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.858029 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.858006 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6450ad14-4080-431a-a2ec-903bc4e08807-metrics-client-ca\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.858029 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.858028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10b0cb33-7846-4d1b-bb3e-a681a4944c30-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.858227 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.858047 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.958763 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.958730 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.958926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.958775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvn77\" (UniqueName: \"kubernetes.io/projected/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-api-access-lvn77\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.958926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.958805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-accelerators-collector-config\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.958926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.958833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndtlz\" (UniqueName: \"kubernetes.io/projected/6450ad14-4080-431a-a2ec-903bc4e08807-kube-api-access-ndtlz\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.958926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.958866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-sys\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.958926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.958889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-root\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.958926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.958913 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-wtmp\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.958972 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-sys\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/10b0cb33-7846-4d1b-bb3e-a681a4944c30-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959035 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-wtmp\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959077 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6450ad14-4080-431a-a2ec-903bc4e08807-root\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-textfile\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-tls\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6450ad14-4080-431a-a2ec-903bc4e08807-metrics-client-ca\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959229 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10b0cb33-7846-4d1b-bb3e-a681a4944c30-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.959737 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959250 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.959737 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959299 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.959737 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959410 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/10b0cb33-7846-4d1b-bb3e-a681a4944c30-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.959737 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959429 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-textfile\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959737 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959525 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-accelerators-collector-config\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.959986 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.959971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6450ad14-4080-431a-a2ec-903bc4e08807-metrics-client-ca\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.960199 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.960173 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.960199 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.960199 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10b0cb33-7846-4d1b-bb3e-a681a4944c30-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.961652 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.961627 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-tls\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.961737 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.961701 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.961909 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.961888 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6450ad14-4080-431a-a2ec-903bc4e08807-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:46.962304 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.962284 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.968981 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.968961 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvn77\" (UniqueName: \"kubernetes.io/projected/10b0cb33-7846-4d1b-bb3e-a681a4944c30-kube-api-access-lvn77\") pod \"kube-state-metrics-7c9dbb8b7d-kqq8p\" (UID: \"10b0cb33-7846-4d1b-bb3e-a681a4944c30\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:46.969220 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:46.969193 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndtlz\" (UniqueName: \"kubernetes.io/projected/6450ad14-4080-431a-a2ec-903bc4e08807-kube-api-access-ndtlz\") pod \"node-exporter-fr2tc\" (UID: \"6450ad14-4080-431a-a2ec-903bc4e08807\") " pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:47.055966 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:47.055920 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fr2tc" Jul 06 15:27:47.060721 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:47.060702 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" Jul 06 15:27:47.069506 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:47.069481 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6450ad14_4080_431a_a2ec_903bc4e08807.slice/crio-c9cbd0761ba87072f11cecf579fb8a697db0bf0105e782cf6f6736d3fde03d10 WatchSource:0}: Error finding container c9cbd0761ba87072f11cecf579fb8a697db0bf0105e782cf6f6736d3fde03d10: Status 404 returned error can't find the container with id c9cbd0761ba87072f11cecf579fb8a697db0bf0105e782cf6f6736d3fde03d10 Jul 06 15:27:47.200327 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:47.200298 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p"] Jul 06 15:27:47.203690 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:47.203655 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b0cb33_7846_4d1b_bb3e_a681a4944c30.slice/crio-ae6cbe253b4a1d02346f4027ab183777a4d5ccff18ccda52131ef96ed48f024e WatchSource:0}: Error finding container ae6cbe253b4a1d02346f4027ab183777a4d5ccff18ccda52131ef96ed48f024e: Status 404 returned error can't find the container with id ae6cbe253b4a1d02346f4027ab183777a4d5ccff18ccda52131ef96ed48f024e Jul 06 15:27:47.437833 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:47.437805 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr2tc" event={"ID":"6450ad14-4080-431a-a2ec-903bc4e08807","Type":"ContainerStarted","Data":"c9cbd0761ba87072f11cecf579fb8a697db0bf0105e782cf6f6736d3fde03d10"} Jul 06 15:27:47.438787 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:47.438762 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" event={"ID":"10b0cb33-7846-4d1b-bb3e-a681a4944c30","Type":"ContainerStarted","Data":"ae6cbe253b4a1d02346f4027ab183777a4d5ccff18ccda52131ef96ed48f024e"} Jul 06 15:27:47.715882 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:47.715801 2561 scope.go:117] "RemoveContainer" containerID="62fae81a8010d3f9b4548ef1064f6202ee4eddf3d68d42d48c81ed4c72d7ecda" Jul 06 15:27:47.716029 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:27:47.715996 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-hh9xt_openshift-console-operator(3ec71521-02e1-4028-9c7e-5f6840c46af8)\"" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" podUID="3ec71521-02e1-4028-9c7e-5f6840c46af8" Jul 06 15:27:48.446506 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.446391 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" event={"ID":"10b0cb33-7846-4d1b-bb3e-a681a4944c30","Type":"ContainerStarted","Data":"c0795a4900718e7ee0947f1e6f12a0fbdb1f402be59a196bbcb3e0ef3b16e024"} Jul 06 15:27:48.446506 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.446467 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" event={"ID":"10b0cb33-7846-4d1b-bb3e-a681a4944c30","Type":"ContainerStarted","Data":"90e9a92d1639f4e7d32e047bd069b8201a028eb0d48f1683f155109d34ac75c2"} Jul 06 15:27:48.448183 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.448126 2561 generic.go:356] "Generic (PLEG): container finished" podID="6450ad14-4080-431a-a2ec-903bc4e08807" containerID="498498c67042b330f2ea6eee6cf666f0e785538f9abfd6733d9ae67e9a76d589" exitCode=0 Jul 06 15:27:48.448183 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.448157 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr2tc" event={"ID":"6450ad14-4080-431a-a2ec-903bc4e08807","Type":"ContainerDied","Data":"498498c67042b330f2ea6eee6cf666f0e785538f9abfd6733d9ae67e9a76d589"} Jul 06 15:27:48.788907 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.788818 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-ddf58566d-7rwdl"] Jul 06 15:27:48.791250 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.791233 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.793481 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.793426 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 15:27:48.793481 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.793441 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-m777z\"" Jul 06 15:27:48.793668 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.793487 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 15:27:48.793668 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.793519 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 15:27:48.793668 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.793631 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 15:27:48.793830 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.793707 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2okfe3e36554u\"" Jul 06 15:27:48.793830 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.793742 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 15:27:48.804825 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.804805 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ddf58566d-7rwdl"] Jul 06 15:27:48.875790 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.875762 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-grpc-tls\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.875946 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.875795 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.875946 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.875819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.875946 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.875914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.876112 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.875971 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.876112 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.875997 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/877e8b72-8a15-4451-b61f-0cdb729f4767-metrics-client-ca\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.876112 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.876028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-tls\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.876112 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.876096 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9kl\" (UniqueName: \"kubernetes.io/projected/877e8b72-8a15-4451-b61f-0cdb729f4767-kube-api-access-rh9kl\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.977413 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.977388 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-grpc-tls\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.977507 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.977419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.977507 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.977438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.977603 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.977581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.977648 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.977634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.977702 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.977658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/877e8b72-8a15-4451-b61f-0cdb729f4767-metrics-client-ca\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.977702 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.977686 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-tls\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.977812 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.977723 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9kl\" (UniqueName: \"kubernetes.io/projected/877e8b72-8a15-4451-b61f-0cdb729f4767-kube-api-access-rh9kl\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.978456 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.978425 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/877e8b72-8a15-4451-b61f-0cdb729f4767-metrics-client-ca\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.980022 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.979992 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.980127 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.980111 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.980341 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.980322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-grpc-tls\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.980405 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.980322 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.980445 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.980417 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.980445 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.980437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/877e8b72-8a15-4451-b61f-0cdb729f4767-secret-thanos-querier-tls\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:48.987453 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:48.987432 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9kl\" (UniqueName: \"kubernetes.io/projected/877e8b72-8a15-4451-b61f-0cdb729f4767-kube-api-access-rh9kl\") pod \"thanos-querier-ddf58566d-7rwdl\" (UID: \"877e8b72-8a15-4451-b61f-0cdb729f4767\") " pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:49.101593 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:49.101565 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:49.232432 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:49.232396 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-ddf58566d-7rwdl"] Jul 06 15:27:49.235166 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:49.235132 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod877e8b72_8a15_4451_b61f_0cdb729f4767.slice/crio-25db4da7f010fa628795ec091013630e26157559451a3a5c47bc1b6f2b91fc8e WatchSource:0}: Error finding container 25db4da7f010fa628795ec091013630e26157559451a3a5c47bc1b6f2b91fc8e: Status 404 returned error can't find the container with id 25db4da7f010fa628795ec091013630e26157559451a3a5c47bc1b6f2b91fc8e Jul 06 15:27:49.454018 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:49.453953 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" event={"ID":"10b0cb33-7846-4d1b-bb3e-a681a4944c30","Type":"ContainerStarted","Data":"b1bb79968b37303d64a3d4909bea5bc2b005a1c5933877e99e9d7780835719ff"} Jul 06 15:27:49.456222 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:49.456197 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr2tc" event={"ID":"6450ad14-4080-431a-a2ec-903bc4e08807","Type":"ContainerStarted","Data":"94b31b66053d8605ce4dadbe653226daee407145ba01ed98459b2917e4a98dc8"} Jul 06 15:27:49.456322 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:49.456250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fr2tc" event={"ID":"6450ad14-4080-431a-a2ec-903bc4e08807","Type":"ContainerStarted","Data":"57ea46f6da0604029d7717e29ce053e02fdfb5eeb49a170675080d0c8ae3f8fe"} Jul 06 15:27:49.457465 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:49.457437 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" event={"ID":"877e8b72-8a15-4451-b61f-0cdb729f4767","Type":"ContainerStarted","Data":"25db4da7f010fa628795ec091013630e26157559451a3a5c47bc1b6f2b91fc8e"} Jul 06 15:27:49.476436 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:49.476392 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-kqq8p" podStartSLOduration=2.379703653 podStartE2EDuration="3.476377575s" totalImagesPullingTime="1.096673922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:49.475490723 +0000 UTC m=+141.264559730" watchObservedRunningTime="2026-07-06 15:27:49.476377575 +0000 UTC m=+141.265446582" Jul 06 15:27:49.493862 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:49.493823 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fr2tc" podStartSLOduration=2.517018096 podStartE2EDuration="3.493809213s" totalImagesPullingTime="902.275982ms" totalInitContainerRuntime="74.515135ms" isStatefulPod=true podCreationTimestamp="2026-07-06 15:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:49.492864735 +0000 UTC m=+141.281933781" watchObservedRunningTime="2026-07-06 15:27:49.493809213 +0000 UTC m=+141.282878222" Jul 06 15:27:51.469621 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:51.469583 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" event={"ID":"877e8b72-8a15-4451-b61f-0cdb729f4767","Type":"ContainerStarted","Data":"33612c5b6580835af65d95d5b6873957b7473cc03549283991643a33f88e97c9"} Jul 06 15:27:51.470081 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:51.469662 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" event={"ID":"877e8b72-8a15-4451-b61f-0cdb729f4767","Type":"ContainerStarted","Data":"4e8c7ecc0696356844f9c8a2a2738192db38078a83d77881f8dddb618f9cc7b5"} Jul 06 15:27:51.470081 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:51.469689 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" event={"ID":"877e8b72-8a15-4451-b61f-0cdb729f4767","Type":"ContainerStarted","Data":"609731c504d8029f03091720d71d775191d6cb995cedeecec643b763fabef83b"} Jul 06 15:27:52.475925 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.475890 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" event={"ID":"877e8b72-8a15-4451-b61f-0cdb729f4767","Type":"ContainerStarted","Data":"481ff629d3d38723c2a5aabea7f211c7055399539efd7f4881e3b6946d0e527d"} Jul 06 15:27:52.476300 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.475953 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" event={"ID":"877e8b72-8a15-4451-b61f-0cdb729f4767","Type":"ContainerStarted","Data":"a0f5a9d5bda8259ba14634d819ed179e6869b14fa36871143fbfa2f33e444f9c"} Jul 06 15:27:52.476300 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.475978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" event={"ID":"877e8b72-8a15-4451-b61f-0cdb729f4767","Type":"ContainerStarted","Data":"18daaa8d379d968a437fc66f838f133c60d4a48815509b154dbc2349564daa08"} Jul 06 15:27:52.476300 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.476046 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:52.504514 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.504474 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" podStartSLOduration=2.026463758 podStartE2EDuration="4.504458352s" totalImagesPullingTime="2.477994594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:52.503707958 +0000 UTC m=+144.292777003" watchObservedRunningTime="2026-07-06 15:27:52.504458352 +0000 UTC m=+144.293527360" Jul 06 15:27:52.967919 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.967432 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:27:52.970928 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.970906 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:52.973346 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.973329 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 15:27:52.973465 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.973364 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 15:27:52.973529 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.973498 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 15:27:52.973611 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.973565 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 15:27:52.973611 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.973584 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 15:27:52.973719 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.973626 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 15:27:52.973819 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.973730 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 15:27:52.974148 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974131 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 15:27:52.974253 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974176 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 15:27:52.974253 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974190 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 15:27:52.974253 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974244 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fegqutlm46i2m\"" Jul 06 15:27:52.974426 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974309 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 15:27:52.974686 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974644 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lxpj8\"" Jul 06 15:27:52.974686 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974660 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 15:27:52.974813 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974700 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 15:27:52.974813 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.974714 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 15:27:52.976958 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.976942 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 15:27:52.996648 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:52.996629 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:27:53.006786 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.006866 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.006866 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.006866 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.006866 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007007 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006883 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwm62\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-kube-api-access-vwm62\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007007 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006901 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007007 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007007 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006961 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007007 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.006981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007145 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007022 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007145 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007145 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007145 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007255 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007153 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007255 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007178 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007255 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007194 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007255 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007214 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007255 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.007397 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.007264 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.107776 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.107752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.107885 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.107780 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.107885 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.107796 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.107885 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.107815 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108050 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108105 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108930 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108930 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108240 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108930 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108292 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108930 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108930 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108930 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108393 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108930 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108790 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.108930 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.108834 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.109524 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.109495 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.109619 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.109576 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.109676 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.109621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110273 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110245 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110359 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwm62\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-kube-api-access-vwm62\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110359 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110337 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110478 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110361 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110478 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110478 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110411 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110478 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110710 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110679 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.110995 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.110971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.111070 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.111049 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-web-config\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.111926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.111427 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.111926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.111590 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.111926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.111874 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.111926 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.111913 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.112258 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.112128 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.112335 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.112318 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.112999 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.112973 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.112999 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.112985 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.113467 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.113451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.114313 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.114292 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config-out\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.114571 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.114525 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.114627 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.114609 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.122061 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.122039 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwm62\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-kube-api-access-vwm62\") pod \"prometheus-k8s-0\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.281332 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.281251 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:27:53.417149 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.417113 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:27:53.421683 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:27:53.421652 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e03054_ed83_4c36_9a00_6ffc5b0751f7.slice/crio-31fd227c901440f03b5f2233a09e76daffc2b3d7203e46bce9fe73fe23d9ccde WatchSource:0}: Error finding container 31fd227c901440f03b5f2233a09e76daffc2b3d7203e46bce9fe73fe23d9ccde: Status 404 returned error can't find the container with id 31fd227c901440f03b5f2233a09e76daffc2b3d7203e46bce9fe73fe23d9ccde Jul 06 15:27:53.480877 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:53.480849 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerStarted","Data":"31fd227c901440f03b5f2233a09e76daffc2b3d7203e46bce9fe73fe23d9ccde"} Jul 06 15:27:54.384459 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:54.384418 2561 patch_prober.go:28] interesting pod/image-registry-d9fdf89c-n4jht container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:27:54.384567 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:54.384470 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" podUID="c3511d93-8155-477f-a02f-1af85814c63e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:27:54.485899 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:54.485870 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" exitCode=0 Jul 06 15:27:54.486185 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:54.485950 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerDied","Data":"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14"} Jul 06 15:27:56.400149 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:56.400115 2561 patch_prober.go:28] interesting pod/image-registry-d9fdf89c-n4jht container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:27:56.400532 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:56.400207 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" podUID="c3511d93-8155-477f-a02f-1af85814c63e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:27:57.500720 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:57.500687 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerStarted","Data":"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc"} Jul 06 15:27:58.486895 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:58.486872 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-ddf58566d-7rwdl" Jul 06 15:27:58.507484 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:58.507459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerStarted","Data":"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2"} Jul 06 15:27:58.507910 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:58.507527 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerStarted","Data":"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33"} Jul 06 15:27:58.507910 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:58.507587 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerStarted","Data":"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d"} Jul 06 15:27:58.507910 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:58.507638 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerStarted","Data":"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0"} Jul 06 15:27:58.507910 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:58.507679 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerStarted","Data":"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc"} Jul 06 15:27:58.545952 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:27:58.545910 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.763954805 podStartE2EDuration="6.545894807s" totalImagesPullingTime="3.758929429s" totalInitContainerRuntime="23.010573ms" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:52 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:58.543760557 +0000 UTC m=+150.332829596" watchObservedRunningTime="2026-07-06 15:27:58.545894807 +0000 UTC m=+150.334963813" Jul 06 15:28:01.715955 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:01.715924 2561 scope.go:117] "RemoveContainer" containerID="62fae81a8010d3f9b4548ef1064f6202ee4eddf3d68d42d48c81ed4c72d7ecda" Jul 06 15:28:02.524716 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:02.524690 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/2.log" Jul 06 15:28:02.524867 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:02.524788 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" event={"ID":"3ec71521-02e1-4028-9c7e-5f6840c46af8","Type":"ContainerStarted","Data":"36ab255e645a820aa4eea254c7a57488f4cf8e7c8289b8c5725e0984f9462c56"} Jul 06 15:28:02.525066 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:02.525045 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:28:02.755240 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:02.755211 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" Jul 06 15:28:02.775420 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:02.775309 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-hh9xt" podStartSLOduration=54.556799733 podStartE2EDuration="57.775289384s" totalImagesPullingTime="3.218489651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:02.561743673 +0000 UTC m=+154.350812680" watchObservedRunningTime="2026-07-06 15:28:02.775289384 +0000 UTC m=+154.564358392" Jul 06 15:28:03.282253 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:03.282223 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:04.383961 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:04.383928 2561 patch_prober.go:28] interesting pod/image-registry-d9fdf89c-n4jht container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:04.384434 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:04.383988 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" podUID="c3511d93-8155-477f-a02f-1af85814c63e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:06.040746 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:28:06.040706 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n5dst" podUID="0db5f3cb-d772-4494-be17-f43fc1935a49" Jul 06 15:28:06.399689 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:06.399654 2561 patch_prober.go:28] interesting pod/image-registry-d9fdf89c-n4jht container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:06.399842 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:06.399702 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" podUID="c3511d93-8155-477f-a02f-1af85814c63e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:06.539582 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:06.539522 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n5dst" Jul 06 15:28:10.960634 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:10.960591 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:28:10.962933 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:10.962897 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0db5f3cb-d772-4494-be17-f43fc1935a49-metrics-tls\") pod \"dns-default-n5dst\" (UID: \"0db5f3cb-d772-4494-be17-f43fc1935a49\") " pod="openshift-dns/dns-default-n5dst" Jul 06 15:28:11.042127 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:11.042097 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wcqjf\"" Jul 06 15:28:11.050932 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:11.050913 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n5dst" Jul 06 15:28:11.202899 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:11.202871 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n5dst"] Jul 06 15:28:11.205809 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:28:11.205767 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db5f3cb_d772_4494_be17_f43fc1935a49.slice/crio-65cd7a29e19c5888d34a000c4395b9379cb7f18e4a05b05c23053033b3850bb6 WatchSource:0}: Error finding container 65cd7a29e19c5888d34a000c4395b9379cb7f18e4a05b05c23053033b3850bb6: Status 404 returned error can't find the container with id 65cd7a29e19c5888d34a000c4395b9379cb7f18e4a05b05c23053033b3850bb6 Jul 06 15:28:11.560242 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:11.560215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n5dst" event={"ID":"0db5f3cb-d772-4494-be17-f43fc1935a49","Type":"ContainerStarted","Data":"65cd7a29e19c5888d34a000c4395b9379cb7f18e4a05b05c23053033b3850bb6"} Jul 06 15:28:13.570592 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:13.570546 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n5dst" event={"ID":"0db5f3cb-d772-4494-be17-f43fc1935a49","Type":"ContainerStarted","Data":"d197ba96ab32168f3c98937dcbff6618664274efb1f5cdeecc7560861896526d"} Jul 06 15:28:13.570973 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:13.570614 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n5dst" event={"ID":"0db5f3cb-d772-4494-be17-f43fc1935a49","Type":"ContainerStarted","Data":"e60fc8530b8f9f8b4879a6e921ea465e7dbf371667ff41cc3acf4a1e09630306"} Jul 06 15:28:13.570973 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:13.570644 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n5dst" Jul 06 15:28:13.595058 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:13.594926 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n5dst" podStartSLOduration=129.012269339 podStartE2EDuration="2m10.594908307s" totalImagesPullingTime="1.582638968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:13.594694202 +0000 UTC m=+165.383763209" watchObservedRunningTime="2026-07-06 15:28:13.594908307 +0000 UTC m=+165.383977314" Jul 06 15:28:14.383453 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:14.383413 2561 patch_prober.go:28] interesting pod/image-registry-d9fdf89c-n4jht container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:14.383643 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:14.383467 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" podUID="c3511d93-8155-477f-a02f-1af85814c63e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:14.383643 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:14.383518 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:28:14.384090 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:14.384054 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"aab06ee7f713bf7354f6ae7aed18c0dffd64ba3fe1cc846d0b64c0eea0a2aa8d"} pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" containerMessage="Container registry failed liveness probe, will be restarted" Jul 06 15:28:14.387845 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:14.387815 2561 patch_prober.go:28] interesting pod/image-registry-d9fdf89c-n4jht container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:14.387978 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:14.387863 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" podUID="c3511d93-8155-477f-a02f-1af85814c63e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:15.579017 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:15.578982 2561 generic.go:356] "Generic (PLEG): container finished" podID="63f36c0a-f49d-4774-97aa-2350a846ce5d" containerID="d9513f16323e655f6940ba6955c45a6e33aaa9f156544115089c4728b56081da" exitCode=0 Jul 06 15:28:15.579387 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:15.579055 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" event={"ID":"63f36c0a-f49d-4774-97aa-2350a846ce5d","Type":"ContainerDied","Data":"d9513f16323e655f6940ba6955c45a6e33aaa9f156544115089c4728b56081da"} Jul 06 15:28:15.579387 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:15.579350 2561 scope.go:117] "RemoveContainer" containerID="d9513f16323e655f6940ba6955c45a6e33aaa9f156544115089c4728b56081da" Jul 06 15:28:16.585162 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:16.585125 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-nmn2p" event={"ID":"63f36c0a-f49d-4774-97aa-2350a846ce5d","Type":"ContainerStarted","Data":"12f60b7caaff91e87b8989db72f851040b466f28949d7628d84d2a6305e1ac31"} Jul 06 15:28:23.575602 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:23.575516 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n5dst" Jul 06 15:28:24.388151 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:24.388124 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:28:39.404605 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:39.404563 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" podUID="c3511d93-8155-477f-a02f-1af85814c63e" containerName="registry" containerID="cri-o://aab06ee7f713bf7354f6ae7aed18c0dffd64ba3fe1cc846d0b64c0eea0a2aa8d" gracePeriod=30 Jul 06 15:28:39.689292 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:39.689230 2561 generic.go:356] "Generic (PLEG): container finished" podID="6e298480-975b-4afc-b9f4-d71876085a19" containerID="7d7ebd92e407d04c5ce8120df1c440dd39765ec81ba270964d4e7457e7c3b08c" exitCode=0 Jul 06 15:28:39.689407 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:39.689312 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" event={"ID":"6e298480-975b-4afc-b9f4-d71876085a19","Type":"ContainerDied","Data":"7d7ebd92e407d04c5ce8120df1c440dd39765ec81ba270964d4e7457e7c3b08c"} Jul 06 15:28:39.689714 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:39.689697 2561 scope.go:117] "RemoveContainer" containerID="7d7ebd92e407d04c5ce8120df1c440dd39765ec81ba270964d4e7457e7c3b08c" Jul 06 15:28:40.696277 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:40.696243 2561 generic.go:356] "Generic (PLEG): container finished" podID="c3511d93-8155-477f-a02f-1af85814c63e" containerID="aab06ee7f713bf7354f6ae7aed18c0dffd64ba3fe1cc846d0b64c0eea0a2aa8d" exitCode=0 Jul 06 15:28:40.696691 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:40.696400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" event={"ID":"c3511d93-8155-477f-a02f-1af85814c63e","Type":"ContainerDied","Data":"aab06ee7f713bf7354f6ae7aed18c0dffd64ba3fe1cc846d0b64c0eea0a2aa8d"} Jul 06 15:28:40.696691 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:40.696460 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" event={"ID":"c3511d93-8155-477f-a02f-1af85814c63e","Type":"ContainerStarted","Data":"159723aa8c0e7bae47eab40fc8a690c651cd1aecdde78930b77e89a7ce2ce995"} Jul 06 15:28:40.696691 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:40.696491 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:28:40.698479 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:40.698455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-xwm4t" event={"ID":"6e298480-975b-4afc-b9f4-d71876085a19","Type":"ContainerStarted","Data":"ec082ff51b1bb663cfe4fdc374ce7d5c1bce3869c7f21c8939d9013995ba8beb"} Jul 06 15:28:53.282304 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:53.282254 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:53.297948 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:53.297923 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:28:53.762397 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:28:53.762371 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:01.706660 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:01.706631 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d9fdf89c-n4jht" Jul 06 15:29:11.395413 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.395376 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:11.395921 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.395850 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="thanos-sidecar" containerID="cri-o://b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" gracePeriod=600 Jul 06 15:29:11.395921 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.395850 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" gracePeriod=600 Jul 06 15:29:11.395921 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.395884 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="config-reloader" containerID="cri-o://dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" gracePeriod=600 Jul 06 15:29:11.396091 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.395907 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy-web" containerID="cri-o://19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" gracePeriod=600 Jul 06 15:29:11.396091 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.395913 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy" containerID="cri-o://eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" gracePeriod=600 Jul 06 15:29:11.396091 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.395845 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="prometheus" containerID="cri-o://618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" gracePeriod=600 Jul 06 15:29:11.634210 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.634185 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:11.728928 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.728860 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-kube-rbac-proxy\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.728928 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.728889 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-metrics-client-certs\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.728928 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.728913 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-grpc-tls\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729184 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.728943 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-kubelet-serving-ca-bundle\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729184 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.728972 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-tls-assets\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729184 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729001 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-tls\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729184 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729029 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-trusted-ca-bundle\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729184 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729060 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwm62\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-kube-api-access-vwm62\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729460 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729328 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:11.729460 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729390 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729460 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729437 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-web-config\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729664 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729468 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-thanos-prometheus-http-client-file\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729664 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729492 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:11.729664 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729557 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-metrics-client-ca\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729664 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729589 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-0\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729664 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729618 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-1\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729664 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729661 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729965 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729699 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729965 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729742 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config-out\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729965 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729768 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-serving-certs-ca-bundle\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729965 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729800 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-2\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.729965 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.729828 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-db\") pod \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\" (UID: \"f9e03054-ed83-4c36-9a00-6ffc5b0751f7\") " Jul 06 15:29:11.730239 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.730086 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.730876 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.730395 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.730876 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.730756 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:11.731587 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.731563 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:29:11.731915 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.731889 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:29:11.732138 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.732115 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:11.732216 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.732160 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:11.732459 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.732437 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:11.732553 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.732481 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.732685 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.732662 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.733226 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.733122 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config" (OuterVolumeSpecName: "config") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.733226 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.733173 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.733226 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.733199 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.733508 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.733478 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:11.733683 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.733658 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.733834 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.733815 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.734023 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.733998 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config-out" (OuterVolumeSpecName: "config-out") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:29:11.734219 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.734198 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-kube-api-access-vwm62" (OuterVolumeSpecName: "kube-api-access-vwm62") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "kube-api-access-vwm62". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:29:11.734443 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.734425 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.743302 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.743283 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-web-config" (OuterVolumeSpecName: "web-config") pod "f9e03054-ed83-4c36-9a00-6ffc5b0751f7" (UID: "f9e03054-ed83-4c36-9a00-6ffc5b0751f7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:11.822054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822026 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" exitCode=0 Jul 06 15:29:11.822054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822048 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" exitCode=0 Jul 06 15:29:11.822054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822054 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" exitCode=0 Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822060 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" exitCode=0 Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822065 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" exitCode=0 Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822070 2561 generic.go:356] "Generic (PLEG): container finished" podID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" exitCode=0 Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822104 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerDied","Data":"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2"} Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822118 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerDied","Data":"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33"} Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822203 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerDied","Data":"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d"} Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822229 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerDied","Data":"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0"} Jul 06 15:29:11.822243 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822236 2561 scope.go:117] "RemoveContainer" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" Jul 06 15:29:11.822707 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822252 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerDied","Data":"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc"} Jul 06 15:29:11.822707 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822278 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerDied","Data":"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc"} Jul 06 15:29:11.822707 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.822301 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f9e03054-ed83-4c36-9a00-6ffc5b0751f7","Type":"ContainerDied","Data":"31fd227c901440f03b5f2233a09e76daffc2b3d7203e46bce9fe73fe23d9ccde"} Jul 06 15:29:11.834929 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.834904 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-kube-rbac-proxy\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.834929 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.834930 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-metrics-client-certs\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.834941 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-grpc-tls\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.834950 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-tls-assets\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.834958 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.834968 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwm62\" (UniqueName: \"kubernetes.io/projected/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-kube-api-access-vwm62\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.834979 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.834993 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-web-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835006 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835018 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-metrics-client-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835031 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835045 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835058 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835072 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835088 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835085 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-config-out\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835721 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835097 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835721 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835109 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.835721 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.835122 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f9e03054-ed83-4c36-9a00-6ffc5b0751f7-prometheus-k8s-db\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:29:11.837603 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.837580 2561 scope.go:117] "RemoveContainer" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" Jul 06 15:29:11.844549 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.844518 2561 scope.go:117] "RemoveContainer" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" Jul 06 15:29:11.851101 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.851086 2561 scope.go:117] "RemoveContainer" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" Jul 06 15:29:11.854383 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.854365 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:11.858719 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.858695 2561 scope.go:117] "RemoveContainer" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" Jul 06 15:29:11.859507 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.859486 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:11.865656 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.865628 2561 scope.go:117] "RemoveContainer" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" Jul 06 15:29:11.872678 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.872658 2561 scope.go:117] "RemoveContainer" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" Jul 06 15:29:11.878918 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.878903 2561 scope.go:117] "RemoveContainer" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" Jul 06 15:29:11.879208 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:29:11.879189 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": container with ID starting with 1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2 not found: ID does not exist" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" Jul 06 15:29:11.879254 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.879218 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2"} err="failed to get container status \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": rpc error: code = NotFound desc = could not find container \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": container with ID starting with 1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2 not found: ID does not exist" Jul 06 15:29:11.879254 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.879236 2561 scope.go:117] "RemoveContainer" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" Jul 06 15:29:11.879450 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:29:11.879434 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": container with ID starting with eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33 not found: ID does not exist" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" Jul 06 15:29:11.879492 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.879455 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33"} err="failed to get container status \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": rpc error: code = NotFound desc = could not find container \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": container with ID starting with eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33 not found: ID does not exist" Jul 06 15:29:11.879492 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.879471 2561 scope.go:117] "RemoveContainer" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" Jul 06 15:29:11.879706 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:29:11.879689 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": container with ID starting with 19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d not found: ID does not exist" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" Jul 06 15:29:11.879770 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.879714 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d"} err="failed to get container status \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": rpc error: code = NotFound desc = could not find container \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": container with ID starting with 19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d not found: ID does not exist" Jul 06 15:29:11.879770 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.879733 2561 scope.go:117] "RemoveContainer" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" Jul 06 15:29:11.879970 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:29:11.879952 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": container with ID starting with b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0 not found: ID does not exist" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" Jul 06 15:29:11.880011 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.879975 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0"} err="failed to get container status \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": rpc error: code = NotFound desc = could not find container \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": container with ID starting with b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0 not found: ID does not exist" Jul 06 15:29:11.880011 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.879989 2561 scope.go:117] "RemoveContainer" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" Jul 06 15:29:11.880204 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:29:11.880190 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": container with ID starting with dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc not found: ID does not exist" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" Jul 06 15:29:11.880245 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.880208 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc"} err="failed to get container status \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": rpc error: code = NotFound desc = could not find container \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": container with ID starting with dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc not found: ID does not exist" Jul 06 15:29:11.880245 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.880219 2561 scope.go:117] "RemoveContainer" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" Jul 06 15:29:11.880435 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:29:11.880419 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": container with ID starting with 618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc not found: ID does not exist" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" Jul 06 15:29:11.880473 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.880440 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc"} err="failed to get container status \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": rpc error: code = NotFound desc = could not find container \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": container with ID starting with 618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc not found: ID does not exist" Jul 06 15:29:11.880473 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.880455 2561 scope.go:117] "RemoveContainer" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" Jul 06 15:29:11.880677 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:29:11.880659 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": container with ID starting with fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14 not found: ID does not exist" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" Jul 06 15:29:11.880725 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.880683 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14"} err="failed to get container status \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": rpc error: code = NotFound desc = could not find container \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": container with ID starting with fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14 not found: ID does not exist" Jul 06 15:29:11.880725 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.880700 2561 scope.go:117] "RemoveContainer" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" Jul 06 15:29:11.880914 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.880896 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2"} err="failed to get container status \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": rpc error: code = NotFound desc = could not find container \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": container with ID starting with 1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2 not found: ID does not exist" Jul 06 15:29:11.880957 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.880914 2561 scope.go:117] "RemoveContainer" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" Jul 06 15:29:11.881153 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.881134 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33"} err="failed to get container status \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": rpc error: code = NotFound desc = could not find container \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": container with ID starting with eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33 not found: ID does not exist" Jul 06 15:29:11.881224 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.881155 2561 scope.go:117] "RemoveContainer" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" Jul 06 15:29:11.881374 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.881355 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d"} err="failed to get container status \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": rpc error: code = NotFound desc = could not find container \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": container with ID starting with 19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d not found: ID does not exist" Jul 06 15:29:11.881415 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.881377 2561 scope.go:117] "RemoveContainer" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" Jul 06 15:29:11.881655 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.881625 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0"} err="failed to get container status \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": rpc error: code = NotFound desc = could not find container \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": container with ID starting with b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0 not found: ID does not exist" Jul 06 15:29:11.881710 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.881658 2561 scope.go:117] "RemoveContainer" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" Jul 06 15:29:11.881896 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.881872 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc"} err="failed to get container status \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": rpc error: code = NotFound desc = could not find container \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": container with ID starting with dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc not found: ID does not exist" Jul 06 15:29:11.881949 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.881897 2561 scope.go:117] "RemoveContainer" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" Jul 06 15:29:11.882104 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.882086 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc"} err="failed to get container status \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": rpc error: code = NotFound desc = could not find container \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": container with ID starting with 618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc not found: ID does not exist" Jul 06 15:29:11.882162 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.882105 2561 scope.go:117] "RemoveContainer" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" Jul 06 15:29:11.882355 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.882339 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14"} err="failed to get container status \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": rpc error: code = NotFound desc = could not find container \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": container with ID starting with fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14 not found: ID does not exist" Jul 06 15:29:11.882401 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.882356 2561 scope.go:117] "RemoveContainer" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" Jul 06 15:29:11.882587 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.882569 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2"} err="failed to get container status \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": rpc error: code = NotFound desc = could not find container \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": container with ID starting with 1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2 not found: ID does not exist" Jul 06 15:29:11.882658 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.882587 2561 scope.go:117] "RemoveContainer" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" Jul 06 15:29:11.882823 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.882803 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33"} err="failed to get container status \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": rpc error: code = NotFound desc = could not find container \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": container with ID starting with eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33 not found: ID does not exist" Jul 06 15:29:11.882874 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.882824 2561 scope.go:117] "RemoveContainer" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" Jul 06 15:29:11.883033 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.883011 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d"} err="failed to get container status \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": rpc error: code = NotFound desc = could not find container \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": container with ID starting with 19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d not found: ID does not exist" Jul 06 15:29:11.883033 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.883033 2561 scope.go:117] "RemoveContainer" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" Jul 06 15:29:11.883258 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.883236 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0"} err="failed to get container status \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": rpc error: code = NotFound desc = could not find container \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": container with ID starting with b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0 not found: ID does not exist" Jul 06 15:29:11.883311 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.883259 2561 scope.go:117] "RemoveContainer" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" Jul 06 15:29:11.883569 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.883546 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc"} err="failed to get container status \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": rpc error: code = NotFound desc = could not find container \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": container with ID starting with dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc not found: ID does not exist" Jul 06 15:29:11.883569 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.883568 2561 scope.go:117] "RemoveContainer" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" Jul 06 15:29:11.883799 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.883783 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc"} err="failed to get container status \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": rpc error: code = NotFound desc = could not find container \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": container with ID starting with 618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc not found: ID does not exist" Jul 06 15:29:11.883846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.883799 2561 scope.go:117] "RemoveContainer" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" Jul 06 15:29:11.884068 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.884050 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14"} err="failed to get container status \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": rpc error: code = NotFound desc = could not find container \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": container with ID starting with fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14 not found: ID does not exist" Jul 06 15:29:11.884122 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.884069 2561 scope.go:117] "RemoveContainer" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" Jul 06 15:29:11.884335 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.884310 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2"} err="failed to get container status \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": rpc error: code = NotFound desc = could not find container \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": container with ID starting with 1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2 not found: ID does not exist" Jul 06 15:29:11.884395 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.884335 2561 scope.go:117] "RemoveContainer" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" Jul 06 15:29:11.884581 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.884560 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33"} err="failed to get container status \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": rpc error: code = NotFound desc = could not find container \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": container with ID starting with eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33 not found: ID does not exist" Jul 06 15:29:11.884628 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.884582 2561 scope.go:117] "RemoveContainer" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" Jul 06 15:29:11.884802 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.884783 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d"} err="failed to get container status \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": rpc error: code = NotFound desc = could not find container \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": container with ID starting with 19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d not found: ID does not exist" Jul 06 15:29:11.884841 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.884803 2561 scope.go:117] "RemoveContainer" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" Jul 06 15:29:11.885029 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885007 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0"} err="failed to get container status \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": rpc error: code = NotFound desc = could not find container \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": container with ID starting with b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0 not found: ID does not exist" Jul 06 15:29:11.885081 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885029 2561 scope.go:117] "RemoveContainer" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" Jul 06 15:29:11.885219 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885198 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc"} err="failed to get container status \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": rpc error: code = NotFound desc = could not find container \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": container with ID starting with dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc not found: ID does not exist" Jul 06 15:29:11.885219 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885218 2561 scope.go:117] "RemoveContainer" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" Jul 06 15:29:11.885434 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885418 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc"} err="failed to get container status \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": rpc error: code = NotFound desc = could not find container \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": container with ID starting with 618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc not found: ID does not exist" Jul 06 15:29:11.885496 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885435 2561 scope.go:117] "RemoveContainer" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" Jul 06 15:29:11.885675 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885657 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14"} err="failed to get container status \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": rpc error: code = NotFound desc = could not find container \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": container with ID starting with fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14 not found: ID does not exist" Jul 06 15:29:11.885745 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885676 2561 scope.go:117] "RemoveContainer" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" Jul 06 15:29:11.885905 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885886 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2"} err="failed to get container status \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": rpc error: code = NotFound desc = could not find container \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": container with ID starting with 1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2 not found: ID does not exist" Jul 06 15:29:11.885943 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.885906 2561 scope.go:117] "RemoveContainer" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" Jul 06 15:29:11.886103 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886086 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33"} err="failed to get container status \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": rpc error: code = NotFound desc = could not find container \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": container with ID starting with eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33 not found: ID does not exist" Jul 06 15:29:11.886156 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886104 2561 scope.go:117] "RemoveContainer" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" Jul 06 15:29:11.886317 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886300 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d"} err="failed to get container status \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": rpc error: code = NotFound desc = could not find container \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": container with ID starting with 19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d not found: ID does not exist" Jul 06 15:29:11.886362 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886317 2561 scope.go:117] "RemoveContainer" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" Jul 06 15:29:11.886528 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886511 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0"} err="failed to get container status \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": rpc error: code = NotFound desc = could not find container \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": container with ID starting with b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0 not found: ID does not exist" Jul 06 15:29:11.886677 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886528 2561 scope.go:117] "RemoveContainer" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" Jul 06 15:29:11.886753 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886736 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc"} err="failed to get container status \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": rpc error: code = NotFound desc = could not find container \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": container with ID starting with dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc not found: ID does not exist" Jul 06 15:29:11.886791 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886753 2561 scope.go:117] "RemoveContainer" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" Jul 06 15:29:11.886979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886963 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc"} err="failed to get container status \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": rpc error: code = NotFound desc = could not find container \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": container with ID starting with 618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc not found: ID does not exist" Jul 06 15:29:11.886979 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.886978 2561 scope.go:117] "RemoveContainer" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" Jul 06 15:29:11.887190 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.887167 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14"} err="failed to get container status \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": rpc error: code = NotFound desc = could not find container \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": container with ID starting with fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14 not found: ID does not exist" Jul 06 15:29:11.887190 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.887181 2561 scope.go:117] "RemoveContainer" containerID="1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2" Jul 06 15:29:11.887403 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.887385 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2"} err="failed to get container status \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": rpc error: code = NotFound desc = could not find container \"1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2\": container with ID starting with 1669a27a4672e12b28b8d2f005a77d42890b2107325889bba3ffc68fa22205e2 not found: ID does not exist" Jul 06 15:29:11.887403 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.887402 2561 scope.go:117] "RemoveContainer" containerID="eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33" Jul 06 15:29:11.887642 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.887621 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33"} err="failed to get container status \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": rpc error: code = NotFound desc = could not find container \"eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33\": container with ID starting with eebe4b9766681e8205b1f5e0bc9fda8beb1a0c985aeeb398ec93c2494ff20d33 not found: ID does not exist" Jul 06 15:29:11.887722 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.887644 2561 scope.go:117] "RemoveContainer" containerID="19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d" Jul 06 15:29:11.887864 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.887848 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d"} err="failed to get container status \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": rpc error: code = NotFound desc = could not find container \"19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d\": container with ID starting with 19e1ee4bbdd8e4a8ca81b295198515fad9e90cc2b9b553039b594dfd747d6a5d not found: ID does not exist" Jul 06 15:29:11.887909 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.887864 2561 scope.go:117] "RemoveContainer" containerID="b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0" Jul 06 15:29:11.888073 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.888055 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0"} err="failed to get container status \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": rpc error: code = NotFound desc = could not find container \"b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0\": container with ID starting with b13e4fd6b76876b1257e2bfadf36a707e13d68f8c1efdb15e5a762be111f02d0 not found: ID does not exist" Jul 06 15:29:11.888143 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.888075 2561 scope.go:117] "RemoveContainer" containerID="dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc" Jul 06 15:29:11.888306 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.888290 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc"} err="failed to get container status \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": rpc error: code = NotFound desc = could not find container \"dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc\": container with ID starting with dc2027c5a0dbcadb55f2833cb9e86d901229994126cbc8dd2582c209fa5bfdbc not found: ID does not exist" Jul 06 15:29:11.888355 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.888306 2561 scope.go:117] "RemoveContainer" containerID="618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc" Jul 06 15:29:11.888485 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.888471 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc"} err="failed to get container status \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": rpc error: code = NotFound desc = could not find container \"618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc\": container with ID starting with 618a40ebf3f670fbdb0af2fd622b933742500e9aa57f87513ebc6ca0b30e47cc not found: ID does not exist" Jul 06 15:29:11.888528 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.888486 2561 scope.go:117] "RemoveContainer" containerID="fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14" Jul 06 15:29:11.888695 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.888669 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14"} err="failed to get container status \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": rpc error: code = NotFound desc = could not find container \"fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14\": container with ID starting with fd816f59030541849675f5d6f3bded37a82aa2c75f6ca52ff6ae83fb177a9c14 not found: ID does not exist" Jul 06 15:29:11.893482 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893462 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:11.893802 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893789 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="config-reloader" Jul 06 15:29:11.893846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893805 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="config-reloader" Jul 06 15:29:11.893846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893812 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy" Jul 06 15:29:11.893846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893818 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy" Jul 06 15:29:11.893846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893827 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="init-config-reloader" Jul 06 15:29:11.893846 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893833 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="init-config-reloader" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893849 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy-web" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893856 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy-web" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893867 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy-thanos" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893873 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy-thanos" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893879 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="thanos-sidecar" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893884 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="thanos-sidecar" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893891 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="prometheus" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893896 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="prometheus" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893939 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="config-reloader" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893950 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy-thanos" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893957 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="thanos-sidecar" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893962 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="prometheus" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893968 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy" Jul 06 15:29:11.893990 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.893976 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" containerName="kube-rbac-proxy-web" Jul 06 15:29:11.899098 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.899081 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:11.901793 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.901764 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 15:29:11.901899 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.901883 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 15:29:11.902054 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902030 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 15:29:11.902153 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902030 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 15:29:11.902153 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902064 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 15:29:11.902297 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902281 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 15:29:11.902573 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902439 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 15:29:11.902573 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902489 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-lxpj8\"" Jul 06 15:29:11.902573 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902494 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 15:29:11.902791 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902555 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fegqutlm46i2m\"" Jul 06 15:29:11.902791 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902610 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 15:29:11.902902 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902826 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 15:29:11.902902 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.902874 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 15:29:11.903200 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.903183 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 15:29:11.903277 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.903266 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 15:29:11.904611 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.904593 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 15:29:11.909140 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.909123 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 15:29:11.918940 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:11.918920 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:12.036137 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036079 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036137 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036309 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036309 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036309 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-config\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036309 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036256 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036309 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036279 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036309 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036302 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036364 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036383 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036431 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6959f42-734f-4847-9f84-34b738dbf9ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036548 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6959f42-734f-4847-9f84-34b738dbf9ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.036637 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.036621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96bzh\" (UniqueName: \"kubernetes.io/projected/c6959f42-734f-4847-9f84-34b738dbf9ed-kube-api-access-96bzh\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137454 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137454 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137458 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137520 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-config\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137554 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137640 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137688 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.137715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137713 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.138508 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6959f42-734f-4847-9f84-34b738dbf9ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.138508 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.138508 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.138508 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137810 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.138508 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.137974 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.138508 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.138251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.140762 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.140529 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.140762 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.140569 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.140762 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.140653 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.140762 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.140669 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-web-config\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141008 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.140842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6959f42-734f-4847-9f84-34b738dbf9ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141008 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.140888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141008 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.140919 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141008 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.140951 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96bzh\" (UniqueName: \"kubernetes.io/projected/c6959f42-734f-4847-9f84-34b738dbf9ed-kube-api-access-96bzh\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141185 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.141024 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141185 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.141050 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141185 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.141087 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141185 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.141101 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c6959f42-734f-4847-9f84-34b738dbf9ed-config-out\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141185 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.141117 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141744 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.141722 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.141838 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.141720 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-config\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.142000 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.141970 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.142105 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.142021 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c6959f42-734f-4847-9f84-34b738dbf9ed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.143218 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.143192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c6959f42-734f-4847-9f84-34b738dbf9ed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.143292 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.143238 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.143475 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.143451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.143509 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.143497 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c6959f42-734f-4847-9f84-34b738dbf9ed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.150168 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.150151 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96bzh\" (UniqueName: \"kubernetes.io/projected/c6959f42-734f-4847-9f84-34b738dbf9ed-kube-api-access-96bzh\") pod \"prometheus-k8s-0\" (UID: \"c6959f42-734f-4847-9f84-34b738dbf9ed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.209234 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.209212 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:29:12.354091 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.354006 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 15:29:12.355995 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:29:12.355976 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6959f42_734f_4847_9f84_34b738dbf9ed.slice/crio-6245d4e7b18dc34093e74738d38d94240e6f16f6db7ad7693d093253fbfda772 WatchSource:0}: Error finding container 6245d4e7b18dc34093e74738d38d94240e6f16f6db7ad7693d093253fbfda772: Status 404 returned error can't find the container with id 6245d4e7b18dc34093e74738d38d94240e6f16f6db7ad7693d093253fbfda772 Jul 06 15:29:12.720346 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.720265 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e03054-ed83-4c36-9a00-6ffc5b0751f7" path="/var/lib/kubelet/pods/f9e03054-ed83-4c36-9a00-6ffc5b0751f7/volumes" Jul 06 15:29:12.827706 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.827675 2561 generic.go:356] "Generic (PLEG): container finished" podID="c6959f42-734f-4847-9f84-34b738dbf9ed" containerID="7adb49add1ce3ce028ad72e857736962940ab3fca4025906b99ce9cac69b1f15" exitCode=0 Jul 06 15:29:12.827898 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.827753 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6959f42-734f-4847-9f84-34b738dbf9ed","Type":"ContainerDied","Data":"7adb49add1ce3ce028ad72e857736962940ab3fca4025906b99ce9cac69b1f15"} Jul 06 15:29:12.827898 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:12.827836 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6959f42-734f-4847-9f84-34b738dbf9ed","Type":"ContainerStarted","Data":"6245d4e7b18dc34093e74738d38d94240e6f16f6db7ad7693d093253fbfda772"} Jul 06 15:29:13.835867 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:13.835833 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6959f42-734f-4847-9f84-34b738dbf9ed","Type":"ContainerStarted","Data":"61cc9a0af381c215eee672f220904728f334e2c0ffd2fa2d5ac2d283a2d53210"} Jul 06 15:29:13.836273 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:13.835914 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6959f42-734f-4847-9f84-34b738dbf9ed","Type":"ContainerStarted","Data":"ef4493caef432d0f74d8f9b66402d2488854913d1760b7bc3224a5baa8db10cf"} Jul 06 15:29:13.836273 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:13.835941 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6959f42-734f-4847-9f84-34b738dbf9ed","Type":"ContainerStarted","Data":"9490227a81db0b25c3966ebf09dd7c9a8bca13c64eab9bcaffabfe870eff462a"} Jul 06 15:29:13.836273 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:13.835970 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6959f42-734f-4847-9f84-34b738dbf9ed","Type":"ContainerStarted","Data":"472ebc7e2d9a2defa82184eb3f97e68162890e7f5c7994b7b756eb547c0c668c"} Jul 06 15:29:13.836273 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:13.835994 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6959f42-734f-4847-9f84-34b738dbf9ed","Type":"ContainerStarted","Data":"3d2c1d3621088b61ec7c8dce70b21b4a9c9f1f831612b9a287d5799f218d2fde"} Jul 06 15:29:13.836273 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:13.836015 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c6959f42-734f-4847-9f84-34b738dbf9ed","Type":"ContainerStarted","Data":"a85e51d8602797da1aaa5959719d336699317e68272be631ea791751cfda1997"} Jul 06 15:29:13.868388 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:13.868340 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.861815208 podStartE2EDuration="2.868321128s" totalImagesPullingTime="0s" totalInitContainerRuntime="6.50592ms" isStatefulPod=false podCreationTimestamp="2026-07-06 15:29:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:29:13.866706046 +0000 UTC m=+225.655775052" watchObservedRunningTime="2026-07-06 15:29:13.868321128 +0000 UTC m=+225.657390135" Jul 06 15:29:17.209507 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:29:17.209476 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:30:12.210178 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:30:12.210142 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:30:12.225187 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:30:12.225167 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:30:13.073059 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:30:13.073034 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 15:30:28.556208 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:30:28.556176 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/2.log" Jul 06 15:30:28.562992 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:30:28.562971 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/2.log" Jul 06 15:30:28.564133 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:30:28.564112 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:30:28.567619 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:30:28.567602 2561 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 15:30:28.570450 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:30:28.570432 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:35:28.582288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:28.582261 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/2.log" Jul 06 15:35:28.587764 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:28.587745 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/2.log" Jul 06 15:35:28.589676 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:28.589659 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:35:28.594577 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:28.594561 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:35:36.092299 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.092266 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-nx4ns"] Jul 06 15:35:36.095562 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.095530 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-nx4ns" Jul 06 15:35:36.097987 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.097962 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 15:35:36.098101 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.097962 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 15:35:36.098101 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.097974 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-l95l7\"" Jul 06 15:35:36.098615 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.098599 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 15:35:36.104694 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.104673 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-nx4ns"] Jul 06 15:35:36.146077 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.146054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbwgv\" (UniqueName: \"kubernetes.io/projected/5107f143-2442-434d-8d2c-52011cc2c99b-kube-api-access-wbwgv\") pod \"s3-init-nx4ns\" (UID: \"5107f143-2442-434d-8d2c-52011cc2c99b\") " pod="kserve/s3-init-nx4ns" Jul 06 15:35:36.146163 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.146107 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5107f143-2442-434d-8d2c-52011cc2c99b-model-cache\") pod \"s3-init-nx4ns\" (UID: \"5107f143-2442-434d-8d2c-52011cc2c99b\") " pod="kserve/s3-init-nx4ns" Jul 06 15:35:36.246832 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.246805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbwgv\" (UniqueName: \"kubernetes.io/projected/5107f143-2442-434d-8d2c-52011cc2c99b-kube-api-access-wbwgv\") pod \"s3-init-nx4ns\" (UID: \"5107f143-2442-434d-8d2c-52011cc2c99b\") " pod="kserve/s3-init-nx4ns" Jul 06 15:35:36.246959 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.246891 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5107f143-2442-434d-8d2c-52011cc2c99b-model-cache\") pod \"s3-init-nx4ns\" (UID: \"5107f143-2442-434d-8d2c-52011cc2c99b\") " pod="kserve/s3-init-nx4ns" Jul 06 15:35:36.247234 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.247214 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5107f143-2442-434d-8d2c-52011cc2c99b-model-cache\") pod \"s3-init-nx4ns\" (UID: \"5107f143-2442-434d-8d2c-52011cc2c99b\") " pod="kserve/s3-init-nx4ns" Jul 06 15:35:36.256150 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.256131 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbwgv\" (UniqueName: \"kubernetes.io/projected/5107f143-2442-434d-8d2c-52011cc2c99b-kube-api-access-wbwgv\") pod \"s3-init-nx4ns\" (UID: \"5107f143-2442-434d-8d2c-52011cc2c99b\") " pod="kserve/s3-init-nx4ns" Jul 06 15:35:36.414812 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.414748 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-nx4ns" Jul 06 15:35:36.541114 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.541084 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-nx4ns"] Jul 06 15:35:36.543838 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:35:36.543815 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5107f143_2442_434d_8d2c_52011cc2c99b.slice/crio-7eb6094f2c67e1231a1311f6f41beb54454f3dbf7a937f84fa8fba66c859aec6 WatchSource:0}: Error finding container 7eb6094f2c67e1231a1311f6f41beb54454f3dbf7a937f84fa8fba66c859aec6: Status 404 returned error can't find the container with id 7eb6094f2c67e1231a1311f6f41beb54454f3dbf7a937f84fa8fba66c859aec6 Jul 06 15:35:36.545715 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:36.545698 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:35:37.270339 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:37.270306 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-nx4ns" event={"ID":"5107f143-2442-434d-8d2c-52011cc2c99b","Type":"ContainerStarted","Data":"7eb6094f2c67e1231a1311f6f41beb54454f3dbf7a937f84fa8fba66c859aec6"} Jul 06 15:35:42.292499 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:42.292422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-nx4ns" event={"ID":"5107f143-2442-434d-8d2c-52011cc2c99b","Type":"ContainerStarted","Data":"e07d2f4c80c18122dc4f6c5576f81cc162b7b33a032c560b677cbe394cc262de"} Jul 06 15:35:44.301816 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:44.301782 2561 generic.go:356] "Generic (PLEG): container finished" podID="5107f143-2442-434d-8d2c-52011cc2c99b" containerID="e07d2f4c80c18122dc4f6c5576f81cc162b7b33a032c560b677cbe394cc262de" exitCode=0 Jul 06 15:35:44.302168 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:44.301834 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-nx4ns" event={"ID":"5107f143-2442-434d-8d2c-52011cc2c99b","Type":"ContainerDied","Data":"e07d2f4c80c18122dc4f6c5576f81cc162b7b33a032c560b677cbe394cc262de"} Jul 06 15:35:49.327500 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:49.327422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-nx4ns" event={"ID":"5107f143-2442-434d-8d2c-52011cc2c99b","Type":"ContainerStarted","Data":"9712a91b628d4912f6f729d1f4f08fb6e50c1b4085ec9dc69b13ba499c5aa5de"} Jul 06 15:35:49.344989 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:35:49.344946 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-nx4ns" podStartSLOduration=1.9031832199999998 podStartE2EDuration="13.344933636s" totalImagesPullingTime="9.974292392s" totalInitContainerRuntime="1.467458024s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:35:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:35:49.344257103 +0000 UTC m=+621.133326114" watchObservedRunningTime="2026-07-06 15:35:49.344933636 +0000 UTC m=+621.134002642" Jul 06 15:36:54.579591 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:54.579550 2561 generic.go:356] "Generic (PLEG): container finished" podID="5107f143-2442-434d-8d2c-52011cc2c99b" containerID="9712a91b628d4912f6f729d1f4f08fb6e50c1b4085ec9dc69b13ba499c5aa5de" exitCode=0 Jul 06 15:36:54.579993 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:54.579610 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-nx4ns" event={"ID":"5107f143-2442-434d-8d2c-52011cc2c99b","Type":"ContainerDied","Data":"9712a91b628d4912f6f729d1f4f08fb6e50c1b4085ec9dc69b13ba499c5aa5de"} Jul 06 15:36:55.701279 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:55.701253 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-nx4ns" Jul 06 15:36:55.846944 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:55.846884 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5107f143-2442-434d-8d2c-52011cc2c99b-model-cache\") pod \"5107f143-2442-434d-8d2c-52011cc2c99b\" (UID: \"5107f143-2442-434d-8d2c-52011cc2c99b\") " Jul 06 15:36:55.847060 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:55.846949 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbwgv\" (UniqueName: \"kubernetes.io/projected/5107f143-2442-434d-8d2c-52011cc2c99b-kube-api-access-wbwgv\") pod \"5107f143-2442-434d-8d2c-52011cc2c99b\" (UID: \"5107f143-2442-434d-8d2c-52011cc2c99b\") " Jul 06 15:36:55.849051 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:55.849020 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5107f143-2442-434d-8d2c-52011cc2c99b-kube-api-access-wbwgv" (OuterVolumeSpecName: "kube-api-access-wbwgv") pod "5107f143-2442-434d-8d2c-52011cc2c99b" (UID: "5107f143-2442-434d-8d2c-52011cc2c99b"). InnerVolumeSpecName "kube-api-access-wbwgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:36:55.865762 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:55.865733 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5107f143-2442-434d-8d2c-52011cc2c99b-model-cache" (OuterVolumeSpecName: "model-cache") pod "5107f143-2442-434d-8d2c-52011cc2c99b" (UID: "5107f143-2442-434d-8d2c-52011cc2c99b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:36:55.948260 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:55.948223 2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5107f143-2442-434d-8d2c-52011cc2c99b-model-cache\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:36:55.948260 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:55.948258 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbwgv\" (UniqueName: \"kubernetes.io/projected/5107f143-2442-434d-8d2c-52011cc2c99b-kube-api-access-wbwgv\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:36:56.588812 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:56.588779 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-nx4ns" event={"ID":"5107f143-2442-434d-8d2c-52011cc2c99b","Type":"ContainerDied","Data":"7eb6094f2c67e1231a1311f6f41beb54454f3dbf7a937f84fa8fba66c859aec6"} Jul 06 15:36:56.588812 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:56.588816 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eb6094f2c67e1231a1311f6f41beb54454f3dbf7a937f84fa8fba66c859aec6" Jul 06 15:36:56.589011 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:36:56.588818 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-nx4ns" Jul 06 15:37:02.982183 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.982148 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xr7z6/must-gather-bzq7s"] Jul 06 15:37:02.982592 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.982438 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5107f143-2442-434d-8d2c-52011cc2c99b" containerName="download-hf-model" Jul 06 15:37:02.982592 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.982449 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5107f143-2442-434d-8d2c-52011cc2c99b" containerName="download-hf-model" Jul 06 15:37:02.982592 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.982457 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5107f143-2442-434d-8d2c-52011cc2c99b" containerName="s3-init" Jul 06 15:37:02.982592 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.982462 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5107f143-2442-434d-8d2c-52011cc2c99b" containerName="s3-init" Jul 06 15:37:02.982592 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.982516 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5107f143-2442-434d-8d2c-52011cc2c99b" containerName="s3-init" Jul 06 15:37:02.985658 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.985637 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:02.988050 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.988006 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xr7z6\"/\"kube-root-ca.crt\"" Jul 06 15:37:02.988050 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.988039 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xr7z6\"/\"openshift-service-ca.crt\"" Jul 06 15:37:02.988413 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.988398 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xr7z6\"/\"default-dockercfg-9ttdx\"" Jul 06 15:37:02.995269 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:02.995250 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xr7z6/must-gather-bzq7s"] Jul 06 15:37:03.101114 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.101081 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59wph\" (UniqueName: \"kubernetes.io/projected/a6bb0710-0c95-48b6-aa98-4f71958d1267-kube-api-access-59wph\") pod \"must-gather-bzq7s\" (UID: \"a6bb0710-0c95-48b6-aa98-4f71958d1267\") " pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:03.101285 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.101134 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6bb0710-0c95-48b6-aa98-4f71958d1267-must-gather-output\") pod \"must-gather-bzq7s\" (UID: \"a6bb0710-0c95-48b6-aa98-4f71958d1267\") " pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:03.202006 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.201975 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59wph\" (UniqueName: \"kubernetes.io/projected/a6bb0710-0c95-48b6-aa98-4f71958d1267-kube-api-access-59wph\") pod \"must-gather-bzq7s\" (UID: \"a6bb0710-0c95-48b6-aa98-4f71958d1267\") " pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:03.202150 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.202012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6bb0710-0c95-48b6-aa98-4f71958d1267-must-gather-output\") pod \"must-gather-bzq7s\" (UID: \"a6bb0710-0c95-48b6-aa98-4f71958d1267\") " pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:03.202327 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.202312 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6bb0710-0c95-48b6-aa98-4f71958d1267-must-gather-output\") pod \"must-gather-bzq7s\" (UID: \"a6bb0710-0c95-48b6-aa98-4f71958d1267\") " pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:03.211764 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.211734 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59wph\" (UniqueName: \"kubernetes.io/projected/a6bb0710-0c95-48b6-aa98-4f71958d1267-kube-api-access-59wph\") pod \"must-gather-bzq7s\" (UID: \"a6bb0710-0c95-48b6-aa98-4f71958d1267\") " pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:03.312014 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.311950 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:03.447161 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.447052 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xr7z6/must-gather-bzq7s"] Jul 06 15:37:03.615421 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:03.615395 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" event={"ID":"a6bb0710-0c95-48b6-aa98-4f71958d1267","Type":"ContainerStarted","Data":"f5b0b7a8eb7efec79bd6062523036e3468bafdd86011d8f6835e163e70b1c7e3"} Jul 06 15:37:09.647338 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:09.647305 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" event={"ID":"a6bb0710-0c95-48b6-aa98-4f71958d1267","Type":"ContainerStarted","Data":"43b0b389128adb374ea3fdf5c8a7d2314bd65a287b7d5d54aac83eb719f331df"} Jul 06 15:37:09.647758 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:09.647353 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" event={"ID":"a6bb0710-0c95-48b6-aa98-4f71958d1267","Type":"ContainerStarted","Data":"a3314faee8ee2f9d3617bab8c130b95ffa3abcc01cbdfb826c2c419741bc19db"} Jul 06 15:37:09.670814 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:09.670768 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" podStartSLOduration=1.811294621 podStartE2EDuration="7.670753028s" totalImagesPullingTime="5.859458407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:09.669136716 +0000 UTC m=+701.458205724" watchObservedRunningTime="2026-07-06 15:37:09.670753028 +0000 UTC m=+701.459822034" Jul 06 15:37:28.733398 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:28.733365 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerID="a3314faee8ee2f9d3617bab8c130b95ffa3abcc01cbdfb826c2c419741bc19db" exitCode=0 Jul 06 15:37:28.733861 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:28.733406 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" event={"ID":"a6bb0710-0c95-48b6-aa98-4f71958d1267","Type":"ContainerDied","Data":"a3314faee8ee2f9d3617bab8c130b95ffa3abcc01cbdfb826c2c419741bc19db"} Jul 06 15:37:28.733861 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:28.733705 2561 scope.go:117] "RemoveContainer" containerID="a3314faee8ee2f9d3617bab8c130b95ffa3abcc01cbdfb826c2c419741bc19db" Jul 06 15:37:29.189233 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:29.189205 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xr7z6_must-gather-bzq7s_a6bb0710-0c95-48b6-aa98-4f71958d1267/gather/0.log" Jul 06 15:37:33.035784 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:33.035703 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kp5vs_6277c056-1e8b-4601-8715-9a8860e666c5/global-pull-secret-syncer/0.log" Jul 06 15:37:33.163293 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:33.163264 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-84rs8_10be061c-3b18-4684-bfe1-82c7766627b5/konnectivity-agent/0.log" Jul 06 15:37:33.231053 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:33.231027 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-213.ec2.internal_d32b06a52fe2c12e89c7b42a8cc8f0b1/haproxy/0.log" Jul 06 15:37:34.532628 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.532590 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xr7z6/must-gather-bzq7s"] Jul 06 15:37:34.533096 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.532795 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" podUID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerName="copy" containerID="cri-o://43b0b389128adb374ea3fdf5c8a7d2314bd65a287b7d5d54aac83eb719f331df" gracePeriod=2 Jul 06 15:37:34.539645 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.539615 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xr7z6/must-gather-bzq7s"] Jul 06 15:37:34.540801 ip-10-0-128-213 kubenswrapper[2561]: E0706 15:37:34.540764 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a6bb0710-0c95-48b6-aa98-4f71958d1267\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-xr7z6\"/\"must-gather-bzq7s\": pods \"must-gather-bzq7s\" not found" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:34.757011 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.756987 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xr7z6_must-gather-bzq7s_a6bb0710-0c95-48b6-aa98-4f71958d1267/copy/0.log" Jul 06 15:37:34.757361 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.757337 2561 generic.go:356] "Generic (PLEG): container finished" podID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerID="43b0b389128adb374ea3fdf5c8a7d2314bd65a287b7d5d54aac83eb719f331df" exitCode=143 Jul 06 15:37:34.757448 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.757406 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5b0b7a8eb7efec79bd6062523036e3468bafdd86011d8f6835e163e70b1c7e3" Jul 06 15:37:34.761992 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.761974 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xr7z6_must-gather-bzq7s_a6bb0710-0c95-48b6-aa98-4f71958d1267/copy/0.log" Jul 06 15:37:34.763403 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.763388 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:34.855824 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.855802 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59wph\" (UniqueName: \"kubernetes.io/projected/a6bb0710-0c95-48b6-aa98-4f71958d1267-kube-api-access-59wph\") pod \"a6bb0710-0c95-48b6-aa98-4f71958d1267\" (UID: \"a6bb0710-0c95-48b6-aa98-4f71958d1267\") " Jul 06 15:37:34.855913 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.855852 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6bb0710-0c95-48b6-aa98-4f71958d1267-must-gather-output\") pod \"a6bb0710-0c95-48b6-aa98-4f71958d1267\" (UID: \"a6bb0710-0c95-48b6-aa98-4f71958d1267\") " Jul 06 15:37:34.857209 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.857190 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6bb0710-0c95-48b6-aa98-4f71958d1267-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "a6bb0710-0c95-48b6-aa98-4f71958d1267" (UID: "a6bb0710-0c95-48b6-aa98-4f71958d1267"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:37:34.857878 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.857848 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bb0710-0c95-48b6-aa98-4f71958d1267-kube-api-access-59wph" (OuterVolumeSpecName: "kube-api-access-59wph") pod "a6bb0710-0c95-48b6-aa98-4f71958d1267" (UID: "a6bb0710-0c95-48b6-aa98-4f71958d1267"). InnerVolumeSpecName "kube-api-access-59wph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:37:34.956316 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.956294 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59wph\" (UniqueName: \"kubernetes.io/projected/a6bb0710-0c95-48b6-aa98-4f71958d1267-kube-api-access-59wph\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:37:34.956316 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:34.956313 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a6bb0710-0c95-48b6-aa98-4f71958d1267-must-gather-output\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 06 15:37:35.761097 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:35.761070 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xr7z6/must-gather-bzq7s" Jul 06 15:37:36.720908 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:36.720874 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6bb0710-0c95-48b6-aa98-4f71958d1267" path="/var/lib/kubelet/pods/a6bb0710-0c95-48b6-aa98-4f71958d1267/volumes" Jul 06 15:37:37.280425 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.280398 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kqq8p_10b0cb33-7846-4d1b-bb3e-a681a4944c30/kube-state-metrics/0.log" Jul 06 15:37:37.308127 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.308106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kqq8p_10b0cb33-7846-4d1b-bb3e-a681a4944c30/kube-rbac-proxy-main/0.log" Jul 06 15:37:37.346495 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.346473 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-kqq8p_10b0cb33-7846-4d1b-bb3e-a681a4944c30/kube-rbac-proxy-self/0.log" Jul 06 15:37:37.480892 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.480825 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fr2tc_6450ad14-4080-431a-a2ec-903bc4e08807/node-exporter/0.log" Jul 06 15:37:37.509997 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.509977 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fr2tc_6450ad14-4080-431a-a2ec-903bc4e08807/kube-rbac-proxy/0.log" Jul 06 15:37:37.540334 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.540317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fr2tc_6450ad14-4080-431a-a2ec-903bc4e08807/init-textfile/0.log" Jul 06 15:37:37.886555 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.886507 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6959f42-734f-4847-9f84-34b738dbf9ed/prometheus/0.log" Jul 06 15:37:37.918682 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.918659 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6959f42-734f-4847-9f84-34b738dbf9ed/config-reloader/0.log" Jul 06 15:37:37.954826 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.954806 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6959f42-734f-4847-9f84-34b738dbf9ed/thanos-sidecar/0.log" Jul 06 15:37:37.987515 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:37.987493 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6959f42-734f-4847-9f84-34b738dbf9ed/kube-rbac-proxy-web/0.log" Jul 06 15:37:38.022369 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.022334 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6959f42-734f-4847-9f84-34b738dbf9ed/kube-rbac-proxy/0.log" Jul 06 15:37:38.055291 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.055268 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6959f42-734f-4847-9f84-34b738dbf9ed/kube-rbac-proxy-thanos/0.log" Jul 06 15:37:38.086051 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.086024 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c6959f42-734f-4847-9f84-34b738dbf9ed/init-config-reloader/0.log" Jul 06 15:37:38.191048 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.191026 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-gj8sm_aae0522d-9bfb-46ef-8836-47386ea203e1/prometheus-operator-admission-webhook/0.log" Jul 06 15:37:38.331633 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.331616 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ddf58566d-7rwdl_877e8b72-8a15-4451-b61f-0cdb729f4767/thanos-query/0.log" Jul 06 15:37:38.360821 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.360762 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ddf58566d-7rwdl_877e8b72-8a15-4451-b61f-0cdb729f4767/kube-rbac-proxy-web/0.log" Jul 06 15:37:38.389360 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.389338 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ddf58566d-7rwdl_877e8b72-8a15-4451-b61f-0cdb729f4767/kube-rbac-proxy/0.log" Jul 06 15:37:38.442167 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.442149 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ddf58566d-7rwdl_877e8b72-8a15-4451-b61f-0cdb729f4767/prom-label-proxy/0.log" Jul 06 15:37:38.475272 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.475245 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ddf58566d-7rwdl_877e8b72-8a15-4451-b61f-0cdb729f4767/kube-rbac-proxy-rules/0.log" Jul 06 15:37:38.507312 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:38.507291 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-ddf58566d-7rwdl_877e8b72-8a15-4451-b61f-0cdb729f4767/kube-rbac-proxy-metrics/0.log" Jul 06 15:37:40.340307 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.340280 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/2.log" Jul 06 15:37:40.347720 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.347694 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-hh9xt_3ec71521-02e1-4028-9c7e-5f6840c46af8/console-operator/3.log" Jul 06 15:37:40.667955 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.667881 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972"] Jul 06 15:37:40.668182 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.668171 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerName="gather" Jul 06 15:37:40.668223 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.668184 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerName="gather" Jul 06 15:37:40.668223 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.668193 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerName="copy" Jul 06 15:37:40.668223 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.668199 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerName="copy" Jul 06 15:37:40.668314 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.668263 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerName="copy" Jul 06 15:37:40.668314 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.668274 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bb0710-0c95-48b6-aa98-4f71958d1267" containerName="gather" Jul 06 15:37:40.671449 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.671430 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.673438 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.673421 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gmfmg\"/\"openshift-service-ca.crt\"" Jul 06 15:37:40.673708 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.673691 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gmfmg\"/\"kube-root-ca.crt\"" Jul 06 15:37:40.673808 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.673770 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gmfmg\"/\"default-dockercfg-tjp5d\"" Jul 06 15:37:40.680575 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.680547 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972"] Jul 06 15:37:40.698629 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.698608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-podres\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.698722 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.698643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wscb\" (UniqueName: \"kubernetes.io/projected/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-kube-api-access-7wscb\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.698722 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.698668 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-sys\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.698722 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.698691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-proc\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.698828 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.698729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-lib-modules\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799167 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-podres\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wscb\" (UniqueName: \"kubernetes.io/projected/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-kube-api-access-7wscb\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799201 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-sys\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-proc\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799263 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-lib-modules\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799288 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799279 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-sys\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799449 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799304 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-podres\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799449 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-proc\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.799449 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.799364 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-lib-modules\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.807972 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.807945 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wscb\" (UniqueName: \"kubernetes.io/projected/bb55cd7c-2937-4d76-af5b-1f7b7b82a686-kube-api-access-7wscb\") pod \"perf-node-gather-daemonset-w5972\" (UID: \"bb55cd7c-2937-4d76-af5b-1f7b7b82a686\") " pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:40.981782 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:40.981726 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:41.108395 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:41.108281 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972"] Jul 06 15:37:41.111335 ip-10-0-128-213 kubenswrapper[2561]: W0706 15:37:41.111305 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbb55cd7c_2937_4d76_af5b_1f7b7b82a686.slice/crio-c1a896d17946b1a1df77336e39f4089760ede7935ac3bd060f2e881f48d4f224 WatchSource:0}: Error finding container c1a896d17946b1a1df77336e39f4089760ede7935ac3bd060f2e881f48d4f224: Status 404 returned error can't find the container with id c1a896d17946b1a1df77336e39f4089760ede7935ac3bd060f2e881f48d4f224 Jul 06 15:37:41.783965 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:41.783932 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" event={"ID":"bb55cd7c-2937-4d76-af5b-1f7b7b82a686","Type":"ContainerStarted","Data":"1834054a84fba0865e650f3cdb4843c88e6b883bc617974429feff74a892ee03"} Jul 06 15:37:41.784402 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:41.783989 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" event={"ID":"bb55cd7c-2937-4d76-af5b-1f7b7b82a686","Type":"ContainerStarted","Data":"c1a896d17946b1a1df77336e39f4089760ede7935ac3bd060f2e881f48d4f224"} Jul 06 15:37:41.784402 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:41.784047 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:41.802928 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:41.802885 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" podStartSLOduration=1.802868661 podStartE2EDuration="1.802868661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:41.802652019 +0000 UTC m=+733.591721028" watchObservedRunningTime="2026-07-06 15:37:41.802868661 +0000 UTC m=+733.591937669" Jul 06 15:37:42.482852 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:42.482818 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n5dst_0db5f3cb-d772-4494-be17-f43fc1935a49/dns/0.log" Jul 06 15:37:42.514851 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:42.514827 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n5dst_0db5f3cb-d772-4494-be17-f43fc1935a49/kube-rbac-proxy/0.log" Jul 06 15:37:42.605087 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:42.605066 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vf6rv_95ac59e6-67c8-4d98-96a1-1c51db82cf3f/dns-node-resolver/0.log" Jul 06 15:37:43.097419 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:43.097387 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d9fdf89c-n4jht_c3511d93-8155-477f-a02f-1af85814c63e/registry/0.log" Jul 06 15:37:43.101702 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:43.101664 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-d9fdf89c-n4jht_c3511d93-8155-477f-a02f-1af85814c63e/registry/1.log" Jul 06 15:37:43.202783 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:43.202757 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jz4xk_b42039fd-c943-44c3-a5bd-c795168f76e0/node-ca/0.log" Jul 06 15:37:44.029869 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:44.029837 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f8b69dd9f-dsvfp_86af66de-2278-4ec5-9aee-4690e2b83310/router/0.log" Jul 06 15:37:44.445107 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:44.445070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l5ns2_aea71b93-7d9c-4e69-8bd2-433234c6bcb0/serve-healthcheck-canary/0.log" Jul 06 15:37:45.112758 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:45.112731 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9jx9_bcf57e8f-db9e-43fc-9c55-16f60b7930d2/kube-rbac-proxy/0.log" Jul 06 15:37:45.142410 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:45.142390 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9jx9_bcf57e8f-db9e-43fc-9c55-16f60b7930d2/exporter/0.log" Jul 06 15:37:45.171894 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:45.171861 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l9jx9_bcf57e8f-db9e-43fc-9c55-16f60b7930d2/extractor/0.log" Jul 06 15:37:47.405509 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:47.405474 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-nx4ns_5107f143-2442-434d-8d2c-52011cc2c99b/s3-init/0.log" Jul 06 15:37:47.426816 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:47.426792 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-nx4ns_5107f143-2442-434d-8d2c-52011cc2c99b/download-hf-model/0.log" Jul 06 15:37:47.798377 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:47.798308 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gmfmg/perf-node-gather-daemonset-w5972" Jul 06 15:37:52.351638 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:52.351603 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xwm4t_6e298480-975b-4afc-b9f4-d71876085a19/kube-storage-version-migrator-operator/1.log" Jul 06 15:37:52.353295 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:52.353255 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-xwm4t_6e298480-975b-4afc-b9f4-d71876085a19/kube-storage-version-migrator-operator/0.log" Jul 06 15:37:53.373938 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:53.373909 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fc89x_76784ea9-d8df-41ff-b9c7-dfff7084ec6c/kube-multus-additional-cni-plugins/0.log" Jul 06 15:37:53.400730 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:53.400710 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fc89x_76784ea9-d8df-41ff-b9c7-dfff7084ec6c/egress-router-binary-copy/0.log" Jul 06 15:37:53.427050 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:53.427028 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fc89x_76784ea9-d8df-41ff-b9c7-dfff7084ec6c/cni-plugins/0.log" Jul 06 15:37:53.457887 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:53.457866 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fc89x_76784ea9-d8df-41ff-b9c7-dfff7084ec6c/bond-cni-plugin/0.log" Jul 06 15:37:53.484819 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:53.484797 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fc89x_76784ea9-d8df-41ff-b9c7-dfff7084ec6c/routeoverride-cni/0.log" Jul 06 15:37:53.514925 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:53.514905 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fc89x_76784ea9-d8df-41ff-b9c7-dfff7084ec6c/whereabouts-cni-bincopy/0.log" Jul 06 15:37:53.542264 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:53.542242 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fc89x_76784ea9-d8df-41ff-b9c7-dfff7084ec6c/whereabouts-cni/0.log" Jul 06 15:37:54.030133 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:54.030105 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mm4b4_d22ebd99-bbd6-4b5c-9372-134d3299e2f5/kube-multus/0.log" Jul 06 15:37:54.185069 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:54.185035 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bchrm_fd1b5d06-7c5e-4573-ab93-793c9895ebfd/network-metrics-daemon/0.log" Jul 06 15:37:54.243298 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:54.243267 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bchrm_fd1b5d06-7c5e-4573-ab93-793c9895ebfd/kube-rbac-proxy/0.log" Jul 06 15:37:55.190700 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.190666 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-controller/0.log" Jul 06 15:37:55.222363 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.222341 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/0.log" Jul 06 15:37:55.222501 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.222376 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovn-acl-logging/1.log" Jul 06 15:37:55.249353 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.249328 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/kube-rbac-proxy-node/0.log" Jul 06 15:37:55.277155 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.277113 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 15:37:55.304224 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.304204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/northd/0.log" Jul 06 15:37:55.332084 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.332065 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/nbdb/0.log" Jul 06 15:37:55.359349 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.359331 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/sbdb/0.log" Jul 06 15:37:55.419621 ip-10-0-128-213 kubenswrapper[2561]: I0706 15:37:55.419597 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7szf4_b1682aa2-dba0-4750-a417-fc1242edec08/ovnkube-controller/0.log"