Jul 09 15:26:25.967302 ip-10-0-130-178 systemd[1]: Starting Kubernetes Kubelet... Jul 09 15:26:26.370106 ip-10-0-130-178 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:26.370106 ip-10-0-130-178 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 15:26:26.370106 ip-10-0-130-178 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:26.370106 ip-10-0-130-178 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 15:26:26.370106 ip-10-0-130-178 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:26.372093 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.371998 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 15:26:26.375756 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375730 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:26.375756 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375751 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:26.375756 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375757 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:26.375756 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375761 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375765 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375770 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375774 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375781 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375786 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375791 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375797 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375801 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375806 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375810 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375815 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375819 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375823 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375827 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375834 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375839 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375843 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:26.376042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375849 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375854 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375858 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375862 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375866 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375870 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375874 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375878 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375883 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375887 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375892 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375896 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375900 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375904 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375908 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375913 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375935 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375941 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375944 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375948 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:26.376763 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375953 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375957 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375961 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375966 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375969 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375974 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375978 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375982 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375986 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375991 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375995 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.375998 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376002 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376006 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376011 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376015 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376019 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376024 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376028 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376032 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:26.377599 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376037 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376041 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376045 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376048 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376052 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376056 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376062 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376067 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376072 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376076 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376081 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376086 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376090 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376094 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376098 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376102 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376106 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376111 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376115 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376119 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:26.378481 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376124 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376129 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376133 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376137 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376141 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376145 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376149 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376154 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376158 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376162 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376166 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376171 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376176 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376180 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376185 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376189 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376193 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.376197 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377380 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:26.379353 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377390 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377394 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377399 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377404 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377411 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377416 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377420 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377424 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377428 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377432 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377436 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377441 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377445 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377449 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377453 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377457 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377461 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377466 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377469 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:26.380173 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377474 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377481 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377487 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377492 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377497 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377502 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377507 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377511 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377515 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377519 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377523 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377527 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377532 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377539 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377543 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377547 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377551 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377555 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377560 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377564 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:26.380821 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377568 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377572 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377577 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377581 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377585 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377589 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377595 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377600 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377605 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377609 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377614 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377618 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377622 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377627 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377633 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377637 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377642 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377646 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377651 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:26.381502 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377655 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377659 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377663 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377668 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377672 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377676 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377681 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377686 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377690 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377694 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377698 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377702 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377707 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377711 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377715 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377719 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377723 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377727 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377732 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377739 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:26.382061 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377744 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377749 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377753 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377757 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377761 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377766 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377770 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377775 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377779 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377783 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377788 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377792 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377796 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377800 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377804 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377808 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377812 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377816 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377820 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.377824 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:26.382712 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378468 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378476 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378480 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378485 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378490 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378494 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378499 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378503 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378507 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378511 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378516 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378520 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378525 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378529 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378533 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378537 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378541 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378545 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378549 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378554 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:26.383236 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378558 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378563 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378568 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378572 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378576 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378580 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378584 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378588 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378592 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378596 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378600 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378605 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378609 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378613 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378617 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378621 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378626 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378630 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378634 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378639 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:26.383819 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378643 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378647 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378651 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378655 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378660 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378664 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378668 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378672 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378676 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378680 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378684 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378688 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378692 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378707 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378711 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378716 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378720 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378724 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378728 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378732 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:26.384357 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378736 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378741 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378745 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378750 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378754 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378758 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378762 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378766 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378770 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378774 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378782 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378790 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378795 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378802 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378807 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378812 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378816 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378820 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:26.384856 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378825 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378829 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378833 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378837 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378841 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378846 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378850 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378854 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378860 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378865 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378869 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378874 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378878 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378885 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378888 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378893 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378898 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378902 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378907 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378911 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:26.385341 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.378933 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379040 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379059 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379068 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379075 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379083 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379088 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379095 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379102 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379107 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379111 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379117 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379123 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379128 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379133 2564 flags.go:64] FLAG: --cgroup-root="" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379138 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379142 2564 flags.go:64] FLAG: --client-ca-file="" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379147 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379152 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379161 2564 flags.go:64] FLAG: --cluster-domain="" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379166 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379171 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379176 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379181 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 15:26:26.385841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379187 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379195 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379200 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379206 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379210 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379215 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379219 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379225 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379229 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379240 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379245 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379250 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379254 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379259 2564 flags.go:64] FLAG: --enable-server="true" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379265 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379272 2564 flags.go:64] FLAG: --event-burst="100" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379277 2564 flags.go:64] FLAG: --event-qps="50" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379283 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379287 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379293 2564 flags.go:64] FLAG: --eviction-hard="" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379299 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379304 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379308 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379313 2564 flags.go:64] FLAG: --eviction-soft="" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379318 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 15:26:26.386432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379322 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379327 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379332 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379337 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379342 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379347 2564 flags.go:64] FLAG: --feature-gates="" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379353 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379357 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379364 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379369 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379373 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379379 2564 flags.go:64] FLAG: --help="false" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379383 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379388 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379393 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379398 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379404 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379409 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379414 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379419 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379424 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379428 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379434 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379440 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 15:26:26.387146 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379448 2564 flags.go:64] FLAG: --kube-reserved="" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379453 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379457 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379462 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379467 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379471 2564 flags.go:64] FLAG: --lock-file="" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379476 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379481 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379486 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379495 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379499 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379504 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379508 2564 flags.go:64] FLAG: --logging-format="text" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379513 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379519 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379524 2564 flags.go:64] FLAG: --manifest-url="" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379529 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379536 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379541 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379547 2564 flags.go:64] FLAG: --max-pods="110" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379552 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379557 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379562 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379566 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379571 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 15:26:26.387739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379576 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379581 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379592 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379598 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379602 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379607 2564 flags.go:64] FLAG: --pod-cidr="" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379613 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379622 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379628 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379633 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379638 2564 flags.go:64] FLAG: --port="10250" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379643 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379648 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0af1549da7a2d460b" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379653 2564 flags.go:64] FLAG: --qos-reserved="" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379658 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379663 2564 flags.go:64] FLAG: --register-node="true" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379667 2564 flags.go:64] FLAG: --register-with-taints="" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379673 2564 flags.go:64] FLAG: --registry-burst="10" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379678 2564 flags.go:64] FLAG: --registry-qps="5" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379682 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379687 2564 flags.go:64] FLAG: --reserved-memory="" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379693 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379698 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379703 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379708 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 15:26:26.388400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379712 2564 flags.go:64] FLAG: --runonce="false" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379717 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379722 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379727 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379732 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379736 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379741 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379745 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379750 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379755 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379760 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379765 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379769 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379774 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379780 2564 flags.go:64] FLAG: --system-cgroups="" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379786 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379795 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379800 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379805 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379812 2564 flags.go:64] FLAG: --tls-min-version="" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379817 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379821 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379826 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379831 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379835 2564 flags.go:64] FLAG: --v="2" Jul 09 15:26:26.389032 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379842 2564 flags.go:64] FLAG: --version="false" Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379849 2564 flags.go:64] FLAG: --vmodule="" Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379855 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.379861 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380101 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380111 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380117 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380122 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380127 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380131 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380136 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380141 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380145 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380149 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380153 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380157 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380162 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380166 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380169 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380173 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:26.389695 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380177 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380181 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380188 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380192 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380196 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380200 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380204 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380208 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380216 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380221 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380226 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380231 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380235 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380239 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380243 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380247 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380252 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380256 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380261 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:26.390441 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380265 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380269 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380274 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380278 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380282 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380286 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380290 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380294 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380298 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380302 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380306 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380311 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380315 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380320 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380323 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380330 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380336 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380340 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380345 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380349 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:26.391045 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380352 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380357 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380361 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380365 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380369 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380373 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380377 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380381 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380385 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380391 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380396 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380400 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380404 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380411 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380416 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380421 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380426 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380430 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380434 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:26.391541 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380438 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380442 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380446 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380450 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380454 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380458 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380463 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380467 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380472 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380477 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380482 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380486 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380490 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380494 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380498 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380503 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380507 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380511 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380515 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380519 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:26.392036 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380523 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380527 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380534 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380538 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.380542 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.381211 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.388496 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.388514 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.388535 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.388541 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388597 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388603 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388606 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388610 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:26.392526 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388613 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388616 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388619 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388621 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388624 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388627 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388629 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388632 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388635 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388637 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388640 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388642 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388645 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388647 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388650 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388653 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388655 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388657 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388660 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388662 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:26.392881 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388665 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388667 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388669 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388672 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388675 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388679 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388682 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388684 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388687 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388689 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388692 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388694 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388697 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388699 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388701 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388704 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388706 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388710 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388714 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:26.393381 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388717 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388720 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388722 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388726 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388728 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388731 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388735 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388738 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388741 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388744 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388746 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388749 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388752 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388754 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388757 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388759 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388762 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388764 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388767 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:26.393836 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388772 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388776 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388779 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388782 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388784 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388787 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388789 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388792 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388794 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388798 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388802 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388804 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388807 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388810 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388812 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388814 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388817 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388819 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388821 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:26.394452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388824 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388827 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388829 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388832 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388835 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388837 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388840 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388842 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388845 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388847 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388850 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388852 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388855 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388857 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388860 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388863 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388865 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:26.394957 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.388868 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.388873 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389007 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389012 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389015 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389018 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389021 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389024 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389027 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389030 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389033 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389035 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389038 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389041 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389044 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:26.395367 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389047 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389049 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389052 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389054 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389058 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389060 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389063 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389065 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389068 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389070 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389073 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389075 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389078 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389082 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389086 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389090 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389094 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389096 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389099 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389102 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:26.395735 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389104 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389107 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389109 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389111 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389114 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389116 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389119 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389122 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389125 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389128 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389131 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389133 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389135 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389138 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389141 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389143 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389146 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389149 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389152 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:26.396240 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389154 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389157 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389159 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389162 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389164 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389167 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389170 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389172 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389175 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389178 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389180 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389183 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389185 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389187 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389190 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389192 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389194 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389197 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389199 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389202 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:26.396699 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389204 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389208 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389211 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389214 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389216 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389219 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389221 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389224 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389227 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389229 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389232 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389234 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389237 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389239 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389242 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389244 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389246 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389249 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389251 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:26.397188 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389254 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389256 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389259 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389262 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389264 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389267 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389269 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:26.389271 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.389276 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.391162 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.394386 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.395895 2564 server.go:1019] "Starting client certificate rotation" Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.396009 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:26:26.397682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.396051 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:26:26.398433 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.398418 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:26:26.402683 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.402662 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:26:26.410709 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.410683 2564 log.go:25] "Validated CRI v1 runtime API" Jul 09 15:26:26.412826 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.412805 2564 log.go:25] "Validated CRI v1 image API" Jul 09 15:26:26.413709 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.413695 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 15:26:26.416191 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.416159 2564 fs.go:135] Filesystem UUIDs: map[5cb49a59-2bc2-459e-8e37-dd4eda5340f5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 92aee58f-666b-440b-aff2-c3a0a36404bc:/dev/nvme0n1p3] Jul 09 15:26:26.416266 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.416189 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 15:26:26.421108 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.420998 2564 manager.go:216] Machine: {Timestamp:2026-07-09 15:26:26.41970493 +0000 UTC m=+0.337404558 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098094 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2266d62ce1b6c0f09738800b5aae25 SystemUUID:ec2266d6-2ce1-b6c0-f097-38800b5aae25 BootID:f2cfa380-d330-44f8-859c-c2a7428bd59f Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:88:19:e6:1d:6b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:88:19:e6:1d:6b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:1e:4e:8b:19:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 15:26:26.421108 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.421099 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 15:26:26.421251 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.421186 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 15:26:26.425659 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.425634 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 15:26:26.425814 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.425661 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-178.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 15:26:26.426523 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.426505 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 15:26:26.426605 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.426531 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 15:26:26.426605 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.426544 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:26:26.427708 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.427269 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:26:26.429095 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.429080 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 15:26:26.431903 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.431890 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:26:26.432231 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432221 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 15:26:26.432279 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432253 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 09 15:26:26.432279 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432264 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 15:26:26.432279 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432275 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 15:26:26.432356 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432285 2564 kubelet.go:398] "Adding apiserver pod source" Jul 09 15:26:26.432356 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432293 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 15:26:26.432671 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432658 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:26:26.432745 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432678 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:26:26.432745 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.432659 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:26:26.434643 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.434627 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 15:26:26.436057 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436041 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 15:26:26.436132 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436079 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 15:26:26.436763 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436750 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 15:26:26.436824 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436770 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 15:26:26.436824 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436779 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 15:26:26.436824 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436787 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 15:26:26.436824 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436799 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 15:26:26.436824 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436807 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 15:26:26.436824 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436819 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 15:26:26.437049 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436827 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 15:26:26.437049 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436837 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 15:26:26.437049 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436847 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 15:26:26.437049 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436860 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 15:26:26.437049 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.436869 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 15:26:26.438182 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.438171 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 15:26:26.438240 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.438185 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 15:26:26.441504 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.441487 2564 server.go:1268] "Started kubelet" Jul 09 15:26:26.441634 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.441608 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 15:26:26.441798 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.441584 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 15:26:26.441863 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.441847 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 15:26:26.442474 ip-10-0-130-178 systemd[1]: Started Kubernetes Kubelet. Jul 09 15:26:26.443185 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.443161 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 15:26:26.443604 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.443592 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 09 15:26:26.446029 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.446003 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-178.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 15:26:26.446029 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.446024 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 15:26:26.446171 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.446055 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 15:26:26.446693 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.446676 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 15:26:26.447067 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.446156 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-178.ec2.internal.18c0a88f6f66096a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-178.ec2.internal,UID:ip-10-0-130-178.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-178.ec2.internal,},FirstTimestamp:2026-07-09 15:26:26.44146417 +0000 UTC m=+0.359163797,LastTimestamp:2026-07-09 15:26:26.44146417 +0000 UTC m=+0.359163797,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-178.ec2.internal,}" Jul 09 15:26:26.448220 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.448206 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 15:26:26.448220 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.448213 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 15:26:26.448333 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.448314 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:26.448933 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.448896 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 15:26:26.448933 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.448897 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 15:26:26.449069 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.448942 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 15:26:26.449121 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.449066 2564 factory.go:55] Registering systemd factory Jul 09 15:26:26.449121 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.449082 2564 factory.go:223] Registration of the systemd container factory successfully Jul 09 15:26:26.450201 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.450182 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 09 15:26:26.450201 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.450198 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 09 15:26:26.450405 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.450375 2564 factory.go:153] Registering CRI-O factory Jul 09 15:26:26.450405 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.450396 2564 factory.go:223] Registration of the crio container factory successfully Jul 09 15:26:26.450510 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.450447 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 15:26:26.450510 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.450475 2564 factory.go:103] Registering Raw factory Jul 09 15:26:26.450510 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.450492 2564 manager.go:1196] Started watching for new ooms in manager Jul 09 15:26:26.451488 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.451469 2564 manager.go:349] Starting recovery of all containers Jul 09 15:26:26.456906 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.456880 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sxfps" Jul 09 15:26:26.458394 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.458195 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-178.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 15:26:26.458394 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.458309 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 15:26:26.462834 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.462819 2564 manager.go:354] Recovery completed Jul 09 15:26:26.464008 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.463978 2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 09 15:26:26.465377 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.465359 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sxfps" Jul 09 15:26:26.467464 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.467451 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:26.469525 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.469507 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:26.469574 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.469546 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:26.469574 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.469560 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:26.470115 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.470085 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 15:26:26.470115 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.470101 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:26.470115 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.470101 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 15:26:26.470297 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.470140 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:26:26.470787 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.470771 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:26.470862 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.470799 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:26.470862 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.470815 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:26.471197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.471179 2564 policy_none.go:49] "None policy: Start" Jul 09 15:26:26.471197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.471198 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 15:26:26.471303 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.471212 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 15:26:26.472097 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.472086 2564 policy_none.go:47] "Start" Jul 09 15:26:26.503591 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.503563 2564 manager.go:337] "Starting Device Plugin manager" Jul 09 15:26:26.503732 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.503605 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 15:26:26.503732 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.503617 2564 server.go:87] "Starting device plugin registration server" Jul 09 15:26:26.503933 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.503906 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 15:26:26.504007 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.503942 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 15:26:26.504058 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.504034 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 15:26:26.504128 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.504110 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 15:26:26.504128 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.504122 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 15:26:26.504676 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.504655 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 15:26:26.504743 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.504713 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:26.604129 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.604080 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:26.605164 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.605111 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:26.605164 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.605141 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:26.605164 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.605150 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:26.605287 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.605178 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.624612 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.624541 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.624612 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.624569 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-178.ec2.internal\": node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:26.668994 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.668942 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:26.672841 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.672811 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 15:26:26.674102 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.674083 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 15:26:26.674203 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.674118 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 15:26:26.674203 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.674137 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 15:26:26.674203 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.674166 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 15:26:26.676533 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.676509 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:26.769654 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.769613 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:26.774793 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.774765 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal"] Jul 09 15:26:26.774889 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.774857 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:26.776011 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.775994 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:26.776104 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.776026 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:26.776104 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.776041 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:26.777331 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.777319 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:26.777471 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.777457 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.777518 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.777489 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:26.778127 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.778104 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:26.778127 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.778131 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:26.778270 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.778142 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:26.778270 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.778111 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:26.778270 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.778207 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:26.778270 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.778219 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:26.779290 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.779276 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.779341 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.779308 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:26.780041 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.780026 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:26.780151 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.780050 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:26.780151 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.780059 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:26.810763 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.810735 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-178.ec2.internal\" not found" node="ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.815364 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.815348 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-178.ec2.internal\" not found" node="ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.852671 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.852644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e5861fb7c10128f501f80d1aa143731-config\") pod \"kube-apiserver-proxy-ip-10-0-130-178.ec2.internal\" (UID: \"7e5861fb7c10128f501f80d1aa143731\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.852760 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.852675 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d4f556a589233c47c4fdd68c9b2838a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"2d4f556a589233c47c4fdd68c9b2838a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.852760 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.852695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d4f556a589233c47c4fdd68c9b2838a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"2d4f556a589233c47c4fdd68c9b2838a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.870582 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.870558 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:26.953383 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.953314 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d4f556a589233c47c4fdd68c9b2838a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"2d4f556a589233c47c4fdd68c9b2838a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.953383 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.953346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d4f556a589233c47c4fdd68c9b2838a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"2d4f556a589233c47c4fdd68c9b2838a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.953383 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.953365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e5861fb7c10128f501f80d1aa143731-config\") pod \"kube-apiserver-proxy-ip-10-0-130-178.ec2.internal\" (UID: \"7e5861fb7c10128f501f80d1aa143731\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.953539 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.953405 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e5861fb7c10128f501f80d1aa143731-config\") pod \"kube-apiserver-proxy-ip-10-0-130-178.ec2.internal\" (UID: \"7e5861fb7c10128f501f80d1aa143731\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.953539 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.953415 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2d4f556a589233c47c4fdd68c9b2838a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"2d4f556a589233c47c4fdd68c9b2838a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.953539 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:26.953452 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d4f556a589233c47c4fdd68c9b2838a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal\" (UID: \"2d4f556a589233c47c4fdd68c9b2838a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:26.970643 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:26.970617 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:27.071336 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.071288 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:27.112481 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.112451 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:27.119001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.118983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" Jul 09 15:26:27.172319 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.172280 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-178.ec2.internal\" not found" Jul 09 15:26:27.257150 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.257091 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:27.349031 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.348998 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" Jul 09 15:26:27.363129 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.363100 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:26:27.365514 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.365499 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" Jul 09 15:26:27.376938 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.376903 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:26:27.395055 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.395026 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 15:26:27.395177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.395161 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 15:26:27.395236 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.395206 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 15:26:27.433303 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.433271 2564 apiserver.go:52] "Watching apiserver" Jul 09 15:26:27.448467 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.448444 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 15:26:27.449497 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.449480 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 15:26:27.450951 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.450932 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-df9fw","openshift-multus/network-metrics-daemon-hcp4j","openshift-network-diagnostics/network-check-target-pqfh9","openshift-network-operator/iptables-alerter-cbz6m","openshift-ovn-kubernetes/ovnkube-node-9p68n","kube-system/konnectivity-agent-wqfxp","kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d","openshift-cluster-node-tuning-operator/tuned-zm45z","openshift-dns/node-resolver-d7mnj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal","openshift-multus/multus-additional-cni-plugins-7ksf9","openshift-multus/multus-h7h7h","kube-system/global-pull-secret-syncer-rfwbj"] Jul 09 15:26:27.452133 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.452118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.453114 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.453099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.454024 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.454009 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:27.454109 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.454073 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:27.454389 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.454374 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v7bjn\"" Jul 09 15:26:27.454860 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.454847 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 15:26:27.454964 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.454948 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.455777 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.455753 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 15:26:27.455777 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.455768 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 15:26:27.455932 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.455763 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 15:26:27.455932 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.455846 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 15:26:27.455932 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.455859 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 15:26:27.456065 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.456041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.456266 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.456249 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kg8jv\"" Jul 09 15:26:27.456714 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.456698 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:26:27.457008 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.456992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:27.458143 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.457815 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 15:26:27.458143 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.457839 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7zgjn\"" Jul 09 15:26:27.459655 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.458146 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 15:26:27.459655 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.458810 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 15:26:27.459655 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.458825 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 15:26:27.459655 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.459566 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 15:26:27.459655 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.459641 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zdkwv\"" Jul 09 15:26:27.459655 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.459653 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 15:26:27.459880 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.459629 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 15:26:27.460030 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.459779 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 15:26:27.460106 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.460092 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-btbkq\"" Jul 09 15:26:27.460156 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.460133 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 15:26:27.460208 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.460155 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:26:27.460208 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.460186 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 15:26:27.460328 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.460316 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.461312 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.461301 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.461373 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.461358 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:27.462313 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.462299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:27.462370 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.462358 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 15:26:27.462416 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.462354 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:27.462599 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.462585 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:26:27.462929 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.462892 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f9nfq\"" Jul 09 15:26:27.463358 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.463347 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.464395 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.464381 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.465207 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.465190 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 15:26:27.465351 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.465313 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 15:26:27.465470 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.465453 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 15:26:27.465545 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.465490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.465545 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.465507 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gh52c\"" Jul 09 15:26:27.466176 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.466162 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bsmnw\"" Jul 09 15:26:27.466363 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.466352 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 15:26:27.466434 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.466421 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 15:26:27.466474 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.466436 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 15:26:27.467462 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.467451 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 15:26:27.467690 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.467672 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k949c\"" Jul 09 15:26:27.468373 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.468335 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 15:26:27.468700 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.468657 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 15:21:26 +0000 UTC" deadline="2028-01-30 19:53:27.370058761 +0000 UTC" Jul 09 15:26:27.468755 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.468700 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13684h26m59.901361102s" Jul 09 15:26:27.487591 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.487569 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-77l7b" Jul 09 15:26:27.495725 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.495707 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-77l7b" Jul 09 15:26:27.549784 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.549763 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 15:26:27.556294 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556269 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-system-cni-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.556432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556300 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.556432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556318 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-daemon-config\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.556432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73cd0a0a-8a14-4b2d-b803-009b834ead47-iptables-alerter-script\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.556432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556361 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6kcp\" (UniqueName: \"kubernetes.io/projected/570094ba-60a1-43c6-b3b0-02964cbe6af0-kube-api-access-r6kcp\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:27.556432 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556384 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-cni-bin\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556429 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-cni-netd\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-hostroot\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-modprobe-d\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysctl-conf\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-etc-kubernetes\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556578 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cni-binary-copy\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-tmp-dir\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-cni-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556645 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-netns\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556689 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cnibin\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556714 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-os-release\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.556761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556749 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-hosts-file\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovnkube-config\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556828 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-kubelet-config\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556843 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-node-log\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556881 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-env-overrides\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556898 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovn-node-metrics-cert\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556940 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovnkube-script-lib\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556956 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysctl-d\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.556979 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-os-release\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557000 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-conf-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557027 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-kubelet\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557046 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-run\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-sys\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557081 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-var-lib-kubelet\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.557364 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557102 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-host\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557123 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-device-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-cni-multus\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557166 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-etc-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557192 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60d6509b-c5f0-4e3d-9c2d-f109110c6098-tmp\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28bc495a-fda4-427f-ad3d-0dd1486047c3-konnectivity-ca\") pod \"konnectivity-agent-wqfxp\" (UID: \"28bc495a-fda4-427f-ad3d-0dd1486047c3\") " pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557218 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557243 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-systemd-units\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qht5w\" (UniqueName: \"kubernetes.io/projected/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-kube-api-access-qht5w\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557272 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-lib-modules\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgtbd\" (UniqueName: \"kubernetes.io/projected/60d6509b-c5f0-4e3d-9c2d-f109110c6098-kube-api-access-qgtbd\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557311 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-cni-binary-copy\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-socket-dir-parent\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557341 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-cni-bin\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73cd0a0a-8a14-4b2d-b803-009b834ead47-host-slash\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.558124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-system-cni-dir\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkdnm\" (UniqueName: \"kubernetes.io/projected/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-kube-api-access-pkdnm\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557425 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-slash\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557450 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzmw9\" (UniqueName: \"kubernetes.io/projected/73cd0a0a-8a14-4b2d-b803-009b834ead47-kube-api-access-pzmw9\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28bc495a-fda4-427f-ad3d-0dd1486047c3-agent-certs\") pod \"konnectivity-agent-wqfxp\" (UID: \"28bc495a-fda4-427f-ad3d-0dd1486047c3\") " pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysconfig\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-systemd\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557520 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-sys-fs\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557539 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-multus-certs\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557556 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-ovn\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557576 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-k8s-cni-cncf-io\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557591 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-socket-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557603 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-registration-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-kubelet\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557636 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557659 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-run-netns\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.558735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557680 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-systemd\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557693 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-log-socket\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmxn2\" (UniqueName: \"kubernetes.io/projected/2178f066-0930-4f3f-9bee-0101bc68ea4d-kube-api-access-xmxn2\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557756 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-dbus\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-tuned\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557780 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf35a2fc-9f61-4605-a428-033b174483ce-host\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557807 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf35a2fc-9f61-4605-a428-033b174483ce-serviceca\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557820 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-cnibin\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557834 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qnd\" (UniqueName: \"kubernetes.io/projected/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-kube-api-access-55qnd\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqsn7\" (UniqueName: \"kubernetes.io/projected/f1d10af5-0153-41c0-8cca-a7c6ad1252da-kube-api-access-xqsn7\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-var-lib-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2tg2\" (UniqueName: \"kubernetes.io/projected/cf35a2fc-9f61-4605-a428-033b174483ce-kube-api-access-s2tg2\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557930 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.559333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.557962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-kubernetes\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.637254 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.636582 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5861fb7c10128f501f80d1aa143731.slice/crio-8bc7962546a39b7e2742a050d7a74202011bc268fd7103710cb9e506bcf56d95 WatchSource:0}: Error finding container 8bc7962546a39b7e2742a050d7a74202011bc268fd7103710cb9e506bcf56d95: Status 404 returned error can't find the container with id 8bc7962546a39b7e2742a050d7a74202011bc268fd7103710cb9e506bcf56d95 Jul 09 15:26:27.637672 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.637647 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4f556a589233c47c4fdd68c9b2838a.slice/crio-500d6354422e05899f307062d350e45588fa521de3f94a902983070cbc1e83b5 WatchSource:0}: Error finding container 500d6354422e05899f307062d350e45588fa521de3f94a902983070cbc1e83b5: Status 404 returned error can't find the container with id 500d6354422e05899f307062d350e45588fa521de3f94a902983070cbc1e83b5 Jul 09 15:26:27.640953 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.640937 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:26:27.658933 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.658897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.659041 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.658939 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-hostroot\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.659041 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.658956 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-modprobe-d\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.659041 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.658969 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysctl-conf\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.659041 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659007 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-hostroot\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.659041 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659007 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659060 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-etc-kubernetes\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659075 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-modprobe-d\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cni-binary-copy\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-tmp-dir\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659117 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-etc-kubernetes\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659123 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysctl-conf\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-cni-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659150 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-netns\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:27.659197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659179 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cnibin\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659205 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-netns\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-os-release\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659256 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-os-release\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659264 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cnibin\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-hosts-file\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovnkube-config\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659315 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-cni-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-kubelet-config\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659398 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-node-log\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659399 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-tmp-dir\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659406 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659430 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-etc-selinux\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659440 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-env-overrides\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.659598 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659449 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-kubelet-config\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659461 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-node-log\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659452 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-hosts-file\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659473 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovn-node-metrics-cert\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659501 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovnkube-script-lib\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659520 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysctl-d\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.659528 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-os-release\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.659591 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret podName:b7a7bac9-274f-43b3-8b11-86b27ec0b39f nodeName:}" failed. No retries permitted until 2026-07-09 15:26:28.159573276 +0000 UTC m=+2.077272901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret") pod "global-pull-secret-syncer-rfwbj" (UID: "b7a7bac9-274f-43b3-8b11-86b27ec0b39f") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-conf-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659619 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysctl-d\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659629 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-os-release\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659631 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cni-binary-copy\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659633 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-kubelet\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-run\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-sys\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659723 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-run\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-var-lib-kubelet\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.660343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-host\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659753 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-sys\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659662 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-kubelet\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659775 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-device-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659797 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-cni-multus\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659799 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-var-lib-kubelet\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659809 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-host\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659817 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-etc-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659822 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-env-overrides\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659847 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-cni-multus\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659838 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovnkube-config\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60d6509b-c5f0-4e3d-9c2d-f109110c6098-tmp\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659687 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-conf-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659874 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-etc-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659891 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28bc495a-fda4-427f-ad3d-0dd1486047c3-konnectivity-ca\") pod \"konnectivity-agent-wqfxp\" (UID: \"28bc495a-fda4-427f-ad3d-0dd1486047c3\") " pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659858 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-device-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659943 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659972 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-systemd-units\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.659995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qht5w\" (UniqueName: \"kubernetes.io/projected/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-kube-api-access-qht5w\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-lib-modules\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660036 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgtbd\" (UniqueName: \"kubernetes.io/projected/60d6509b-c5f0-4e3d-9c2d-f109110c6098-kube-api-access-qgtbd\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-systemd-units\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660057 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-cni-binary-copy\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovnkube-script-lib\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660218 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-socket-dir-parent\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660260 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-cni-bin\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660285 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73cd0a0a-8a14-4b2d-b803-009b834ead47-host-slash\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660309 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-socket-dir-parent\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660318 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-system-cni-dir\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkdnm\" (UniqueName: \"kubernetes.io/projected/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-kube-api-access-pkdnm\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/73cd0a0a-8a14-4b2d-b803-009b834ead47-host-slash\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660320 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-cni-bin\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.661846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660360 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f1d10af5-0153-41c0-8cca-a7c6ad1252da-system-cni-dir\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660368 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/28bc495a-fda4-427f-ad3d-0dd1486047c3-konnectivity-ca\") pod \"konnectivity-agent-wqfxp\" (UID: \"28bc495a-fda4-427f-ad3d-0dd1486047c3\") " pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-slash\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzmw9\" (UniqueName: \"kubernetes.io/projected/73cd0a0a-8a14-4b2d-b803-009b834ead47-kube-api-access-pzmw9\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660411 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-slash\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28bc495a-fda4-427f-ad3d-0dd1486047c3-agent-certs\") pod \"konnectivity-agent-wqfxp\" (UID: \"28bc495a-fda4-427f-ad3d-0dd1486047c3\") " pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660454 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysconfig\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660458 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-lib-modules\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660476 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-systemd\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660498 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-sys-fs\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660515 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-sysconfig\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660519 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-multus-certs\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660547 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-ovn\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660556 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-systemd\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660555 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-multus-certs\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-k8s-cni-cncf-io\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-socket-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.662423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660600 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-ovn\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660452 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660597 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-sys-fs\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-registration-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660632 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-run-k8s-cni-cncf-io\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660653 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-registration-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-kubelet\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-host-var-lib-kubelet\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660700 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-run-netns\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660720 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-systemd\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-log-socket\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.660742 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660760 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.660790 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:28.160775305 +0000 UTC m=+2.078474920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660796 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-run-systemd\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmxn2\" (UniqueName: \"kubernetes.io/projected/2178f066-0930-4f3f-9bee-0101bc68ea4d-kube-api-access-xmxn2\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.663119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-run-netns\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660817 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-log-socket\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660834 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-dbus\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660809 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-run-ovn-kubernetes\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-tuned\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.660953 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-dbus\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf35a2fc-9f61-4605-a428-033b174483ce-host\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661136 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-socket-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661163 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-cni-binary-copy\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf35a2fc-9f61-4605-a428-033b174483ce-serviceca\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661162 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf35a2fc-9f61-4605-a428-033b174483ce-host\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-cnibin\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661319 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55qnd\" (UniqueName: \"kubernetes.io/projected/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-kube-api-access-55qnd\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661400 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-cnibin\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqsn7\" (UniqueName: \"kubernetes.io/projected/f1d10af5-0153-41c0-8cca-a7c6ad1252da-kube-api-access-xqsn7\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-var-lib-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2tg2\" (UniqueName: \"kubernetes.io/projected/cf35a2fc-9f61-4605-a428-033b174483ce-kube-api-access-s2tg2\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661552 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf35a2fc-9f61-4605-a428-033b174483ce-serviceca\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.663660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661567 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-kubernetes\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661603 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-var-lib-openvswitch\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661620 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-system-cni-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-daemon-config\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661666 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-kubernetes\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73cd0a0a-8a14-4b2d-b803-009b834ead47-iptables-alerter-script\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6kcp\" (UniqueName: \"kubernetes.io/projected/570094ba-60a1-43c6-b3b0-02964cbe6af0-kube-api-access-r6kcp\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-cni-bin\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661755 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-cni-netd\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661815 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-cni-netd\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661896 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-system-cni-dir\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661965 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2178f066-0930-4f3f-9bee-0101bc68ea4d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.661999 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f1d10af5-0153-41c0-8cca-a7c6ad1252da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.662059 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-host-cni-bin\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.662419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-multus-daemon-config\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.664177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.662828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/73cd0a0a-8a14-4b2d-b803-009b834ead47-iptables-alerter-script\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.664584 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.663122 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-ovn-node-metrics-cert\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.664584 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.663232 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/60d6509b-c5f0-4e3d-9c2d-f109110c6098-etc-tuned\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.664584 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.663236 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/60d6509b-c5f0-4e3d-9c2d-f109110c6098-tmp\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.664584 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.663289 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/28bc495a-fda4-427f-ad3d-0dd1486047c3-agent-certs\") pod \"konnectivity-agent-wqfxp\" (UID: \"28bc495a-fda4-427f-ad3d-0dd1486047c3\") " pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:27.670112 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.670089 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:27.670112 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.670113 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:27.670305 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.670126 2564 projected.go:196] Error preparing data for projected volume kube-api-access-nhbwf for pod openshift-network-diagnostics/network-check-target-pqfh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:27.670305 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:27.670179 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf podName:f7040f84-4e0f-4952-8fae-87389c8a8b65 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:28.170161447 +0000 UTC m=+2.087861077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nhbwf" (UniqueName: "kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf") pod "network-check-target-pqfh9" (UID: "f7040f84-4e0f-4952-8fae-87389c8a8b65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:27.672695 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.672675 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgtbd\" (UniqueName: \"kubernetes.io/projected/60d6509b-c5f0-4e3d-9c2d-f109110c6098-kube-api-access-qgtbd\") pod \"tuned-zm45z\" (UID: \"60d6509b-c5f0-4e3d-9c2d-f109110c6098\") " pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.673174 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.673118 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qht5w\" (UniqueName: \"kubernetes.io/projected/93cc2f34-c3c3-464b-ab40-a12deccc6f1e-kube-api-access-qht5w\") pod \"ovnkube-node-9p68n\" (UID: \"93cc2f34-c3c3-464b-ab40-a12deccc6f1e\") " pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.673174 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.673118 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkdnm\" (UniqueName: \"kubernetes.io/projected/dc1e8316-7b3f-47b7-b7b0-6831130b9e5d-kube-api-access-pkdnm\") pod \"node-resolver-d7mnj\" (UID: \"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d\") " pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.673570 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.673226 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmxn2\" (UniqueName: \"kubernetes.io/projected/2178f066-0930-4f3f-9bee-0101bc68ea4d-kube-api-access-xmxn2\") pod \"aws-ebs-csi-driver-node-r2g5d\" (UID: \"2178f066-0930-4f3f-9bee-0101bc68ea4d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.673570 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.673448 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqsn7\" (UniqueName: \"kubernetes.io/projected/f1d10af5-0153-41c0-8cca-a7c6ad1252da-kube-api-access-xqsn7\") pod \"multus-additional-cni-plugins-7ksf9\" (UID: \"f1d10af5-0153-41c0-8cca-a7c6ad1252da\") " pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.673570 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.673518 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2tg2\" (UniqueName: \"kubernetes.io/projected/cf35a2fc-9f61-4605-a428-033b174483ce-kube-api-access-s2tg2\") pod \"node-ca-df9fw\" (UID: \"cf35a2fc-9f61-4605-a428-033b174483ce\") " pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.673651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.673608 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzmw9\" (UniqueName: \"kubernetes.io/projected/73cd0a0a-8a14-4b2d-b803-009b834ead47-kube-api-access-pzmw9\") pod \"iptables-alerter-cbz6m\" (UID: \"73cd0a0a-8a14-4b2d-b803-009b834ead47\") " pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.673772 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.673756 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6kcp\" (UniqueName: \"kubernetes.io/projected/570094ba-60a1-43c6-b3b0-02964cbe6af0-kube-api-access-r6kcp\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:27.674190 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.674175 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qnd\" (UniqueName: \"kubernetes.io/projected/1789c039-b1fb-4746-a9e6-c4a1f0d4402e-kube-api-access-55qnd\") pod \"multus-h7h7h\" (UID: \"1789c039-b1fb-4746-a9e6-c4a1f0d4402e\") " pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.677426 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.677393 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" event={"ID":"7e5861fb7c10128f501f80d1aa143731","Type":"ContainerStarted","Data":"8bc7962546a39b7e2742a050d7a74202011bc268fd7103710cb9e506bcf56d95"} Jul 09 15:26:27.678272 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.678253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" event={"ID":"2d4f556a589233c47c4fdd68c9b2838a","Type":"ContainerStarted","Data":"500d6354422e05899f307062d350e45588fa521de3f94a902983070cbc1e83b5"} Jul 09 15:26:27.762153 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.762129 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:27.772310 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.772239 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-d7mnj" Jul 09 15:26:27.782042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.782019 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc1e8316_7b3f_47b7_b7b0_6831130b9e5d.slice/crio-96cf0021ee6b4e09325aa198f343c423f1060eae5eb6769613d79449df42a55c WatchSource:0}: Error finding container 96cf0021ee6b4e09325aa198f343c423f1060eae5eb6769613d79449df42a55c: Status 404 returned error can't find the container with id 96cf0021ee6b4e09325aa198f343c423f1060eae5eb6769613d79449df42a55c Jul 09 15:26:27.804566 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.804540 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" Jul 09 15:26:27.811277 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.811257 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-h7h7h" Jul 09 15:26:27.813214 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.813194 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1d10af5_0153_41c0_8cca_a7c6ad1252da.slice/crio-7bde71dec8e27ed6be9c1eda7205646184413a76de8a3a0b4e9f6923777ede5a WatchSource:0}: Error finding container 7bde71dec8e27ed6be9c1eda7205646184413a76de8a3a0b4e9f6923777ede5a: Status 404 returned error can't find the container with id 7bde71dec8e27ed6be9c1eda7205646184413a76de8a3a0b4e9f6923777ede5a Jul 09 15:26:27.819182 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.819160 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1789c039_b1fb_4746_a9e6_c4a1f0d4402e.slice/crio-d00f4cc7e3730df487dccd15b3ccbcf801a0ac2e4aeceb0d95534585cc5ff0be WatchSource:0}: Error finding container d00f4cc7e3730df487dccd15b3ccbcf801a0ac2e4aeceb0d95534585cc5ff0be: Status 404 returned error can't find the container with id d00f4cc7e3730df487dccd15b3ccbcf801a0ac2e4aeceb0d95534585cc5ff0be Jul 09 15:26:27.825966 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.825950 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cbz6m" Jul 09 15:26:27.833555 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.833533 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73cd0a0a_8a14_4b2d_b803_009b834ead47.slice/crio-45b930a66443d7f20e2a6611c14878737f70b22fab398cf0196ec49f1f7fd5dc WatchSource:0}: Error finding container 45b930a66443d7f20e2a6611c14878737f70b22fab398cf0196ec49f1f7fd5dc: Status 404 returned error can't find the container with id 45b930a66443d7f20e2a6611c14878737f70b22fab398cf0196ec49f1f7fd5dc Jul 09 15:26:27.836724 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.836711 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:27.843553 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.843534 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:27.843935 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.843903 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93cc2f34_c3c3_464b_ab40_a12deccc6f1e.slice/crio-c3dd1cfe93da0ffde0bf2b4d08023e61c06dbf09c52b54036b0191809866eb9b WatchSource:0}: Error finding container c3dd1cfe93da0ffde0bf2b4d08023e61c06dbf09c52b54036b0191809866eb9b: Status 404 returned error can't find the container with id c3dd1cfe93da0ffde0bf2b4d08023e61c06dbf09c52b54036b0191809866eb9b Jul 09 15:26:27.851467 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.851448 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28bc495a_fda4_427f_ad3d_0dd1486047c3.slice/crio-cde37f26c8fc1aff350d4e77cbe3924dd38f61fbdc74dd8ab6e55e2f82bc77da WatchSource:0}: Error finding container cde37f26c8fc1aff350d4e77cbe3924dd38f61fbdc74dd8ab6e55e2f82bc77da: Status 404 returned error can't find the container with id cde37f26c8fc1aff350d4e77cbe3924dd38f61fbdc74dd8ab6e55e2f82bc77da Jul 09 15:26:27.854231 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.854214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zm45z" Jul 09 15:26:27.863452 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.863420 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d6509b_c5f0_4e3d_9c2d_f109110c6098.slice/crio-0fbfb3f49181d2554bb4edf36d594d902ea0b56c8d5c5cc5aad675c868ea1817 WatchSource:0}: Error finding container 0fbfb3f49181d2554bb4edf36d594d902ea0b56c8d5c5cc5aad675c868ea1817: Status 404 returned error can't find the container with id 0fbfb3f49181d2554bb4edf36d594d902ea0b56c8d5c5cc5aad675c868ea1817 Jul 09 15:26:27.863609 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.863587 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:27.866719 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.866705 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-df9fw" Jul 09 15:26:27.872136 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:27.872117 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" Jul 09 15:26:27.875806 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.875786 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf35a2fc_9f61_4605_a428_033b174483ce.slice/crio-6bfde69d7469dab700b5ada5f2878ae52c1255631d4c245b90d3677f70a599cb WatchSource:0}: Error finding container 6bfde69d7469dab700b5ada5f2878ae52c1255631d4c245b90d3677f70a599cb: Status 404 returned error can't find the container with id 6bfde69d7469dab700b5ada5f2878ae52c1255631d4c245b90d3677f70a599cb Jul 09 15:26:27.880270 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:26:27.880250 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2178f066_0930_4f3f_9bee_0101bc68ea4d.slice/crio-921047091ac48099ef4ce6710fd9f5be3591c3f69b7e69ac36d6a393d0223af1 WatchSource:0}: Error finding container 921047091ac48099ef4ce6710fd9f5be3591c3f69b7e69ac36d6a393d0223af1: Status 404 returned error can't find the container with id 921047091ac48099ef4ce6710fd9f5be3591c3f69b7e69ac36d6a393d0223af1 Jul 09 15:26:28.165296 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.165219 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:28.165440 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.165295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:28.165440 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.165380 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:28.165440 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.165401 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:28.165595 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.165455 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret podName:b7a7bac9-274f-43b3-8b11-86b27ec0b39f nodeName:}" failed. No retries permitted until 2026-07-09 15:26:29.16543931 +0000 UTC m=+3.083138922 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret") pod "global-pull-secret-syncer-rfwbj" (UID: "b7a7bac9-274f-43b3-8b11-86b27ec0b39f") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:28.165595 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.165474 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:29.165465096 +0000 UTC m=+3.083164709 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:28.267539 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.266202 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:28.267539 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.266361 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:28.267539 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.266379 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:28.267539 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.266390 2564 projected.go:196] Error preparing data for projected volume kube-api-access-nhbwf for pod openshift-network-diagnostics/network-check-target-pqfh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:28.267539 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.266469 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf podName:f7040f84-4e0f-4952-8fae-87389c8a8b65 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:29.266452695 +0000 UTC m=+3.184152309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhbwf" (UniqueName: "kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf") pod "network-check-target-pqfh9" (UID: "f7040f84-4e0f-4952-8fae-87389c8a8b65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:28.360579 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.360399 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:28.497890 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.497764 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:21:27 +0000 UTC" deadline="2027-12-21 06:14:10.018038082 +0000 UTC" Jul 09 15:26:28.497890 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.497832 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12710h47m41.52021029s" Jul 09 15:26:28.677050 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.677021 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:28.677293 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.677158 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:28.677576 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.677555 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:28.677697 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.677676 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:28.677758 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.677744 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:28.677829 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:28.677811 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:28.703844 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.703808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-df9fw" event={"ID":"cf35a2fc-9f61-4605-a428-033b174483ce","Type":"ContainerStarted","Data":"6bfde69d7469dab700b5ada5f2878ae52c1255631d4c245b90d3677f70a599cb"} Jul 09 15:26:28.710333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.710297 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zm45z" event={"ID":"60d6509b-c5f0-4e3d-9c2d-f109110c6098","Type":"ContainerStarted","Data":"0fbfb3f49181d2554bb4edf36d594d902ea0b56c8d5c5cc5aad675c868ea1817"} Jul 09 15:26:28.750576 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.750459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h7h7h" event={"ID":"1789c039-b1fb-4746-a9e6-c4a1f0d4402e","Type":"ContainerStarted","Data":"d00f4cc7e3730df487dccd15b3ccbcf801a0ac2e4aeceb0d95534585cc5ff0be"} Jul 09 15:26:28.768403 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.768362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerStarted","Data":"7bde71dec8e27ed6be9c1eda7205646184413a76de8a3a0b4e9f6923777ede5a"} Jul 09 15:26:28.792651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.792608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d7mnj" event={"ID":"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d","Type":"ContainerStarted","Data":"96cf0021ee6b4e09325aa198f343c423f1060eae5eb6769613d79449df42a55c"} Jul 09 15:26:28.820937 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.820878 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" event={"ID":"2178f066-0930-4f3f-9bee-0101bc68ea4d","Type":"ContainerStarted","Data":"921047091ac48099ef4ce6710fd9f5be3591c3f69b7e69ac36d6a393d0223af1"} Jul 09 15:26:28.828831 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.828789 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqfxp" event={"ID":"28bc495a-fda4-427f-ad3d-0dd1486047c3","Type":"ContainerStarted","Data":"cde37f26c8fc1aff350d4e77cbe3924dd38f61fbdc74dd8ab6e55e2f82bc77da"} Jul 09 15:26:28.837218 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.837146 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"c3dd1cfe93da0ffde0bf2b4d08023e61c06dbf09c52b54036b0191809866eb9b"} Jul 09 15:26:28.848906 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:28.848869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cbz6m" event={"ID":"73cd0a0a-8a14-4b2d-b803-009b834ead47","Type":"ContainerStarted","Data":"45b930a66443d7f20e2a6611c14878737f70b22fab398cf0196ec49f1f7fd5dc"} Jul 09 15:26:29.174172 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:29.174086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:29.174172 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:29.174160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:29.174384 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:29.174290 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:29.174384 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:29.174352 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:31.17433226 +0000 UTC m=+5.092031875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:29.174799 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:29.174777 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:29.174947 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:29.174834 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret podName:b7a7bac9-274f-43b3-8b11-86b27ec0b39f nodeName:}" failed. No retries permitted until 2026-07-09 15:26:31.174819686 +0000 UTC m=+5.092519301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret") pod "global-pull-secret-syncer-rfwbj" (UID: "b7a7bac9-274f-43b3-8b11-86b27ec0b39f") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:29.275452 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:29.275139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:29.275452 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:29.275364 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:29.275452 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:29.275382 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:29.275452 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:29.275394 2564 projected.go:196] Error preparing data for projected volume kube-api-access-nhbwf for pod openshift-network-diagnostics/network-check-target-pqfh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:29.275452 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:29.275451 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf podName:f7040f84-4e0f-4952-8fae-87389c8a8b65 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:31.275433965 +0000 UTC m=+5.193133587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhbwf" (UniqueName: "kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf") pod "network-check-target-pqfh9" (UID: "f7040f84-4e0f-4952-8fae-87389c8a8b65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:29.498931 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:29.498547 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:21:27 +0000 UTC" deadline="2028-02-20 02:29:30.609749441 +0000 UTC" Jul 09 15:26:29.498931 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:29.498831 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14171h3m1.110923004s" Jul 09 15:26:29.576757 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:29.576724 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:30.677385 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:30.677355 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:30.677894 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:30.677479 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:30.677894 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:30.677868 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:30.678040 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:30.677984 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:30.678100 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:30.678054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:30.678241 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:30.678143 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:31.190165 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:31.190077 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:31.190369 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:31.190244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:31.190369 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:31.190252 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:31.190369 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:31.190318 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:31.190369 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:31.190352 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret podName:b7a7bac9-274f-43b3-8b11-86b27ec0b39f nodeName:}" failed. No retries permitted until 2026-07-09 15:26:35.19033849 +0000 UTC m=+9.108038104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret") pod "global-pull-secret-syncer-rfwbj" (UID: "b7a7bac9-274f-43b3-8b11-86b27ec0b39f") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:31.190588 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:31.190387 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:35.190369468 +0000 UTC m=+9.108069095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:31.294249 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:31.294210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:31.294434 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:31.294399 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:31.294434 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:31.294418 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:31.294434 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:31.294430 2564 projected.go:196] Error preparing data for projected volume kube-api-access-nhbwf for pod openshift-network-diagnostics/network-check-target-pqfh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:31.294580 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:31.294475 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf podName:f7040f84-4e0f-4952-8fae-87389c8a8b65 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:35.2944598 +0000 UTC m=+9.212159414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhbwf" (UniqueName: "kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf") pod "network-check-target-pqfh9" (UID: "f7040f84-4e0f-4952-8fae-87389c8a8b65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:32.676379 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:32.676043 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:32.676379 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:32.676084 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:32.676379 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:32.676058 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:32.676379 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:32.676180 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:32.676379 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:32.676262 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:32.677014 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:32.676353 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:34.675209 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:34.674652 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:34.675209 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:34.674666 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:34.675209 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:34.674780 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:34.675209 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:34.674796 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:34.675209 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:34.674909 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:34.675209 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:34.675052 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:35.229958 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:35.229904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:35.230154 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:35.230006 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:35.230154 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:35.230138 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:35.230265 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:35.230200 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret podName:b7a7bac9-274f-43b3-8b11-86b27ec0b39f nodeName:}" failed. No retries permitted until 2026-07-09 15:26:43.230182262 +0000 UTC m=+17.147881894 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret") pod "global-pull-secret-syncer-rfwbj" (UID: "b7a7bac9-274f-43b3-8b11-86b27ec0b39f") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:35.230589 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:35.230570 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:35.230670 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:35.230623 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:43.23060725 +0000 UTC m=+17.148306868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:35.331267 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:35.330642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:35.331267 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:35.330865 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:35.331267 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:35.330887 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:35.331267 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:35.330899 2564 projected.go:196] Error preparing data for projected volume kube-api-access-nhbwf for pod openshift-network-diagnostics/network-check-target-pqfh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:35.331267 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:35.330965 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf podName:f7040f84-4e0f-4952-8fae-87389c8a8b65 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:43.33094742 +0000 UTC m=+17.248647085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhbwf" (UniqueName: "kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf") pod "network-check-target-pqfh9" (UID: "f7040f84-4e0f-4952-8fae-87389c8a8b65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:36.676742 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:36.676705 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:36.677206 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:36.676809 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:36.677206 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:36.676857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:36.677206 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:36.676953 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:36.677343 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:36.677260 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:36.677389 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:36.677345 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:38.674981 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:38.674833 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:38.675631 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:38.675565 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:38.675749 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:38.675637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:38.675794 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:38.675742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:38.675794 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:38.675784 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:38.675902 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:38.675876 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:40.674832 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:40.674793 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:40.674832 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:40.674803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:40.675311 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:40.674803 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:40.675311 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:40.674954 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:40.675311 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:40.675032 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:40.675311 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:40.675119 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:42.675948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:42.675337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:42.675948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:42.675377 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:42.675948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:42.675339 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:42.675948 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:42.675473 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:42.675948 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:42.675598 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:42.675948 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:42.675664 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:43.289658 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:43.289616 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:43.289885 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:43.289718 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:43.289885 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:43.289790 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:43.289885 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:43.289811 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:43.289885 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:43.289852 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:59.289835709 +0000 UTC m=+33.207535325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:43.289885 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:43.289874 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret podName:b7a7bac9-274f-43b3-8b11-86b27ec0b39f nodeName:}" failed. No retries permitted until 2026-07-09 15:26:59.289863175 +0000 UTC m=+33.207562800 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret") pod "global-pull-secret-syncer-rfwbj" (UID: "b7a7bac9-274f-43b3-8b11-86b27ec0b39f") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:43.390958 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:43.390910 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:43.391159 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:43.391113 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:43.391159 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:43.391138 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:43.391159 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:43.391153 2564 projected.go:196] Error preparing data for projected volume kube-api-access-nhbwf for pod openshift-network-diagnostics/network-check-target-pqfh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:43.391295 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:43.391223 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf podName:f7040f84-4e0f-4952-8fae-87389c8a8b65 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:59.391202865 +0000 UTC m=+33.308902502 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhbwf" (UniqueName: "kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf") pod "network-check-target-pqfh9" (UID: "f7040f84-4e0f-4952-8fae-87389c8a8b65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:44.675073 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:44.675041 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:44.675073 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:44.675070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:44.675593 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:44.675168 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:44.675593 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:44.675213 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:44.675593 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:44.675330 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:44.675593 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:44.675413 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:46.675867 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:46.675389 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:46.675867 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:46.675495 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:46.675867 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:46.675526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:46.675867 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:46.675680 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:46.675867 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:46.675738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:46.675867 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:46.675822 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:48.675060 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.674490 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:48.675060 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:48.674856 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:48.675060 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.674673 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:48.675060 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:48.674935 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:48.675060 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.674550 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:48.675060 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:48.674993 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:48.897812 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.897324 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-h7h7h" event={"ID":"1789c039-b1fb-4746-a9e6-c4a1f0d4402e","Type":"ContainerStarted","Data":"ef64bc15757ca8a11f352b68662d88fe500b5a38078806b8148ba212612fa933"} Jul 09 15:26:48.899077 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.899025 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerStarted","Data":"15bcb8d9dee9895fba3d47cc2b0951faf71b5ef066b95978d0e37271c8d346a3"} Jul 09 15:26:48.901387 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.901066 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-d7mnj" event={"ID":"dc1e8316-7b3f-47b7-b7b0-6831130b9e5d","Type":"ContainerStarted","Data":"b7bce9b1b021062ec7cf1ae0ebcc6d926e0b40e2a67e66fba627d6b6d4bdd2e7"} Jul 09 15:26:48.905199 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.905149 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" event={"ID":"7e5861fb7c10128f501f80d1aa143731","Type":"ContainerStarted","Data":"4d88747f70afa159de265a0ae4650287b9c12a9d9901381ae02733f998ca3604"} Jul 09 15:26:48.907489 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.907469 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" event={"ID":"2178f066-0930-4f3f-9bee-0101bc68ea4d","Type":"ContainerStarted","Data":"b5076f894a1843951e8888a8023a5bdee86c522f5cbe1dad39d1734b574e501f"} Jul 09 15:26:48.908736 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.908706 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqfxp" event={"ID":"28bc495a-fda4-427f-ad3d-0dd1486047c3","Type":"ContainerStarted","Data":"57a62ff4a3b1030c98aa9c9db8f455c26f477a81a4d8201b9536bceaa9703f97"} Jul 09 15:26:48.911788 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.911765 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:26:48.912649 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.912624 2564 generic.go:356] "Generic (PLEG): container finished" podID="93cc2f34-c3c3-464b-ab40-a12deccc6f1e" containerID="ffadf8d05521f75a4632132efbfdcbc577b5a7db53f7addae23533b8e4acc158" exitCode=1 Jul 09 15:26:48.912734 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.912705 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"657cca00cb9e77a8c138755cd26c52292efa63741974664bea0cc6a072b2916b"} Jul 09 15:26:48.912801 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.912783 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"9c05205fb296eae7a9f7850acf52f979851d91a9ebc0b01721852748ed3fb0b6"} Jul 09 15:26:48.912860 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.912835 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerDied","Data":"ffadf8d05521f75a4632132efbfdcbc577b5a7db53f7addae23533b8e4acc158"} Jul 09 15:26:48.912954 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.912879 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"af65c42607842bdd578f2be53cd326265615ed0bba3dd3e6cf9ba20b58aeaf85"} Jul 09 15:26:48.914990 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.914897 2564 generic.go:356] "Generic (PLEG): container finished" podID="2d4f556a589233c47c4fdd68c9b2838a" containerID="9253900b50664102e447c009b638e12e404e466c1f5a55d9a82d6e46a0f4a009" exitCode=0 Jul 09 15:26:48.914990 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.914953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" event={"ID":"2d4f556a589233c47c4fdd68c9b2838a","Type":"ContainerDied","Data":"9253900b50664102e447c009b638e12e404e466c1f5a55d9a82d6e46a0f4a009"} Jul 09 15:26:48.916702 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.916676 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-df9fw" event={"ID":"cf35a2fc-9f61-4605-a428-033b174483ce","Type":"ContainerStarted","Data":"5c7f1626609ebcfbe7688bf3b961012522d5967a94ecddb837ecd25f22b2c338"} Jul 09 15:26:48.918106 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.918086 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zm45z" event={"ID":"60d6509b-c5f0-4e3d-9c2d-f109110c6098","Type":"ContainerStarted","Data":"f98a81b0c6904012477afc69dda9e15f2989d586e2675da44d85b7754a668984"} Jul 09 15:26:48.965318 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.965260 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-h7h7h" podStartSLOduration=2.198035574 podStartE2EDuration="22.96524323s" totalImagesPullingTime="20.767207656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:48.926424801 +0000 UTC m=+22.844124437" watchObservedRunningTime="2026-07-09 15:26:48.96524323 +0000 UTC m=+22.882942865" Jul 09 15:26:48.989477 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:48.989427 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-d7mnj" podStartSLOduration=2.399341564 podStartE2EDuration="22.989412728s" totalImagesPullingTime="20.590071164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:48.989144467 +0000 UTC m=+22.906844103" watchObservedRunningTime="2026-07-09 15:26:48.989412728 +0000 UTC m=+22.907112364" Jul 09 15:26:49.046516 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.046460 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zm45z" podStartSLOduration=2.537809096 podStartE2EDuration="23.046442471s" totalImagesPullingTime="20.508633375s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:49.021990742 +0000 UTC m=+22.939690378" watchObservedRunningTime="2026-07-09 15:26:49.046442471 +0000 UTC m=+22.964142106" Jul 09 15:26:49.068473 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.068414 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-df9fw" podStartSLOduration=2.6022202009999997 podStartE2EDuration="23.06839092s" totalImagesPullingTime="20.466170719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:49.047445125 +0000 UTC m=+22.965144761" watchObservedRunningTime="2026-07-09 15:26:49.06839092 +0000 UTC m=+22.986090557" Jul 09 15:26:49.098226 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.098156 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wqfxp" podStartSLOduration=2.6355368710000002 podStartE2EDuration="23.098138771s" totalImagesPullingTime="20.4626019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:49.097901197 +0000 UTC m=+23.015600832" watchObservedRunningTime="2026-07-09 15:26:49.098138771 +0000 UTC m=+23.015838407" Jul 09 15:26:49.098392 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.098279 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-178.ec2.internal" podStartSLOduration=22.098258796 podStartE2EDuration="22.098258796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:49.071321254 +0000 UTC m=+22.989020881" watchObservedRunningTime="2026-07-09 15:26:49.098258796 +0000 UTC m=+23.015958432" Jul 09 15:26:49.922426 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.922391 2564 generic.go:356] "Generic (PLEG): container finished" podID="f1d10af5-0153-41c0-8cca-a7c6ad1252da" containerID="15bcb8d9dee9895fba3d47cc2b0951faf71b5ef066b95978d0e37271c8d346a3" exitCode=0 Jul 09 15:26:49.923345 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.922493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerDied","Data":"15bcb8d9dee9895fba3d47cc2b0951faf71b5ef066b95978d0e37271c8d346a3"} Jul 09 15:26:49.926000 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.925980 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:26:49.926437 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.926409 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"fd466a312f355a53bd99435281abf960e84f331fcd5466a31f56c93f52d98e61"} Jul 09 15:26:49.926541 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.926500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"f0b8072daf6bf5da5b0c6675089b6cf5d43efac2fcaa11c30dea212661284386"} Jul 09 15:26:49.928096 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:49.928022 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cbz6m" event={"ID":"73cd0a0a-8a14-4b2d-b803-009b834ead47","Type":"ContainerStarted","Data":"72b9abf8ac85d8cfe680545cbcf80583492f5521586c5f182aa5e416c3499c8d"} Jul 09 15:26:50.482144 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.482119 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 15:26:50.516771 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.516655 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T15:26:50.482140481Z","UUID":"cb2724f0-55cc-4095-b3c9-9163b312e2cb","Handler":null,"Name":"","Endpoint":""} Jul 09 15:26:50.518434 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.518407 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 15:26:50.518565 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.518450 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 15:26:50.644681 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.644593 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:50.645394 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.645375 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:50.664480 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.664424 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cbz6m" podStartSLOduration=4.127772278 podStartE2EDuration="24.664408718s" totalImagesPullingTime="20.53663644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:49.999009376 +0000 UTC m=+23.916709006" watchObservedRunningTime="2026-07-09 15:26:50.664408718 +0000 UTC m=+24.582108417" Jul 09 15:26:50.674339 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.674310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:50.674510 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.674310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:50.674510 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:50.674431 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:50.674510 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.674310 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:50.674510 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:50.674496 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:50.674734 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:50.674569 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:50.932517 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.932420 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" event={"ID":"2d4f556a589233c47c4fdd68c9b2838a","Type":"ContainerStarted","Data":"b9f62c330e8dfc9ee25a1024444bd74d9da5043258236d2b3174fc37ffc6ac5e"} Jul 09 15:26:50.935120 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.935090 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" event={"ID":"2178f066-0930-4f3f-9bee-0101bc68ea4d","Type":"ContainerStarted","Data":"c1fedf192f94b18c5bc2fa5f5ca78b2f2570029f6f2daeea001f68f5c0468147"} Jul 09 15:26:50.951579 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:50.951523 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-178.ec2.internal" podStartSLOduration=23.951501712 podStartE2EDuration="23.951501712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:50.950968306 +0000 UTC m=+24.868667943" watchObservedRunningTime="2026-07-09 15:26:50.951501712 +0000 UTC m=+24.869201349" Jul 09 15:26:51.940858 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:51.940826 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:26:51.941315 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:51.941289 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"bfbf85aa6e4948d23e8b517d8f5898d8c1d371501e60c244cd837038fde9bf34"} Jul 09 15:26:51.943626 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:51.943606 2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 15:26:51.944016 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:51.943988 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" event={"ID":"2178f066-0930-4f3f-9bee-0101bc68ea4d","Type":"ContainerStarted","Data":"41ef9c3e5a4b44d34aa4a8655c9f8f3ff10c16a6fa37383047edb0a726422fc2"} Jul 09 15:26:51.968053 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:51.967996 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-r2g5d" podStartSLOduration=2.751641259 podStartE2EDuration="25.967977682s" totalImagesPullingTime="23.216336423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:51.967949944 +0000 UTC m=+25.885649581" watchObservedRunningTime="2026-07-09 15:26:51.967977682 +0000 UTC m=+25.885677311" Jul 09 15:26:52.089582 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:52.089538 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:52.090743 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:52.090719 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wqfxp" Jul 09 15:26:52.675314 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:52.675101 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:52.675513 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:52.675156 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:52.675513 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:52.675183 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:52.675513 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:52.675421 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:52.675513 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:52.675475 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:52.675681 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:52.675564 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:54.674829 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.674548 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:54.674829 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.674583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:54.675643 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:54.674842 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:54.675643 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.674583 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:54.675643 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:54.674950 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:54.675643 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:54.675039 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:54.952416 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.952324 2564 generic.go:356] "Generic (PLEG): container finished" podID="f1d10af5-0153-41c0-8cca-a7c6ad1252da" containerID="c9eb4188fa02c98702c3067a902f1d0040565c90efb4e9eacdd400b3e95df7ef" exitCode=0 Jul 09 15:26:54.952416 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.952402 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerDied","Data":"c9eb4188fa02c98702c3067a902f1d0040565c90efb4e9eacdd400b3e95df7ef"} Jul 09 15:26:54.955783 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.955764 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:26:54.956191 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.956168 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"fb396744c094391319655c02dfea5d5650b767fa8ce8a377cfc2c7bfefe240a8"} Jul 09 15:26:54.956446 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.956425 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:54.956576 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.956564 2564 scope.go:117] "RemoveContainer" containerID="ffadf8d05521f75a4632132efbfdcbc577b5a7db53f7addae23533b8e4acc158" Jul 09 15:26:54.973819 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:54.973800 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:55.962061 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:55.962030 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:26:55.963216 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:55.963175 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" event={"ID":"93cc2f34-c3c3-464b-ab40-a12deccc6f1e","Type":"ContainerStarted","Data":"55ca6d43df90e1449caada24dc72e97229a25c6d29eecff397e1cdd9e171b480"} Jul 09 15:26:55.963506 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:55.963483 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:55.963601 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:55.963565 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:55.979164 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:55.979138 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:26:56.003204 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.003153 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" podStartSLOduration=9.428450481 podStartE2EDuration="30.003138196s" totalImagesPullingTime="20.574687715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:56.001771048 +0000 UTC m=+29.919470684" watchObservedRunningTime="2026-07-09 15:26:56.003138196 +0000 UTC m=+29.920837861" Jul 09 15:26:56.552171 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.552141 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pqfh9"] Jul 09 15:26:56.552328 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.552252 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:56.552370 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:56.552333 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:56.555130 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.555102 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hcp4j"] Jul 09 15:26:56.555265 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.555208 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:56.555323 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:56.555303 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:56.555734 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.555711 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rfwbj"] Jul 09 15:26:56.555836 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.555804 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:56.555900 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:56.555881 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:56.967199 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.967158 2564 generic.go:356] "Generic (PLEG): container finished" podID="f1d10af5-0153-41c0-8cca-a7c6ad1252da" containerID="78c431dd585304062c508110bb291db71994fb92c0061962f7ccdf3f2befa9a4" exitCode=0 Jul 09 15:26:56.967601 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:56.967242 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerDied","Data":"78c431dd585304062c508110bb291db71994fb92c0061962f7ccdf3f2befa9a4"} Jul 09 15:26:58.675419 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:58.675245 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:58.675954 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:58.675259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:58.675954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:58.675518 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:26:58.675954 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:58.675234 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:58.675954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:58.675607 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:26:58.675954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:58.675655 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:26:58.974526 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:58.974437 2564 generic.go:356] "Generic (PLEG): container finished" podID="f1d10af5-0153-41c0-8cca-a7c6ad1252da" containerID="08a73ed7f5f0a93fcc7785b513e326c58e15e2700bce711594575214e89a6952" exitCode=0 Jul 09 15:26:58.974526 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:58.974494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerDied","Data":"08a73ed7f5f0a93fcc7785b513e326c58e15e2700bce711594575214e89a6952"} Jul 09 15:26:59.308340 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:59.308266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:26:59.308340 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:59.308317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:26:59.308524 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:59.308401 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:59.308524 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:59.308411 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:59.308524 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:59.308455 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:31.308441013 +0000 UTC m=+65.226140630 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:59.308524 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:59.308468 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret podName:b7a7bac9-274f-43b3-8b11-86b27ec0b39f nodeName:}" failed. No retries permitted until 2026-07-09 15:27:31.308462461 +0000 UTC m=+65.226162074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret") pod "global-pull-secret-syncer-rfwbj" (UID: "b7a7bac9-274f-43b3-8b11-86b27ec0b39f") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:59.409073 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:26:59.409045 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:26:59.409225 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:59.409168 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:59.409225 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:59.409183 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:59.409225 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:59.409192 2564 projected.go:196] Error preparing data for projected volume kube-api-access-nhbwf for pod openshift-network-diagnostics/network-check-target-pqfh9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:59.409322 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:26:59.409235 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf podName:f7040f84-4e0f-4952-8fae-87389c8a8b65 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:31.40922283 +0000 UTC m=+65.326922444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nhbwf" (UniqueName: "kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf") pod "network-check-target-pqfh9" (UID: "f7040f84-4e0f-4952-8fae-87389c8a8b65") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:27:00.674703 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:00.674661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:27:00.675224 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:00.674806 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pqfh9" podUID="f7040f84-4e0f-4952-8fae-87389c8a8b65" Jul 09 15:27:00.675224 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:00.674665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:27:00.675224 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:00.674937 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:27:00.675224 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:00.674665 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:27:00.675224 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:00.675021 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rfwbj" podUID="b7a7bac9-274f-43b3-8b11-86b27ec0b39f" Jul 09 15:27:01.433777 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.433748 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-178.ec2.internal" event="NodeReady" Jul 09 15:27:01.433970 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.433887 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 15:27:01.530260 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.530219 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pq9ph"] Jul 09 15:27:01.534127 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.534100 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gk4kc"] Jul 09 15:27:01.534264 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.534222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.537425 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.537403 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gk4kc" Jul 09 15:27:01.540763 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.540728 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 15:27:01.541126 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.541101 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 15:27:01.541255 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.541239 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 15:27:01.541494 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.541478 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jqnp4\"" Jul 09 15:27:01.542216 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.541673 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 15:27:01.542216 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.541858 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 15:27:01.542216 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.542092 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5fmlz\"" Jul 09 15:27:01.547356 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.547332 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gk4kc"] Jul 09 15:27:01.549885 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.549854 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pq9ph"] Jul 09 15:27:01.624682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.624560 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/61052b40-9684-41e8-ac97-f6633e32a3ff-config-volume\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.624682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.624622 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61052b40-9684-41e8-ac97-f6633e32a3ff-tmp-dir\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.624682 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.624647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjdrl\" (UniqueName: \"kubernetes.io/projected/61052b40-9684-41e8-ac97-f6633e32a3ff-kube-api-access-mjdrl\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.624981 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.624702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6g4\" (UniqueName: \"kubernetes.io/projected/21f631c8-0b85-4b98-a556-149dfc315f9b-kube-api-access-zl6g4\") pod \"ingress-canary-gk4kc\" (UID: \"21f631c8-0b85-4b98-a556-149dfc315f9b\") " pod="openshift-ingress-canary/ingress-canary-gk4kc" Jul 09 15:27:01.624981 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.624760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.624981 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.624778 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21f631c8-0b85-4b98-a556-149dfc315f9b-cert\") pod \"ingress-canary-gk4kc\" (UID: \"21f631c8-0b85-4b98-a556-149dfc315f9b\") " pod="openshift-ingress-canary/ingress-canary-gk4kc" Jul 09 15:27:01.726057 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.725965 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/61052b40-9684-41e8-ac97-f6633e32a3ff-config-volume\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.726057 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.726049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61052b40-9684-41e8-ac97-f6633e32a3ff-tmp-dir\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.726508 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.726079 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjdrl\" (UniqueName: \"kubernetes.io/projected/61052b40-9684-41e8-ac97-f6633e32a3ff-kube-api-access-mjdrl\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.726508 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.726108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6g4\" (UniqueName: \"kubernetes.io/projected/21f631c8-0b85-4b98-a556-149dfc315f9b-kube-api-access-zl6g4\") pod \"ingress-canary-gk4kc\" (UID: \"21f631c8-0b85-4b98-a556-149dfc315f9b\") " pod="openshift-ingress-canary/ingress-canary-gk4kc" Jul 09 15:27:01.726508 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.726145 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.726508 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.726169 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21f631c8-0b85-4b98-a556-149dfc315f9b-cert\") pod \"ingress-canary-gk4kc\" (UID: \"21f631c8-0b85-4b98-a556-149dfc315f9b\") " pod="openshift-ingress-canary/ingress-canary-gk4kc" Jul 09 15:27:01.726680 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.726643 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/61052b40-9684-41e8-ac97-f6633e32a3ff-config-volume\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.727182 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:01.727059 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:01.727182 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:01.727138 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:27:02.227117644 +0000 UTC m=+36.144817259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:27:01.727182 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.727135 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61052b40-9684-41e8-ac97-f6633e32a3ff-tmp-dir\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.731193 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.731166 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21f631c8-0b85-4b98-a556-149dfc315f9b-cert\") pod \"ingress-canary-gk4kc\" (UID: \"21f631c8-0b85-4b98-a556-149dfc315f9b\") " pod="openshift-ingress-canary/ingress-canary-gk4kc" Jul 09 15:27:01.739453 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.739379 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6g4\" (UniqueName: \"kubernetes.io/projected/21f631c8-0b85-4b98-a556-149dfc315f9b-kube-api-access-zl6g4\") pod \"ingress-canary-gk4kc\" (UID: \"21f631c8-0b85-4b98-a556-149dfc315f9b\") " pod="openshift-ingress-canary/ingress-canary-gk4kc" Jul 09 15:27:01.739579 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.739509 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjdrl\" (UniqueName: \"kubernetes.io/projected/61052b40-9684-41e8-ac97-f6633e32a3ff-kube-api-access-mjdrl\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:01.853053 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:01.853011 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gk4kc" Jul 09 15:27:02.230309 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.230266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:02.230471 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:02.230397 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:02.230471 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:02.230464 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:27:03.230444291 +0000 UTC m=+37.148143907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:27:02.678871 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.678838 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:27:02.679055 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.678972 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:27:02.679144 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.679054 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:27:02.683154 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.683127 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:27:02.683304 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.683170 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r8ws7\"" Jul 09 15:27:02.684134 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.684113 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:27:02.684419 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.684117 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:27:02.684530 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.684195 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:27:02.684643 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:02.684222 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ht5qx\"" Jul 09 15:27:03.105510 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:03.105236 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gk4kc"] Jul 09 15:27:03.110814 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:27:03.110722 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f631c8_0b85_4b98_a556_149dfc315f9b.slice/crio-4220998b08e222e15d94aae2d8f9f6af1d54bb4d50cf8d9c884dcb1d7bb9379d WatchSource:0}: Error finding container 4220998b08e222e15d94aae2d8f9f6af1d54bb4d50cf8d9c884dcb1d7bb9379d: Status 404 returned error can't find the container with id 4220998b08e222e15d94aae2d8f9f6af1d54bb4d50cf8d9c884dcb1d7bb9379d Jul 09 15:27:03.236330 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:03.236302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:03.236496 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:03.236476 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:03.236567 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:03.236554 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:27:05.236533342 +0000 UTC m=+39.154232962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:27:03.988279 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:03.988239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gk4kc" event={"ID":"21f631c8-0b85-4b98-a556-149dfc315f9b","Type":"ContainerStarted","Data":"4220998b08e222e15d94aae2d8f9f6af1d54bb4d50cf8d9c884dcb1d7bb9379d"} Jul 09 15:27:03.990913 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:03.990875 2564 generic.go:356] "Generic (PLEG): container finished" podID="f1d10af5-0153-41c0-8cca-a7c6ad1252da" containerID="49a317918e92d50e3e234928ccc6516e72b090404b4642c493df29a0f80401fc" exitCode=0 Jul 09 15:27:03.991085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:03.990954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerDied","Data":"49a317918e92d50e3e234928ccc6516e72b090404b4642c493df29a0f80401fc"} Jul 09 15:27:04.997850 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:04.997816 2564 generic.go:356] "Generic (PLEG): container finished" podID="f1d10af5-0153-41c0-8cca-a7c6ad1252da" containerID="545e4ffa1fd359887383382342c23357c733456ca7c2b02715543ada5acdac78" exitCode=0 Jul 09 15:27:04.998314 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:04.997893 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerDied","Data":"545e4ffa1fd359887383382342c23357c733456ca7c2b02715543ada5acdac78"} Jul 09 15:27:05.253397 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:05.253297 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:05.253556 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:05.253464 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:05.253556 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:05.253541 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:27:09.253521867 +0000 UTC m=+43.171221481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:27:06.002270 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:06.002048 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gk4kc" event={"ID":"21f631c8-0b85-4b98-a556-149dfc315f9b","Type":"ContainerStarted","Data":"7c95ea31775398490799c20f5774a9c1d64cbeab47ee8114a5eac46ef60f20b0"} Jul 09 15:27:06.009508 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:06.009480 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" event={"ID":"f1d10af5-0153-41c0-8cca-a7c6ad1252da","Type":"ContainerStarted","Data":"192c665d3e167e33b49689894a99f7c54aba92c596f5af8fd661d4c8f51442a2"} Jul 09 15:27:06.022964 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:06.022867 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gk4kc" podStartSLOduration=2.355506218 podStartE2EDuration="5.022848121s" totalImagesPullingTime="2.667341903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:06.021766624 +0000 UTC m=+39.939466261" watchObservedRunningTime="2026-07-09 15:27:06.022848121 +0000 UTC m=+39.940547760" Jul 09 15:27:06.047859 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:06.047763 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7ksf9" podStartSLOduration=8.827561389 podStartE2EDuration="40.047745597s" totalImagesPullingTime="31.220184208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:06.046419303 +0000 UTC m=+39.964118940" watchObservedRunningTime="2026-07-09 15:27:06.047745597 +0000 UTC m=+39.965445232" Jul 09 15:27:09.285974 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:09.285932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:09.286375 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:09.286043 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:09.286375 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:09.286104 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:27:17.286088957 +0000 UTC m=+51.203788574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:27:17.343652 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:17.343608 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:17.344456 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:17.344402 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:17.346688 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:17.344785 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:27:33.344741909 +0000 UTC m=+67.262441541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:27:27.984296 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:27.984262 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9p68n" Jul 09 15:27:31.336083 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.336040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:27:31.336483 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.336113 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:27:31.340608 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.340592 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:27:31.340681 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.340631 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:27:31.346494 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:31.346476 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 15:27:31.346551 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:31.346541 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:28:35.346526008 +0000 UTC m=+129.264225624 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : secret "metrics-daemon-secret" not found Jul 09 15:27:31.350292 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.350270 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b7a7bac9-274f-43b3-8b11-86b27ec0b39f-original-pull-secret\") pod \"global-pull-secret-syncer-rfwbj\" (UID: \"b7a7bac9-274f-43b3-8b11-86b27ec0b39f\") " pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:27:31.436589 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.436549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:27:31.439844 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.439825 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:27:31.449750 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.449731 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:27:31.460399 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.460378 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhbwf\" (UniqueName: \"kubernetes.io/projected/f7040f84-4e0f-4952-8fae-87389c8a8b65-kube-api-access-nhbwf\") pod \"network-check-target-pqfh9\" (UID: \"f7040f84-4e0f-4952-8fae-87389c8a8b65\") " pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:27:31.497261 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.497235 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r8ws7\"" Jul 09 15:27:31.504802 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.504780 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:27:31.507065 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.507050 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rfwbj" Jul 09 15:27:31.635116 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.635085 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rfwbj"] Jul 09 15:27:31.637997 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:27:31.637970 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a7bac9_274f_43b3_8b11_86b27ec0b39f.slice/crio-55945129e73bb1efa2da4568177918dc26cd724ac2ebabb571c7bf5c3e315f30 WatchSource:0}: Error finding container 55945129e73bb1efa2da4568177918dc26cd724ac2ebabb571c7bf5c3e315f30: Status 404 returned error can't find the container with id 55945129e73bb1efa2da4568177918dc26cd724ac2ebabb571c7bf5c3e315f30 Jul 09 15:27:31.652648 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:31.652622 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pqfh9"] Jul 09 15:27:31.655352 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:27:31.655329 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7040f84_4e0f_4952_8fae_87389c8a8b65.slice/crio-d902b6e3316400c7e893fb9e9c32fb12e21a1409bcb3fe6ed514c17fc091b132 WatchSource:0}: Error finding container d902b6e3316400c7e893fb9e9c32fb12e21a1409bcb3fe6ed514c17fc091b132: Status 404 returned error can't find the container with id d902b6e3316400c7e893fb9e9c32fb12e21a1409bcb3fe6ed514c17fc091b132 Jul 09 15:27:32.071341 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.071304 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rfwbj" event={"ID":"b7a7bac9-274f-43b3-8b11-86b27ec0b39f","Type":"ContainerStarted","Data":"55945129e73bb1efa2da4568177918dc26cd724ac2ebabb571c7bf5c3e315f30"} Jul 09 15:27:32.072284 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.072262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pqfh9" event={"ID":"f7040f84-4e0f-4952-8fae-87389c8a8b65","Type":"ContainerStarted","Data":"d902b6e3316400c7e893fb9e9c32fb12e21a1409bcb3fe6ed514c17fc091b132"} Jul 09 15:27:32.826677 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.826648 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c"] Jul 09 15:27:32.828652 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.828626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" Jul 09 15:27:32.832691 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.832668 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 15:27:32.832811 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.832727 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 15:27:32.832811 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.832750 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 15:27:32.832898 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.832676 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 15:27:32.832977 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.832894 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-92dfv\"" Jul 09 15:27:32.842745 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.842692 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c"] Jul 09 15:27:32.846569 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.846538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbm4h\" (UniqueName: \"kubernetes.io/projected/0845fc70-271c-4abe-b576-011151e05988-kube-api-access-bbm4h\") pod \"managed-serviceaccount-addon-agent-5d46b55b88-jgm9c\" (UID: \"0845fc70-271c-4abe-b576-011151e05988\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" Jul 09 15:27:32.846687 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.846644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0845fc70-271c-4abe-b576-011151e05988-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d46b55b88-jgm9c\" (UID: \"0845fc70-271c-4abe-b576-011151e05988\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" Jul 09 15:27:32.947396 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.947355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbm4h\" (UniqueName: \"kubernetes.io/projected/0845fc70-271c-4abe-b576-011151e05988-kube-api-access-bbm4h\") pod \"managed-serviceaccount-addon-agent-5d46b55b88-jgm9c\" (UID: \"0845fc70-271c-4abe-b576-011151e05988\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" Jul 09 15:27:32.947396 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.947407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0845fc70-271c-4abe-b576-011151e05988-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d46b55b88-jgm9c\" (UID: \"0845fc70-271c-4abe-b576-011151e05988\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" Jul 09 15:27:32.950654 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.950620 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0845fc70-271c-4abe-b576-011151e05988-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5d46b55b88-jgm9c\" (UID: \"0845fc70-271c-4abe-b576-011151e05988\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" Jul 09 15:27:32.957903 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:32.957871 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbm4h\" (UniqueName: \"kubernetes.io/projected/0845fc70-271c-4abe-b576-011151e05988-kube-api-access-bbm4h\") pod \"managed-serviceaccount-addon-agent-5d46b55b88-jgm9c\" (UID: \"0845fc70-271c-4abe-b576-011151e05988\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" Jul 09 15:27:33.148469 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:33.148430 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" Jul 09 15:27:33.303894 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:33.303827 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c"] Jul 09 15:27:33.307048 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:27:33.307017 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0845fc70_271c_4abe_b576_011151e05988.slice/crio-920f13bf0713845cde7b5260db9f11a99fe04f89d5103279d26e3effb343b085 WatchSource:0}: Error finding container 920f13bf0713845cde7b5260db9f11a99fe04f89d5103279d26e3effb343b085: Status 404 returned error can't find the container with id 920f13bf0713845cde7b5260db9f11a99fe04f89d5103279d26e3effb343b085 Jul 09 15:27:33.350287 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:33.350205 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:27:33.350448 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:33.350381 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:33.350508 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:27:33.350452 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:28:05.350430723 +0000 UTC m=+99.268130344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:27:34.081128 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:34.081091 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" event={"ID":"0845fc70-271c-4abe-b576-011151e05988","Type":"ContainerStarted","Data":"920f13bf0713845cde7b5260db9f11a99fe04f89d5103279d26e3effb343b085"} Jul 09 15:27:38.093398 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:38.093360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" event={"ID":"0845fc70-271c-4abe-b576-011151e05988","Type":"ContainerStarted","Data":"ebbcad973cdd243507c1f0a4be2c3cc3cccde90dd467cd6bb020dbff69175d93"} Jul 09 15:27:38.094912 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:38.094886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rfwbj" event={"ID":"b7a7bac9-274f-43b3-8b11-86b27ec0b39f","Type":"ContainerStarted","Data":"e67a4b5c54fcc1ddde023f98c1c2738a6f572a4e82d189be6935aeb38098e4c7"} Jul 09 15:27:38.096259 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:38.096234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pqfh9" event={"ID":"f7040f84-4e0f-4952-8fae-87389c8a8b65","Type":"ContainerStarted","Data":"31f43a06c997d7f67f4bfae4c4b99b46a15f75908d00097311fbaf19eb50e9eb"} Jul 09 15:27:38.096382 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:38.096365 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:27:38.111480 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:38.111435 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" podStartSLOduration=1.575248764 podStartE2EDuration="6.111421495s" totalImagesPullingTime="4.536172731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:27:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:38.110583464 +0000 UTC m=+72.028283100" watchObservedRunningTime="2026-07-09 15:27:38.111421495 +0000 UTC m=+72.029121131" Jul 09 15:27:38.130093 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:38.129692 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pqfh9" podStartSLOduration=65.970889463 podStartE2EDuration="1m12.129674257s" totalImagesPullingTime="6.158784794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:38.129258437 +0000 UTC m=+72.046958086" watchObservedRunningTime="2026-07-09 15:27:38.129674257 +0000 UTC m=+72.047373874" Jul 09 15:27:38.144455 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:27:38.144411 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rfwbj" podStartSLOduration=65.946082276 podStartE2EDuration="1m12.144396327s" totalImagesPullingTime="6.198314051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:38.144209547 +0000 UTC m=+72.061909183" watchObservedRunningTime="2026-07-09 15:27:38.144396327 +0000 UTC m=+72.062095961" Jul 09 15:28:05.369290 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:28:05.369128 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:28:05.369783 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:28:05.369297 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:28:05.369783 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:28:05.369378 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:29:09.369356387 +0000 UTC m=+163.287056015 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:28:09.102381 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:28:09.102352 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pqfh9" Jul 09 15:28:35.378694 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:28:35.378644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:28:35.379120 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:28:35.378811 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 15:28:35.379120 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:28:35.378882 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs podName:570094ba-60a1-43c6-b3b0-02964cbe6af0 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:37.378866038 +0000 UTC m=+251.296565654 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs") pod "network-metrics-daemon-hcp4j" (UID: "570094ba-60a1-43c6-b3b0-02964cbe6af0") : secret "metrics-daemon-secret" not found Jul 09 15:29:04.545582 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:29:04.545531 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pq9ph" podUID="61052b40-9684-41e8-ac97-f6633e32a3ff" Jul 09 15:29:05.305935 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:05.305892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pq9ph" Jul 09 15:29:05.700993 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:29:05.700943 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hcp4j" podUID="570094ba-60a1-43c6-b3b0-02964cbe6af0" Jul 09 15:29:09.408116 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:09.408069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:29:09.408580 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:29:09.408214 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:29:09.408580 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:29:09.408300 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls podName:61052b40-9684-41e8-ac97-f6633e32a3ff nodeName:}" failed. No retries permitted until 2026-07-09 15:31:11.408280337 +0000 UTC m=+285.325979959 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls") pod "dns-default-pq9ph" (UID: "61052b40-9684-41e8-ac97-f6633e32a3ff") : secret "dns-default-metrics-tls" not found Jul 09 15:29:18.675360 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:18.675266 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:29:38.388928 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:38.388895 2564 generic.go:356] "Generic (PLEG): container finished" podID="0845fc70-271c-4abe-b576-011151e05988" containerID="ebbcad973cdd243507c1f0a4be2c3cc3cccde90dd467cd6bb020dbff69175d93" exitCode=255 Jul 09 15:29:38.389283 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:38.388968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" event={"ID":"0845fc70-271c-4abe-b576-011151e05988","Type":"ContainerDied","Data":"ebbcad973cdd243507c1f0a4be2c3cc3cccde90dd467cd6bb020dbff69175d93"} Jul 09 15:29:38.394433 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:38.394418 2564 scope.go:117] "RemoveContainer" containerID="ebbcad973cdd243507c1f0a4be2c3cc3cccde90dd467cd6bb020dbff69175d93" Jul 09 15:29:39.394697 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:39.394663 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5d46b55b88-jgm9c" event={"ID":"0845fc70-271c-4abe-b576-011151e05988","Type":"ContainerStarted","Data":"b06cad3a5d89e9a889473eb9c7c64ffb9105d1c62a83615a21ee88341790e0d7"} Jul 09 15:29:59.936504 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.936434 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-c6v9j"] Jul 09 15:29:59.938540 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.938511 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66cbdddd59-ngx6s"] Jul 09 15:29:59.938667 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.938636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:29:59.942980 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.941077 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 15:29:59.942980 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.941212 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.942980 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.941242 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:29:59.942980 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.941861 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gwllq\"" Jul 09 15:29:59.942980 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.942195 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 15:29:59.944236 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.944037 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 15:29:59.944868 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.944845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-image-registry-private-configuration\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.944985 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.944880 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6cs7\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-kube-api-access-w6cs7\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.944985 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.944970 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-config\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:29:59.945077 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.944991 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-trusted-ca\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.945077 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.945008 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-certificates\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.945077 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.945061 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvh2w\" (UniqueName: \"kubernetes.io/projected/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-kube-api-access-xvh2w\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:29:59.945181 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.945095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-installation-pull-secrets\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.945181 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.945127 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-serving-cert\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:29:59.945181 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.945151 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.945181 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.945175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/982310e0-7f19-4a29-b19e-0dce41c879ba-ca-trust-extracted\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.945365 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.945263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-trusted-ca\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:29:59.945365 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.945297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-bound-sa-token\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:29:59.946088 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.946068 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 15:29:59.946088 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.946084 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 15:29:59.946566 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.946551 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 15:29:59.947223 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.947198 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gwbcf\"" Jul 09 15:29:59.947777 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.947754 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 15:29:59.951785 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.951768 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 15:29:59.964905 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.964885 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-c6v9j"] Jul 09 15:29:59.968793 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:29:59.968773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66cbdddd59-ngx6s"] Jul 09 15:30:00.045696 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.045666 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-serving-cert\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.045696 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.045701 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.045965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.045724 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/982310e0-7f19-4a29-b19e-0dce41c879ba-ca-trust-extracted\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.045965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.045749 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-trusted-ca\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.045965 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.045840 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:00.045965 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.045858 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66cbdddd59-ngx6s: secret "image-registry-tls" not found Jul 09 15:30:00.045965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.045860 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-bound-sa-token\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.045965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.045892 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-image-registry-private-configuration\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.045965 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.045947 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls podName:982310e0-7f19-4a29-b19e-0dce41c879ba nodeName:}" failed. No retries permitted until 2026-07-09 15:30:00.545903312 +0000 UTC m=+214.463602942 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls") pod "image-registry-66cbdddd59-ngx6s" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba") : secret "image-registry-tls" not found Jul 09 15:30:00.046324 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.045979 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6cs7\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-kube-api-access-w6cs7\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.046324 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-config\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.046324 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-trusted-ca\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.046324 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-certificates\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.046324 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvh2w\" (UniqueName: \"kubernetes.io/projected/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-kube-api-access-xvh2w\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.046324 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-installation-pull-secrets\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.046324 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046186 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/982310e0-7f19-4a29-b19e-0dce41c879ba-ca-trust-extracted\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.046733 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046692 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-certificates\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.046733 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046699 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-trusted-ca\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.046970 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.046837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-config\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.047476 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.047456 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-trusted-ca\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.048891 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.048800 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-image-registry-private-configuration\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.049005 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.048936 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-installation-pull-secrets\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.049070 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.049054 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-serving-cert\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.049383 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.049365 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt"] Jul 09 15:30:00.051997 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.051981 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:00.054206 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.054188 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 09 15:30:00.054642 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.054622 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 09 15:30:00.055025 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.055007 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-dxbmh\"" Jul 09 15:30:00.055106 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.055008 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:00.065551 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.065524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-bound-sa-token\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.068651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.068631 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt"] Jul 09 15:30:00.069557 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.069504 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6cs7\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-kube-api-access-w6cs7\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.071298 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.071279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvh2w\" (UniqueName: \"kubernetes.io/projected/d9a72df8-24c2-4ccc-ba69-26ee5a2801c9-kube-api-access-xvh2w\") pod \"console-operator-7866497494-c6v9j\" (UID: \"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9\") " pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.132042 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.132012 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7ff8j"] Jul 09 15:30:00.133731 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.133715 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.138660 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.138640 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 15:30:00.138788 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.138665 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 15:30:00.138849 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.138837 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-9l4vp\"" Jul 09 15:30:00.139026 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.138968 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 15:30:00.141430 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.141407 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7548f45bc4-xvtw4"] Jul 09 15:30:00.143065 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.143049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.143453 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.143435 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 15:30:00.146326 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146306 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 15:30:00.146413 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146311 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 15:30:00.146636 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.146672 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146647 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-default-certificate\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.146705 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146671 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsscj\" (UniqueName: \"kubernetes.io/projected/7e50328a-0981-4a39-bccb-8526ff377077-kube-api-access-zsscj\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:00.146737 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:00.146769 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146750 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-stats-auth\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.146769 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146760 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 15:30:00.146829 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcnwc\" (UniqueName: \"kubernetes.io/projected/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-kube-api-access-zcnwc\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.146860 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146827 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-serving-cert\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.146900 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146856 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-tmp\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.146986 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.146968 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.147031 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.147001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lpsf\" (UniqueName: \"kubernetes.io/projected/241bdd29-60e6-4961-9a09-a9c1d60a482a-kube-api-access-6lpsf\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.147089 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.147074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.147156 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.147137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-snapshots\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.147208 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.147171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.147560 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.147547 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 15:30:00.147759 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.147745 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 15:30:00.148022 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.148005 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 15:30:00.148112 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.148043 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9qzpb\"" Jul 09 15:30:00.148176 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.148164 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 15:30:00.154433 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.154415 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7ff8j"] Jul 09 15:30:00.164103 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.164080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7548f45bc4-xvtw4"] Jul 09 15:30:00.247502 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247407 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.247502 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lpsf\" (UniqueName: \"kubernetes.io/projected/241bdd29-60e6-4961-9a09-a9c1d60a482a-kube-api-access-6lpsf\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.247502 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247528 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-snapshots\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.247599 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:00.747576062 +0000 UTC m=+214.665275677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.247624 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247650 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.247674 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:00.747664673 +0000 UTC m=+214.665364293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : secret "router-metrics-certs-default" not found Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-default-certificate\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsscj\" (UniqueName: \"kubernetes.io/projected/7e50328a-0981-4a39-bccb-8526ff377077-kube-api-access-zsscj\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247767 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:00.247789 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-stats-auth\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.248487 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcnwc\" (UniqueName: \"kubernetes.io/projected/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-kube-api-access-zcnwc\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.248487 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-serving-cert\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.248487 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.247871 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:00.248487 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.247875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-tmp\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.248487 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.247956 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls podName:7e50328a-0981-4a39-bccb-8526ff377077 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:00.747937704 +0000 UTC m=+214.665637332 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls") pod "cluster-samples-operator-65db858894-hfhgt" (UID: "7e50328a-0981-4a39-bccb-8526ff377077") : secret "samples-operator-tls" not found Jul 09 15:30:00.248487 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.248262 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-tmp\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.248487 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.248276 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.248487 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.248267 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-snapshots\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.248798 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.248725 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.250311 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.250294 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-stats-auth\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.250391 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.250377 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-default-certificate\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.250449 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.250435 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-serving-cert\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.250484 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.250462 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:00.256200 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.256176 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcnwc\" (UniqueName: \"kubernetes.io/projected/e9a06d1f-3c53-496b-a1e0-588a1a4fb21e-kube-api-access-zcnwc\") pod \"insights-operator-68d9dd94cf-7ff8j\" (UID: \"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e\") " pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.256304 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.256179 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lpsf\" (UniqueName: \"kubernetes.io/projected/241bdd29-60e6-4961-9a09-a9c1d60a482a-kube-api-access-6lpsf\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.256304 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.256278 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsscj\" (UniqueName: \"kubernetes.io/projected/7e50328a-0981-4a39-bccb-8526ff377077-kube-api-access-zsscj\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:00.380186 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.380153 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-c6v9j"] Jul 09 15:30:00.382852 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:00.382826 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a72df8_24c2_4ccc_ba69_26ee5a2801c9.slice/crio-a48dc997539145ea783fccade860c09b5ab2ca3275dee17901644a2cd896dfe1 WatchSource:0}: Error finding container a48dc997539145ea783fccade860c09b5ab2ca3275dee17901644a2cd896dfe1: Status 404 returned error can't find the container with id a48dc997539145ea783fccade860c09b5ab2ca3275dee17901644a2cd896dfe1 Jul 09 15:30:00.442979 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.442949 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" Jul 09 15:30:00.456519 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.456491 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c6v9j" event={"ID":"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9","Type":"ContainerStarted","Data":"a48dc997539145ea783fccade860c09b5ab2ca3275dee17901644a2cd896dfe1"} Jul 09 15:30:00.551515 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.551483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:00.551661 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.551630 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:00.551661 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.551650 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66cbdddd59-ngx6s: secret "image-registry-tls" not found Jul 09 15:30:00.551751 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.551705 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls podName:982310e0-7f19-4a29-b19e-0dce41c879ba nodeName:}" failed. No retries permitted until 2026-07-09 15:30:01.551688572 +0000 UTC m=+215.469388190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls") pod "image-registry-66cbdddd59-ngx6s" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba") : secret "image-registry-tls" not found Jul 09 15:30:00.571266 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.571241 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7ff8j"] Jul 09 15:30:00.573390 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:00.573357 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9a06d1f_3c53_496b_a1e0_588a1a4fb21e.slice/crio-2301c7d219172eeea0cd28e78a98730f71ef778892240cfa58ea0b85098e6c26 WatchSource:0}: Error finding container 2301c7d219172eeea0cd28e78a98730f71ef778892240cfa58ea0b85098e6c26: Status 404 returned error can't find the container with id 2301c7d219172eeea0cd28e78a98730f71ef778892240cfa58ea0b85098e6c26 Jul 09 15:30:00.753551 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.753510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:00.753746 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.753649 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:00.753746 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.753684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.753746 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.753713 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls podName:7e50328a-0981-4a39-bccb-8526ff377077 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:01.75369801 +0000 UTC m=+215.671397626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls") pod "cluster-samples-operator-65db858894-hfhgt" (UID: "7e50328a-0981-4a39-bccb-8526ff377077") : secret "samples-operator-tls" not found Jul 09 15:30:00.753954 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:00.753766 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:00.753954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.753780 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:01.753762388 +0000 UTC m=+215.671462002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:00.753954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.753807 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:00.753954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:00.753892 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:01.753865116 +0000 UTC m=+215.671564733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : secret "router-metrics-certs-default" not found Jul 09 15:30:01.460491 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:01.460451 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" event={"ID":"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e","Type":"ContainerStarted","Data":"2301c7d219172eeea0cd28e78a98730f71ef778892240cfa58ea0b85098e6c26"} Jul 09 15:30:01.560842 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:01.560806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:01.561022 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:01.560987 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:01.561022 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:01.561009 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66cbdddd59-ngx6s: secret "image-registry-tls" not found Jul 09 15:30:01.561112 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:01.561077 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls podName:982310e0-7f19-4a29-b19e-0dce41c879ba nodeName:}" failed. No retries permitted until 2026-07-09 15:30:03.561053138 +0000 UTC m=+217.478752755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls") pod "image-registry-66cbdddd59-ngx6s" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba") : secret "image-registry-tls" not found Jul 09 15:30:01.762627 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:01.762538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:01.762627 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:01.762595 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:01.762807 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:01.762689 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:01.762807 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:01.762723 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:03.762704027 +0000 UTC m=+217.680403647 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:01.762807 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:01.762793 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:03.762775067 +0000 UTC m=+217.680474683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : secret "router-metrics-certs-default" not found Jul 09 15:30:01.762984 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:01.762844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:01.762984 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:01.762949 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:01.762984 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:01.762981 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls podName:7e50328a-0981-4a39-bccb-8526ff377077 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:03.762973418 +0000 UTC m=+217.680673031 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls") pod "cluster-samples-operator-65db858894-hfhgt" (UID: "7e50328a-0981-4a39-bccb-8526ff377077") : secret "samples-operator-tls" not found Jul 09 15:30:03.468761 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:03.468734 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/0.log" Jul 09 15:30:03.469233 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:03.468775 2564 generic.go:356] "Generic (PLEG): container finished" podID="d9a72df8-24c2-4ccc-ba69-26ee5a2801c9" containerID="d49a85dec60c70214256d564d4e7fd8fe130e379a9ce90836e2efc13c6b47fdf" exitCode=255 Jul 09 15:30:03.469233 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:03.468834 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c6v9j" event={"ID":"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9","Type":"ContainerDied","Data":"d49a85dec60c70214256d564d4e7fd8fe130e379a9ce90836e2efc13c6b47fdf"} Jul 09 15:30:03.469233 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:03.469179 2564 scope.go:117] "RemoveContainer" containerID="d49a85dec60c70214256d564d4e7fd8fe130e379a9ce90836e2efc13c6b47fdf" Jul 09 15:30:03.580064 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:03.580025 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:03.580257 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:03.580201 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:03.580257 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:03.580226 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66cbdddd59-ngx6s: secret "image-registry-tls" not found Jul 09 15:30:03.580366 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:03.580296 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls podName:982310e0-7f19-4a29-b19e-0dce41c879ba nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.580275449 +0000 UTC m=+221.497975084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls") pod "image-registry-66cbdddd59-ngx6s" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba") : secret "image-registry-tls" not found Jul 09 15:30:03.781703 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:03.781604 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:03.781703 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:03.781681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:03.781951 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:03.781737 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:03.781951 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:03.781761 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:03.781951 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:03.781819 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:03.781951 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:03.781824 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.781807518 +0000 UTC m=+221.699507131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : secret "router-metrics-certs-default" not found Jul 09 15:30:03.781951 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:03.781874 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.781862331 +0000 UTC m=+221.699561944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:03.781951 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:03.781886 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls podName:7e50328a-0981-4a39-bccb-8526ff377077 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.781880121 +0000 UTC m=+221.699579734 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls") pod "cluster-samples-operator-65db858894-hfhgt" (UID: "7e50328a-0981-4a39-bccb-8526ff377077") : secret "samples-operator-tls" not found Jul 09 15:30:04.473409 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.473380 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:30:04.473833 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.473819 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/0.log" Jul 09 15:30:04.473879 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.473851 2564 generic.go:356] "Generic (PLEG): container finished" podID="d9a72df8-24c2-4ccc-ba69-26ee5a2801c9" containerID="8091e7b34153f1f9304af45a3f64885cea28096ca686ce0116e2ce1ed474c8f4" exitCode=255 Jul 09 15:30:04.473973 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.473946 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c6v9j" event={"ID":"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9","Type":"ContainerDied","Data":"8091e7b34153f1f9304af45a3f64885cea28096ca686ce0116e2ce1ed474c8f4"} Jul 09 15:30:04.474056 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.474043 2564 scope.go:117] "RemoveContainer" containerID="d49a85dec60c70214256d564d4e7fd8fe130e379a9ce90836e2efc13c6b47fdf" Jul 09 15:30:04.474314 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.474290 2564 scope.go:117] "RemoveContainer" containerID="8091e7b34153f1f9304af45a3f64885cea28096ca686ce0116e2ce1ed474c8f4" Jul 09 15:30:04.474511 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:04.474489 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c6v9j_openshift-console-operator(d9a72df8-24c2-4ccc-ba69-26ee5a2801c9)\"" pod="openshift-console-operator/console-operator-7866497494-c6v9j" podUID="d9a72df8-24c2-4ccc-ba69-26ee5a2801c9" Jul 09 15:30:04.475408 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.475387 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" event={"ID":"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e","Type":"ContainerStarted","Data":"ff99a2698ba980955920172269cf1a4e0db56ccf08d1c57aa7d8210ffbb998db"} Jul 09 15:30:04.509626 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.509568 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" podStartSLOduration=1.605273806 podStartE2EDuration="4.509549008s" totalImagesPullingTime="2.904275202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:04.509129622 +0000 UTC m=+218.426829254" watchObservedRunningTime="2026-07-09 15:30:04.509549008 +0000 UTC m=+218.427248623" Jul 09 15:30:04.781948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.781848 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-prh5h"] Jul 09 15:30:04.784625 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.784602 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.786859 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.786842 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdrfs\"" Jul 09 15:30:04.787081 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.787065 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 15:30:04.787322 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.787308 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 15:30:04.796847 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.796800 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-prh5h"] Jul 09 15:30:04.891485 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.891452 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40808fa7-0ac9-461f-b481-c725a1917cee-data-volume\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.891653 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.891500 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40808fa7-0ac9-461f-b481-c725a1917cee-crio-socket\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.891653 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.891528 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.891653 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.891606 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.891653 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.891644 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78zsf\" (UniqueName: \"kubernetes.io/projected/40808fa7-0ac9-461f-b481-c725a1917cee-kube-api-access-78zsf\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.992064 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.992033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.992221 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.992070 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78zsf\" (UniqueName: \"kubernetes.io/projected/40808fa7-0ac9-461f-b481-c725a1917cee-kube-api-access-78zsf\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.992221 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:04.992150 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:04.992288 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:04.992226 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:05.492210556 +0000 UTC m=+219.409910170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : configmap "kube-rbac-proxy" not found Jul 09 15:30:04.992288 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.992279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40808fa7-0ac9-461f-b481-c725a1917cee-data-volume\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.992357 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.992315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40808fa7-0ac9-461f-b481-c725a1917cee-crio-socket\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.992357 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.992330 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.992417 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.992397 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/40808fa7-0ac9-461f-b481-c725a1917cee-crio-socket\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:04.992447 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:04.992426 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:04.992507 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:04.992459 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:05.492450737 +0000 UTC m=+219.410150351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:04.992633 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:04.992610 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/40808fa7-0ac9-461f-b481-c725a1917cee-data-volume\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:05.004239 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:05.004210 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78zsf\" (UniqueName: \"kubernetes.io/projected/40808fa7-0ac9-461f-b481-c725a1917cee-kube-api-access-78zsf\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:05.479864 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:05.479835 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:30:05.480315 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:05.480245 2564 scope.go:117] "RemoveContainer" containerID="8091e7b34153f1f9304af45a3f64885cea28096ca686ce0116e2ce1ed474c8f4" Jul 09 15:30:05.480421 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:05.480401 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c6v9j_openshift-console-operator(d9a72df8-24c2-4ccc-ba69-26ee5a2801c9)\"" pod="openshift-console-operator/console-operator-7866497494-c6v9j" podUID="d9a72df8-24c2-4ccc-ba69-26ee5a2801c9" Jul 09 15:30:05.495806 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:05.495774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:05.495963 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:05.495880 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:05.495963 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:05.495959 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:06.495940466 +0000 UTC m=+220.413640082 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:05.496095 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:05.496009 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:05.496138 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:05.496105 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:05.496171 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:05.496158 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:06.496144017 +0000 UTC m=+220.413843631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : configmap "kube-rbac-proxy" not found Jul 09 15:30:06.504817 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.504784 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:06.504817 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.504827 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:06.505272 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:06.504899 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:06.505272 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:06.504963 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:06.505272 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:06.504972 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:08.504957139 +0000 UTC m=+222.422656752 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : configmap "kube-rbac-proxy" not found Jul 09 15:30:06.505272 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:06.505042 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:08.505022599 +0000 UTC m=+222.422722226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:06.633310 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.633262 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tsz79"] Jul 09 15:30:06.636039 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.636015 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.638690 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.638669 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 15:30:06.638811 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.638672 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 15:30:06.639590 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.639576 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 15:30:06.639659 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.639642 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 15:30:06.639711 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.639695 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-f8nlp\"" Jul 09 15:30:06.645185 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.645164 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tsz79"] Jul 09 15:30:06.706733 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.706697 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e184754-685f-48af-acc0-cfdfbf5ad17f-signing-key\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.706903 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.706751 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e184754-685f-48af-acc0-cfdfbf5ad17f-signing-cabundle\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.706903 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.706769 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w565f\" (UniqueName: \"kubernetes.io/projected/0e184754-685f-48af-acc0-cfdfbf5ad17f-kube-api-access-w565f\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.807210 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.807129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e184754-685f-48af-acc0-cfdfbf5ad17f-signing-key\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.807210 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.807187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e184754-685f-48af-acc0-cfdfbf5ad17f-signing-cabundle\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.807210 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.807203 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w565f\" (UniqueName: \"kubernetes.io/projected/0e184754-685f-48af-acc0-cfdfbf5ad17f-kube-api-access-w565f\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.807880 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.807857 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0e184754-685f-48af-acc0-cfdfbf5ad17f-signing-cabundle\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.809636 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.809609 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0e184754-685f-48af-acc0-cfdfbf5ad17f-signing-key\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.816220 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.816194 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w565f\" (UniqueName: \"kubernetes.io/projected/0e184754-685f-48af-acc0-cfdfbf5ad17f-kube-api-access-w565f\") pod \"service-ca-79f68b9f4f-tsz79\" (UID: \"0e184754-685f-48af-acc0-cfdfbf5ad17f\") " pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:06.945479 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:06.945440 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" Jul 09 15:30:07.077812 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:07.077729 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-tsz79"] Jul 09 15:30:07.080678 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:07.080639 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e184754_685f_48af_acc0_cfdfbf5ad17f.slice/crio-e3ace9fd4d8a7b178580070d7538fa55f828883ad17900c4e639446ecc6e1547 WatchSource:0}: Error finding container e3ace9fd4d8a7b178580070d7538fa55f828883ad17900c4e639446ecc6e1547: Status 404 returned error can't find the container with id e3ace9fd4d8a7b178580070d7538fa55f828883ad17900c4e639446ecc6e1547 Jul 09 15:30:07.486558 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:07.486522 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" event={"ID":"0e184754-685f-48af-acc0-cfdfbf5ad17f","Type":"ContainerStarted","Data":"e3ace9fd4d8a7b178580070d7538fa55f828883ad17900c4e639446ecc6e1547"} Jul 09 15:30:07.565469 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:07.565435 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d7mnj_dc1e8316-7b3f-47b7-b7b0-6831130b9e5d/dns-node-resolver/0.log" Jul 09 15:30:07.614096 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:07.614069 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:07.614251 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:07.614221 2564 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:07.614251 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:07.614238 2564 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66cbdddd59-ngx6s: secret "image-registry-tls" not found Jul 09 15:30:07.614326 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:07.614294 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls podName:982310e0-7f19-4a29-b19e-0dce41c879ba nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.614275936 +0000 UTC m=+229.531975553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls") pod "image-registry-66cbdddd59-ngx6s" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba") : secret "image-registry-tls" not found Jul 09 15:30:07.816328 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:07.816236 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:07.816328 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:07.816320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:07.816519 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:07.816392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:07.816519 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:07.816443 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.816420884 +0000 UTC m=+229.734120512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:07.816519 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:07.816454 2564 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:07.816519 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:07.816506 2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 09 15:30:07.816688 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:07.816513 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.816496468 +0000 UTC m=+229.734196085 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : secret "router-metrics-certs-default" not found Jul 09 15:30:07.816688 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:07.816574 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls podName:7e50328a-0981-4a39-bccb-8526ff377077 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.816560622 +0000 UTC m=+229.734260242 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls") pod "cluster-samples-operator-65db858894-hfhgt" (UID: "7e50328a-0981-4a39-bccb-8526ff377077") : secret "samples-operator-tls" not found Jul 09 15:30:08.364163 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:08.364136 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-df9fw_cf35a2fc-9f61-4605-a428-033b174483ce/node-ca/0.log" Jul 09 15:30:08.522762 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:08.522716 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:08.522954 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:08.522781 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:08.522954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:08.522862 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:08.522954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:08.522888 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:08.522954 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:08.522941 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:12.522906478 +0000 UTC m=+226.440606095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : configmap "kube-rbac-proxy" not found Jul 09 15:30:08.523114 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:08.522960 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:12.522951574 +0000 UTC m=+226.440651190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:09.166001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:09.165975 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gk4kc_21f631c8-0b85-4b98-a556-149dfc315f9b/serve-healthcheck-canary/0.log" Jul 09 15:30:10.251163 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:10.251117 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:10.251559 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:10.251184 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:10.251559 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:10.251512 2564 scope.go:117] "RemoveContainer" containerID="8091e7b34153f1f9304af45a3f64885cea28096ca686ce0116e2ce1ed474c8f4" Jul 09 15:30:10.251670 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:10.251651 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-c6v9j_openshift-console-operator(d9a72df8-24c2-4ccc-ba69-26ee5a2801c9)\"" pod="openshift-console-operator/console-operator-7866497494-c6v9j" podUID="d9a72df8-24c2-4ccc-ba69-26ee5a2801c9" Jul 09 15:30:10.496387 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:10.496352 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" event={"ID":"0e184754-685f-48af-acc0-cfdfbf5ad17f","Type":"ContainerStarted","Data":"bd9ca1f88fb994d455445bfc017ecf01b0e92e20ba8e06fa88ccc15e947025d5"} Jul 09 15:30:12.557283 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:12.557253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:12.557661 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:12.557298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:12.557661 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:12.557428 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:12.557661 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:12.557427 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:12.557661 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:12.557493 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:20.557477904 +0000 UTC m=+234.475177523 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : configmap "kube-rbac-proxy" not found Jul 09 15:30:12.557661 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:12.557507 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:20.557501048 +0000 UTC m=+234.475200662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:15.682906 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.682872 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:15.688495 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.688466 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"image-registry-66cbdddd59-ngx6s\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:15.855996 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.855953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:15.884250 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.884209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:15.884400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.884269 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:15.884400 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.884328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:15.884518 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:15.884490 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle podName:241bdd29-60e6-4961-9a09-a9c1d60a482a nodeName:}" failed. No retries permitted until 2026-07-09 15:30:31.884470685 +0000 UTC m=+245.802170298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle") pod "router-default-7548f45bc4-xvtw4" (UID: "241bdd29-60e6-4961-9a09-a9c1d60a482a") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:15.886975 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.886948 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/7e50328a-0981-4a39-bccb-8526ff377077-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-hfhgt\" (UID: \"7e50328a-0981-4a39-bccb-8526ff377077\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:15.887197 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.887177 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/241bdd29-60e6-4961-9a09-a9c1d60a482a-metrics-certs\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:15.965971 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.965900 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" Jul 09 15:30:15.995699 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.995573 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-tsz79" podStartSLOduration=7.381263671 podStartE2EDuration="9.995556202s" totalImagesPullingTime="2.614292531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:10.518269658 +0000 UTC m=+224.435969295" watchObservedRunningTime="2026-07-09 15:30:15.995556202 +0000 UTC m=+229.913255845" Jul 09 15:30:15.995772 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:15.995703 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66cbdddd59-ngx6s"] Jul 09 15:30:15.998193 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:15.998151 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982310e0_7f19_4a29_b19e_0dce41c879ba.slice/crio-ced3e185d87acfba511b56a2d1ad393c9b88570cfb9b59771a2f6ef43d1bb329 WatchSource:0}: Error finding container ced3e185d87acfba511b56a2d1ad393c9b88570cfb9b59771a2f6ef43d1bb329: Status 404 returned error can't find the container with id ced3e185d87acfba511b56a2d1ad393c9b88570cfb9b59771a2f6ef43d1bb329 Jul 09 15:30:16.117492 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:16.117464 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt"] Jul 09 15:30:16.515781 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:16.515745 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" event={"ID":"982310e0-7f19-4a29-b19e-0dce41c879ba","Type":"ContainerStarted","Data":"a9f69e0bcacdd4bb4b1fa09c5be017bf047ebbab493c84868136be2fd67c9928"} Jul 09 15:30:16.516002 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:16.515794 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" event={"ID":"982310e0-7f19-4a29-b19e-0dce41c879ba","Type":"ContainerStarted","Data":"ced3e185d87acfba511b56a2d1ad393c9b88570cfb9b59771a2f6ef43d1bb329"} Jul 09 15:30:16.516002 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:16.515825 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:16.516854 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:16.516830 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" event={"ID":"7e50328a-0981-4a39-bccb-8526ff377077","Type":"ContainerStarted","Data":"5cb7331ceb7423e0ba7981374b11ed2452728ca78fba18a22af3869dd15e7467"} Jul 09 15:30:16.541980 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:16.539748 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" podStartSLOduration=17.539728208 podStartE2EDuration="17.539728208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:16.538245969 +0000 UTC m=+230.455945619" watchObservedRunningTime="2026-07-09 15:30:16.539728208 +0000 UTC m=+230.457427849" Jul 09 15:30:20.620741 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:20.620703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:20.621228 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:20.620758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:20.621228 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:20.620862 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:20.621228 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:20.620954 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls podName:40808fa7-0ac9-461f-b481-c725a1917cee nodeName:}" failed. No retries permitted until 2026-07-09 15:30:36.620939351 +0000 UTC m=+250.538638964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls") pod "insights-runtime-extractor-prh5h" (UID: "40808fa7-0ac9-461f-b481-c725a1917cee") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:20.621454 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:20.621428 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/40808fa7-0ac9-461f-b481-c725a1917cee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:23.541073 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:23.541041 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" event={"ID":"7e50328a-0981-4a39-bccb-8526ff377077","Type":"ContainerStarted","Data":"4913a6c8e52658d9704a9d7eba4206312225183f7cdcb5ef2e2c5c70bb325c1f"} Jul 09 15:30:23.541441 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:23.541096 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" event={"ID":"7e50328a-0981-4a39-bccb-8526ff377077","Type":"ContainerStarted","Data":"b4e4b8d010331fa9837737fa65d7d49eb1bd538f12fa965202524b85aa6a7578"} Jul 09 15:30:24.679066 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:24.679039 2564 scope.go:117] "RemoveContainer" containerID="8091e7b34153f1f9304af45a3f64885cea28096ca686ce0116e2ce1ed474c8f4" Jul 09 15:30:25.548493 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:25.548466 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:30:25.548658 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:25.548551 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-c6v9j" event={"ID":"d9a72df8-24c2-4ccc-ba69-26ee5a2801c9","Type":"ContainerStarted","Data":"0eb86723871f50a640d7cab93bbc578085ea987250b24b69658b682a6ecacbeb"} Jul 09 15:30:25.548855 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:25.548830 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:25.553392 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:25.553372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-c6v9j" Jul 09 15:30:25.567303 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:25.567257 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-c6v9j" podStartSLOduration=24.217092219 podStartE2EDuration="26.567240287s" totalImagesPullingTime="2.350148068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:25.566703671 +0000 UTC m=+239.484403309" watchObservedRunningTime="2026-07-09 15:30:25.567240287 +0000 UTC m=+239.484939925" Jul 09 15:30:25.568068 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:25.568024 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-hfhgt" podStartSLOduration=19.198659487 podStartE2EDuration="25.568015773s" totalImagesPullingTime="6.369356286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:23.563391177 +0000 UTC m=+237.481090813" watchObservedRunningTime="2026-07-09 15:30:25.568015773 +0000 UTC m=+239.485715408" Jul 09 15:30:31.427796 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:31.427763 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66cbdddd59-ngx6s"] Jul 09 15:30:31.432085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:31.432047 2564 patch_prober.go:28] interesting pod/image-registry-66cbdddd59-ngx6s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:30:31.432244 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:31.432103 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" podUID="982310e0-7f19-4a29-b19e-0dce41c879ba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:31.906201 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:31.906163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:31.906878 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:31.906851 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/241bdd29-60e6-4961-9a09-a9c1d60a482a-service-ca-bundle\") pod \"router-default-7548f45bc4-xvtw4\" (UID: \"241bdd29-60e6-4961-9a09-a9c1d60a482a\") " pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:31.953792 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:31.953760 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9qzpb\"" Jul 09 15:30:31.962015 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:31.961983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:32.094642 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:32.094616 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7548f45bc4-xvtw4"] Jul 09 15:30:32.096869 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:32.096843 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod241bdd29_60e6_4961_9a09_a9c1d60a482a.slice/crio-0bff90dcb209bff6af8f46eb1d200e042fee7e34e5a847cda2a2e10514efbb59 WatchSource:0}: Error finding container 0bff90dcb209bff6af8f46eb1d200e042fee7e34e5a847cda2a2e10514efbb59: Status 404 returned error can't find the container with id 0bff90dcb209bff6af8f46eb1d200e042fee7e34e5a847cda2a2e10514efbb59 Jul 09 15:30:32.574164 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:32.574126 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" event={"ID":"241bdd29-60e6-4961-9a09-a9c1d60a482a","Type":"ContainerStarted","Data":"feaaec8a71357f0899f85d1a7a7eaff12213ad9f38b4ff4b571f5e57bab8e9fa"} Jul 09 15:30:32.574642 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:32.574179 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" event={"ID":"241bdd29-60e6-4961-9a09-a9c1d60a482a","Type":"ContainerStarted","Data":"0bff90dcb209bff6af8f46eb1d200e042fee7e34e5a847cda2a2e10514efbb59"} Jul 09 15:30:32.617381 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:32.617328 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" podStartSLOduration=32.617310712 podStartE2EDuration="32.617310712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:32.615799743 +0000 UTC m=+246.533499375" watchObservedRunningTime="2026-07-09 15:30:32.617310712 +0000 UTC m=+246.535010347" Jul 09 15:30:32.962985 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:32.962946 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:32.965581 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:32.965549 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:33.577036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:33.576999 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:33.578223 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:33.578200 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7548f45bc4-xvtw4" Jul 09 15:30:36.642850 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:36.642806 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:36.645177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:36.645158 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/40808fa7-0ac9-461f-b481-c725a1917cee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-prh5h\" (UID: \"40808fa7-0ac9-461f-b481-c725a1917cee\") " pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:36.895953 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:36.895846 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdrfs\"" Jul 09 15:30:36.903402 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:36.903382 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-prh5h" Jul 09 15:30:37.034896 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:37.034835 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-prh5h"] Jul 09 15:30:37.036937 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:37.036887 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40808fa7_0ac9_461f_b481_c725a1917cee.slice/crio-491424b74024644beded4b37bd380bc4df70f9b0f417532d627d98a21b2088b0 WatchSource:0}: Error finding container 491424b74024644beded4b37bd380bc4df70f9b0f417532d627d98a21b2088b0: Status 404 returned error can't find the container with id 491424b74024644beded4b37bd380bc4df70f9b0f417532d627d98a21b2088b0 Jul 09 15:30:37.448372 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:37.448338 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:30:37.450832 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:37.450808 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/570094ba-60a1-43c6-b3b0-02964cbe6af0-metrics-certs\") pod \"network-metrics-daemon-hcp4j\" (UID: \"570094ba-60a1-43c6-b3b0-02964cbe6af0\") " pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:30:37.579411 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:37.579380 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ht5qx\"" Jul 09 15:30:37.586955 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:37.586812 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hcp4j" Jul 09 15:30:37.590038 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:37.590002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-prh5h" event={"ID":"40808fa7-0ac9-461f-b481-c725a1917cee","Type":"ContainerStarted","Data":"491424b74024644beded4b37bd380bc4df70f9b0f417532d627d98a21b2088b0"} Jul 09 15:30:37.751263 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:37.751167 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hcp4j"] Jul 09 15:30:37.756197 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:37.756149 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570094ba_60a1_43c6_b3b0_02964cbe6af0.slice/crio-068043578ad72d02618a778e2d1a62abd1e7f2d943c258139a9614324e848b3c WatchSource:0}: Error finding container 068043578ad72d02618a778e2d1a62abd1e7f2d943c258139a9614324e848b3c: Status 404 returned error can't find the container with id 068043578ad72d02618a778e2d1a62abd1e7f2d943c258139a9614324e848b3c Jul 09 15:30:38.595846 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:38.595787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hcp4j" event={"ID":"570094ba-60a1-43c6-b3b0-02964cbe6af0","Type":"ContainerStarted","Data":"068043578ad72d02618a778e2d1a62abd1e7f2d943c258139a9614324e848b3c"} Jul 09 15:30:39.601375 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:39.601336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hcp4j" event={"ID":"570094ba-60a1-43c6-b3b0-02964cbe6af0","Type":"ContainerStarted","Data":"66e7795ee251626be2fa8a0c2b7a33b8940b6096b4669fbaa55fc4ddb054d9f2"} Jul 09 15:30:39.601860 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:39.601400 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hcp4j" event={"ID":"570094ba-60a1-43c6-b3b0-02964cbe6af0","Type":"ContainerStarted","Data":"4fde910f6eabccf096973755186f30b67339efb67d9efc4f0d6b1b97effd9b43"} Jul 09 15:30:39.623488 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:39.623424 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hcp4j" podStartSLOduration=252.643612977 podStartE2EDuration="4m13.623403888s" totalImagesPullingTime="979.790911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:39.621345956 +0000 UTC m=+253.539045593" watchObservedRunningTime="2026-07-09 15:30:39.623403888 +0000 UTC m=+253.541103524" Jul 09 15:30:41.432306 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:41.432269 2564 patch_prober.go:28] interesting pod/image-registry-66cbdddd59-ngx6s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:30:41.432677 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:41.432323 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" podUID="982310e0-7f19-4a29-b19e-0dce41c879ba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:41.610076 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:41.610032 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-prh5h" event={"ID":"40808fa7-0ac9-461f-b481-c725a1917cee","Type":"ContainerStarted","Data":"5f5cc9556636af0d2d67b2c8d89bf18b2aafd7ada4fe561581139a30d3c37515"} Jul 09 15:30:44.620390 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:44.620354 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-prh5h" event={"ID":"40808fa7-0ac9-461f-b481-c725a1917cee","Type":"ContainerStarted","Data":"e9796b50d443d6f98f050f3e0eed16a2a95470c8a353665d77d6f046d28c6862"} Jul 09 15:30:45.029445 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.029411 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8666df6c97-vdmjd"] Jul 09 15:30:45.032505 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.032482 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.035649 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.035629 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 15:30:45.035773 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.035672 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 15:30:45.036381 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.036362 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 15:30:45.036479 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.036400 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 15:30:45.036859 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.036841 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z6sb7\"" Jul 09 15:30:45.036906 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.036866 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 15:30:45.037773 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.037756 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 15:30:45.038008 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.037959 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 15:30:45.040746 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.040728 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 15:30:45.046418 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.046397 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8666df6c97-vdmjd"] Jul 09 15:30:45.119885 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.119848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w596\" (UniqueName: \"kubernetes.io/projected/17f46189-b120-45ce-a187-074ac888e842-kube-api-access-5w596\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.120085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.119897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-oauth-serving-cert\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.120085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.120011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-serving-cert\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.120085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.120044 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-service-ca\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.120085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.120072 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-console-config\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.120296 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.120095 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-trusted-ca-bundle\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.120296 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.120179 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-oauth-config\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.221435 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.221400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-console-config\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.221435 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.221442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-trusted-ca-bundle\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.221741 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.221487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-oauth-config\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.221741 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.221530 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w596\" (UniqueName: \"kubernetes.io/projected/17f46189-b120-45ce-a187-074ac888e842-kube-api-access-5w596\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.221741 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.221578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-oauth-serving-cert\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.221741 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.221624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-serving-cert\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.221741 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.221642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-service-ca\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.222290 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.222265 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-console-config\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.222412 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.222385 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-trusted-ca-bundle\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.222680 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.222660 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-oauth-serving-cert\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.222747 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.222712 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-service-ca\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.224850 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.224829 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-oauth-config\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.225044 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.225022 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-serving-cert\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.230745 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.230704 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w596\" (UniqueName: \"kubernetes.io/projected/17f46189-b120-45ce-a187-074ac888e842-kube-api-access-5w596\") pod \"console-8666df6c97-vdmjd\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.341526 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.341495 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:45.491269 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.490909 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8666df6c97-vdmjd"] Jul 09 15:30:45.493983 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:45.493951 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17f46189_b120_45ce_a187_074ac888e842.slice/crio-9cd772c30a903a5aaf09280cf99c07f10a9238e7f50d69b7926009e6011c8fa6 WatchSource:0}: Error finding container 9cd772c30a903a5aaf09280cf99c07f10a9238e7f50d69b7926009e6011c8fa6: Status 404 returned error can't find the container with id 9cd772c30a903a5aaf09280cf99c07f10a9238e7f50d69b7926009e6011c8fa6 Jul 09 15:30:45.625866 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:45.625772 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666df6c97-vdmjd" event={"ID":"17f46189-b120-45ce-a187-074ac888e842","Type":"ContainerStarted","Data":"9cd772c30a903a5aaf09280cf99c07f10a9238e7f50d69b7926009e6011c8fa6"} Jul 09 15:30:47.635973 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:47.635913 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-prh5h" event={"ID":"40808fa7-0ac9-461f-b481-c725a1917cee","Type":"ContainerStarted","Data":"ae900ba8cb8f9575ff532a0717f41744607df4e486090596b80061e29dbccf00"} Jul 09 15:30:47.661576 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:47.661519 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-prh5h" podStartSLOduration=33.538225527 podStartE2EDuration="43.661504561s" totalImagesPullingTime="10.123279034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:30:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:47.661112138 +0000 UTC m=+261.578811774" watchObservedRunningTime="2026-07-09 15:30:47.661504561 +0000 UTC m=+261.579204195" Jul 09 15:30:48.640893 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:48.640851 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666df6c97-vdmjd" event={"ID":"17f46189-b120-45ce-a187-074ac888e842","Type":"ContainerStarted","Data":"73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902"} Jul 09 15:30:48.660342 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:48.660290 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8666df6c97-vdmjd" podStartSLOduration=0.657650144 podStartE2EDuration="3.660273724s" totalImagesPullingTime="3.00262358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:48.659289576 +0000 UTC m=+262.576989226" watchObservedRunningTime="2026-07-09 15:30:48.660273724 +0000 UTC m=+262.577973358" Jul 09 15:30:51.432266 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:51.432229 2564 patch_prober.go:28] interesting pod/image-registry-66cbdddd59-ngx6s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:30:51.432639 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:51.432302 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" podUID="982310e0-7f19-4a29-b19e-0dce41c879ba" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:55.048345 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.048309 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc"] Jul 09 15:30:55.055085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.055064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.058606 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.058580 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 15:30:55.058911 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.058894 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 15:30:55.059991 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.059974 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 15:30:55.060123 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.060019 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 15:30:55.060196 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.060022 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 15:30:55.060260 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.060041 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-cqsqt\"" Jul 09 15:30:55.069888 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.069866 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc"] Jul 09 15:30:55.106238 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.106198 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.106238 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.106236 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.106452 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.106313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f305e93-8838-45d8-953b-b4aafcea2982-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.106452 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.106363 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnh6v\" (UniqueName: \"kubernetes.io/projected/5f305e93-8838-45d8-953b-b4aafcea2982-kube-api-access-mnh6v\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.126025 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.125995 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ssv7m"] Jul 09 15:30:55.130358 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.130337 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.139093 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.139070 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 15:30:55.139201 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.139149 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 15:30:55.139201 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.139185 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-94j8h\"" Jul 09 15:30:55.139490 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.139475 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 15:30:55.155332 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.155308 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dwvhq"] Jul 09 15:30:55.159579 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.159556 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ssv7m"] Jul 09 15:30:55.159706 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.159689 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.164823 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.164804 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 15:30:55.164961 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.164849 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 15:30:55.165137 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.165120 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 15:30:55.165768 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.165753 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8r4sg\"" Jul 09 15:30:55.207195 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f305e93-8838-45d8-953b-b4aafcea2982-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.207362 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrp6c\" (UniqueName: \"kubernetes.io/projected/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-api-access-qrp6c\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.207362 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207281 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-root\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.207362 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207322 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnh6v\" (UniqueName: \"kubernetes.io/projected/5f305e93-8838-45d8-953b-b4aafcea2982-kube-api-access-mnh6v\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.207362 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207353 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.207575 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207380 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5aa25c3d-8adc-4aed-bd2c-b471ea931579-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.207575 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.207575 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207547 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-metrics-client-ca\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.207575 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207572 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-textfile\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.207764 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.207764 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-tls\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.207764 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.207764 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.207764 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-sys\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.208036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207779 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa25c3d-8adc-4aed-bd2c-b471ea931579-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.208036 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:55.207839 2564 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 15:30:55.208036 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:30:55.207897 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-tls podName:5f305e93-8838-45d8-953b-b4aafcea2982 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:55.707878251 +0000 UTC m=+269.625577869 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-skmjc" (UID: "5f305e93-8838-45d8-953b-b4aafcea2982") : secret "openshift-state-metrics-tls" not found Jul 09 15:30:55.208036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207840 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.208036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.207961 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-wtmp\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.208036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.208005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-accelerators-collector-config\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.208036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.208009 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f305e93-8838-45d8-953b-b4aafcea2982-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.208036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.208032 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck4wc\" (UniqueName: \"kubernetes.io/projected/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-kube-api-access-ck4wc\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.210429 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.210403 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.222219 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.222195 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnh6v\" (UniqueName: \"kubernetes.io/projected/5f305e93-8838-45d8-953b-b4aafcea2982-kube-api-access-mnh6v\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.308800 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-sys\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.308800 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308745 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa25c3d-8adc-4aed-bd2c-b471ea931579-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.308800 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.308800 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308795 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-wtmp\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308819 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-accelerators-collector-config\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308835 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck4wc\" (UniqueName: \"kubernetes.io/projected/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-kube-api-access-ck4wc\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308883 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrp6c\" (UniqueName: \"kubernetes.io/projected/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-api-access-qrp6c\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308827 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-sys\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-root\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308968 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-wtmp\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.308972 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-root\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5aa25c3d-8adc-4aed-bd2c-b471ea931579-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309043 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-metrics-client-ca\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309107 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309103 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-textfile\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309590 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309590 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309144 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-tls\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309590 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309439 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-textfile\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309590 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309465 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-accelerators-collector-config\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.309988 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aa25c3d-8adc-4aed-bd2c-b471ea931579-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.309988 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.309912 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.310184 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.310032 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5aa25c3d-8adc-4aed-bd2c-b471ea931579-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.310184 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.310044 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-metrics-client-ca\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.312074 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.312045 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.312188 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.312168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.312239 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.312210 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-node-exporter-tls\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.312366 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.312351 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.325303 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.325280 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck4wc\" (UniqueName: \"kubernetes.io/projected/b4c5fcfe-1587-4aca-a297-0c5b41e2d822-kube-api-access-ck4wc\") pod \"node-exporter-dwvhq\" (UID: \"b4c5fcfe-1587-4aca-a297-0c5b41e2d822\") " pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.325667 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.325643 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrp6c\" (UniqueName: \"kubernetes.io/projected/5aa25c3d-8adc-4aed-bd2c-b471ea931579-kube-api-access-qrp6c\") pod \"kube-state-metrics-785778ff74-ssv7m\" (UID: \"5aa25c3d-8adc-4aed-bd2c-b471ea931579\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.342303 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.342281 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:55.342394 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.342329 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:30:55.343541 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.343522 2564 patch_prober.go:28] interesting pod/console-8666df6c97-vdmjd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jul 09 15:30:55.343640 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.343570 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8666df6c97-vdmjd" podUID="17f46189-b120-45ce-a187-074ac888e842" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jul 09 15:30:55.438939 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.438883 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" Jul 09 15:30:55.471002 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.470969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dwvhq" Jul 09 15:30:55.482168 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:55.482141 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c5fcfe_1587_4aca_a297_0c5b41e2d822.slice/crio-4433e16a6b56649c3515c8e99695b77bcb5db734217203c54d30d0ee29e6b8a4 WatchSource:0}: Error finding container 4433e16a6b56649c3515c8e99695b77bcb5db734217203c54d30d0ee29e6b8a4: Status 404 returned error can't find the container with id 4433e16a6b56649c3515c8e99695b77bcb5db734217203c54d30d0ee29e6b8a4 Jul 09 15:30:55.579663 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.579586 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-ssv7m"] Jul 09 15:30:55.582528 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:55.582500 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aa25c3d_8adc_4aed_bd2c_b471ea931579.slice/crio-92781b70145d2c33ab6fc9ce792e677ec23ba72a6a4ce5f14f9aec9002f7e442 WatchSource:0}: Error finding container 92781b70145d2c33ab6fc9ce792e677ec23ba72a6a4ce5f14f9aec9002f7e442: Status 404 returned error can't find the container with id 92781b70145d2c33ab6fc9ce792e677ec23ba72a6a4ce5f14f9aec9002f7e442 Jul 09 15:30:55.670027 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.669986 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dwvhq" event={"ID":"b4c5fcfe-1587-4aca-a297-0c5b41e2d822","Type":"ContainerStarted","Data":"4433e16a6b56649c3515c8e99695b77bcb5db734217203c54d30d0ee29e6b8a4"} Jul 09 15:30:55.671160 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.671133 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" event={"ID":"5aa25c3d-8adc-4aed-bd2c-b471ea931579","Type":"ContainerStarted","Data":"92781b70145d2c33ab6fc9ce792e677ec23ba72a6a4ce5f14f9aec9002f7e442"} Jul 09 15:30:55.711943 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.711894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.714449 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.714424 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5f305e93-8838-45d8-953b-b4aafcea2982-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-skmjc\" (UID: \"5f305e93-8838-45d8-953b-b4aafcea2982\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:55.965621 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:55.965587 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" Jul 09 15:30:56.135084 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:56.135042 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc"] Jul 09 15:30:56.143193 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:30:56.143161 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f305e93_8838_45d8_953b_b4aafcea2982.slice/crio-4c916a00269bf3219a685e094284812be7aa7896a1f7eff8c0b07c45cd5e98e9 WatchSource:0}: Error finding container 4c916a00269bf3219a685e094284812be7aa7896a1f7eff8c0b07c45cd5e98e9: Status 404 returned error can't find the container with id 4c916a00269bf3219a685e094284812be7aa7896a1f7eff8c0b07c45cd5e98e9 Jul 09 15:30:56.447732 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:56.447680 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" podUID="982310e0-7f19-4a29-b19e-0dce41c879ba" containerName="registry" containerID="cri-o://a9f69e0bcacdd4bb4b1fa09c5be017bf047ebbab493c84868136be2fd67c9928" gracePeriod=30 Jul 09 15:30:56.677442 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:56.677404 2564 generic.go:356] "Generic (PLEG): container finished" podID="982310e0-7f19-4a29-b19e-0dce41c879ba" containerID="a9f69e0bcacdd4bb4b1fa09c5be017bf047ebbab493c84868136be2fd67c9928" exitCode=0 Jul 09 15:30:56.680631 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:56.680599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" event={"ID":"982310e0-7f19-4a29-b19e-0dce41c879ba","Type":"ContainerDied","Data":"a9f69e0bcacdd4bb4b1fa09c5be017bf047ebbab493c84868136be2fd67c9928"} Jul 09 15:30:56.680787 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:56.680645 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" event={"ID":"5f305e93-8838-45d8-953b-b4aafcea2982","Type":"ContainerStarted","Data":"64df29d80bb73e83160e717f3581efe3dbf2e84596669438d11d837e89bad2fa"} Jul 09 15:30:56.680787 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:56.680669 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" event={"ID":"5f305e93-8838-45d8-953b-b4aafcea2982","Type":"ContainerStarted","Data":"4a3443f9c5b26fb2fa044a7918dd422eb8b5307995f3262b974809550e301498"} Jul 09 15:30:56.680787 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:56.680688 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" event={"ID":"5f305e93-8838-45d8-953b-b4aafcea2982","Type":"ContainerStarted","Data":"4c916a00269bf3219a685e094284812be7aa7896a1f7eff8c0b07c45cd5e98e9"} Jul 09 15:30:56.986068 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:56.986042 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:57.022948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.022905 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-bound-sa-token\") pod \"982310e0-7f19-4a29-b19e-0dce41c879ba\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " Jul 09 15:30:57.023055 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.022997 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-installation-pull-secrets\") pod \"982310e0-7f19-4a29-b19e-0dce41c879ba\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " Jul 09 15:30:57.023120 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.023057 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-certificates\") pod \"982310e0-7f19-4a29-b19e-0dce41c879ba\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " Jul 09 15:30:57.023179 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.023152 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6cs7\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-kube-api-access-w6cs7\") pod \"982310e0-7f19-4a29-b19e-0dce41c879ba\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " Jul 09 15:30:57.023234 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.023222 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-trusted-ca\") pod \"982310e0-7f19-4a29-b19e-0dce41c879ba\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " Jul 09 15:30:57.023290 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.023278 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") pod \"982310e0-7f19-4a29-b19e-0dce41c879ba\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " Jul 09 15:30:57.023479 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.023452 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "982310e0-7f19-4a29-b19e-0dce41c879ba" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:30:57.023706 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.023664 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-image-registry-private-configuration\") pod \"982310e0-7f19-4a29-b19e-0dce41c879ba\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " Jul 09 15:30:57.023706 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.023729 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/982310e0-7f19-4a29-b19e-0dce41c879ba-ca-trust-extracted\") pod \"982310e0-7f19-4a29-b19e-0dce41c879ba\" (UID: \"982310e0-7f19-4a29-b19e-0dce41c879ba\") " Jul 09 15:30:57.023706 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.023743 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "982310e0-7f19-4a29-b19e-0dce41c879ba" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:30:57.024029 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.024008 2564 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-certificates\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:30:57.024082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.024029 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/982310e0-7f19-4a29-b19e-0dce41c879ba-trusted-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:30:57.025643 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.025619 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "982310e0-7f19-4a29-b19e-0dce41c879ba" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:30:57.025772 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.025745 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "982310e0-7f19-4a29-b19e-0dce41c879ba" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:30:57.026280 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.026254 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-kube-api-access-w6cs7" (OuterVolumeSpecName: "kube-api-access-w6cs7") pod "982310e0-7f19-4a29-b19e-0dce41c879ba" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba"). InnerVolumeSpecName "kube-api-access-w6cs7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:30:57.026424 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.026399 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "982310e0-7f19-4a29-b19e-0dce41c879ba" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:30:57.026489 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.026471 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "982310e0-7f19-4a29-b19e-0dce41c879ba" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:30:57.033283 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.033260 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982310e0-7f19-4a29-b19e-0dce41c879ba-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "982310e0-7f19-4a29-b19e-0dce41c879ba" (UID: "982310e0-7f19-4a29-b19e-0dce41c879ba"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:30:57.124565 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.124538 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6cs7\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-kube-api-access-w6cs7\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:30:57.124767 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.124750 2564 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-registry-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:30:57.124896 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.124881 2564 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-image-registry-private-configuration\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:30:57.125104 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.125027 2564 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/982310e0-7f19-4a29-b19e-0dce41c879ba-ca-trust-extracted\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:30:57.125104 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.125050 2564 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/982310e0-7f19-4a29-b19e-0dce41c879ba-bound-sa-token\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:30:57.125104 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.125063 2564 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/982310e0-7f19-4a29-b19e-0dce41c879ba-installation-pull-secrets\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:30:57.684830 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.684797 2564 generic.go:356] "Generic (PLEG): container finished" podID="b4c5fcfe-1587-4aca-a297-0c5b41e2d822" containerID="e1d2ecee1d6982dd83283d88b7382f16174f9e6c43d0dd57c776c85f06064727" exitCode=0 Jul 09 15:30:57.685187 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.684881 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dwvhq" event={"ID":"b4c5fcfe-1587-4aca-a297-0c5b41e2d822","Type":"ContainerDied","Data":"e1d2ecee1d6982dd83283d88b7382f16174f9e6c43d0dd57c776c85f06064727"} Jul 09 15:30:57.686975 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.686954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" event={"ID":"5aa25c3d-8adc-4aed-bd2c-b471ea931579","Type":"ContainerStarted","Data":"27895ffd12527f766a25396a980cb4c44c849425480c78152efa20d75d266189"} Jul 09 15:30:57.687085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.687006 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" event={"ID":"5aa25c3d-8adc-4aed-bd2c-b471ea931579","Type":"ContainerStarted","Data":"ef43d4a424bb186b35c57ddeb12ebd326067a19f993606c621a25ab5e59864cb"} Jul 09 15:30:57.687085 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.687038 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" event={"ID":"5aa25c3d-8adc-4aed-bd2c-b471ea931579","Type":"ContainerStarted","Data":"36846d07aeba62850c256f5eeecb77272d7f7f3760eaecf23fcb41bd71e88d08"} Jul 09 15:30:57.688220 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.688201 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" event={"ID":"982310e0-7f19-4a29-b19e-0dce41c879ba","Type":"ContainerDied","Data":"ced3e185d87acfba511b56a2d1ad393c9b88570cfb9b59771a2f6ef43d1bb329"} Jul 09 15:30:57.688220 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.688211 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66cbdddd59-ngx6s" Jul 09 15:30:57.688333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.688277 2564 scope.go:117] "RemoveContainer" containerID="a9f69e0bcacdd4bb4b1fa09c5be017bf047ebbab493c84868136be2fd67c9928" Jul 09 15:30:57.732208 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.732159 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-ssv7m" podStartSLOduration=1.315166256 podStartE2EDuration="2.732138905s" totalImagesPullingTime="1.416972649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:57.731477086 +0000 UTC m=+271.649176752" watchObservedRunningTime="2026-07-09 15:30:57.732138905 +0000 UTC m=+271.649838544" Jul 09 15:30:57.750553 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.750525 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66cbdddd59-ngx6s"] Jul 09 15:30:57.755581 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:57.755554 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66cbdddd59-ngx6s"] Jul 09 15:30:58.684466 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:58.684434 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="982310e0-7f19-4a29-b19e-0dce41c879ba" path="/var/lib/kubelet/pods/982310e0-7f19-4a29-b19e-0dce41c879ba/volumes" Jul 09 15:30:58.694292 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:58.694256 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dwvhq" event={"ID":"b4c5fcfe-1587-4aca-a297-0c5b41e2d822","Type":"ContainerStarted","Data":"eb33bd1fa24c6d18ba08a9611b28e89ef02fd15f074e3ac753c7c6be177b8f6f"} Jul 09 15:30:58.694693 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:58.694303 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dwvhq" event={"ID":"b4c5fcfe-1587-4aca-a297-0c5b41e2d822","Type":"ContainerStarted","Data":"f65e101e4fb7421afdae1cf59312101816e329e672ec4de9354e0876b24b4f71"} Jul 09 15:30:58.696279 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:58.696251 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" event={"ID":"5f305e93-8838-45d8-953b-b4aafcea2982","Type":"ContainerStarted","Data":"0af61c791850d4f65d976cadf94a7bf72d3bd61f0e315a26832a9de3e95f7ea9"} Jul 09 15:30:58.715311 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:58.715268 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dwvhq" podStartSLOduration=2.112572974 podStartE2EDuration="3.715253947s" totalImagesPullingTime="1.515881777s" totalInitContainerRuntime="86.799196ms" isStatefulPod=true podCreationTimestamp="2026-07-09 15:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:58.713775537 +0000 UTC m=+272.631475173" watchObservedRunningTime="2026-07-09 15:30:58.715253947 +0000 UTC m=+272.632953574" Jul 09 15:30:58.734202 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:58.734160 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-skmjc" podStartSLOduration=2.386489672 podStartE2EDuration="3.734146108s" totalImagesPullingTime="1.347656436s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:58.733220955 +0000 UTC m=+272.650920591" watchObservedRunningTime="2026-07-09 15:30:58.734146108 +0000 UTC m=+272.651845744" Jul 09 15:30:59.880597 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.880567 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56df5b4bb5-ff4zk"] Jul 09 15:30:59.881071 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.880968 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982310e0-7f19-4a29-b19e-0dce41c879ba" containerName="registry" Jul 09 15:30:59.881071 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.880985 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="982310e0-7f19-4a29-b19e-0dce41c879ba" containerName="registry" Jul 09 15:30:59.881184 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.881077 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="982310e0-7f19-4a29-b19e-0dce41c879ba" containerName="registry" Jul 09 15:30:59.884161 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.884142 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:30:59.894617 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.894593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56df5b4bb5-ff4zk"] Jul 09 15:30:59.952549 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.952517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-oauth-config\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:30:59.952701 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.952566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-serving-cert\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:30:59.952701 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.952654 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-oauth-serving-cert\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:30:59.952701 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.952686 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjp7g\" (UniqueName: \"kubernetes.io/projected/f2239d1e-d4fc-465b-bdef-9c989cf05736-kube-api-access-jjp7g\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:30:59.952805 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.952710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-service-ca\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:30:59.952805 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.952730 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-config\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:30:59.952805 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:30:59.952777 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-trusted-ca-bundle\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.054080 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-oauth-serving-cert\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.054231 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054094 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjp7g\" (UniqueName: \"kubernetes.io/projected/f2239d1e-d4fc-465b-bdef-9c989cf05736-kube-api-access-jjp7g\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.054231 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-service-ca\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.054231 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-config\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.054231 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-trusted-ca-bundle\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.054426 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-oauth-config\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.054426 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-serving-cert\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.054937 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-oauth-serving-cert\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.055036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054975 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-service-ca\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.055036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.054988 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-config\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.055121 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.055080 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-trusted-ca-bundle\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.057008 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.056989 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-oauth-config\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.057118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.057101 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-serving-cert\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.066729 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.066710 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjp7g\" (UniqueName: \"kubernetes.io/projected/f2239d1e-d4fc-465b-bdef-9c989cf05736-kube-api-access-jjp7g\") pod \"console-56df5b4bb5-ff4zk\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.193082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.192992 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:00.332035 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.331949 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56df5b4bb5-ff4zk"] Jul 09 15:31:00.335042 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:31:00.334991 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2239d1e_d4fc_465b_bdef_9c989cf05736.slice/crio-50fb3ec05db2f2c28fce94318c7d3ce760a45a64f8c273d9cf5a11f84adbc0bc WatchSource:0}: Error finding container 50fb3ec05db2f2c28fce94318c7d3ce760a45a64f8c273d9cf5a11f84adbc0bc: Status 404 returned error can't find the container with id 50fb3ec05db2f2c28fce94318c7d3ce760a45a64f8c273d9cf5a11f84adbc0bc Jul 09 15:31:00.705452 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.705415 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56df5b4bb5-ff4zk" event={"ID":"f2239d1e-d4fc-465b-bdef-9c989cf05736","Type":"ContainerStarted","Data":"682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35"} Jul 09 15:31:00.705662 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.705471 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56df5b4bb5-ff4zk" event={"ID":"f2239d1e-d4fc-465b-bdef-9c989cf05736","Type":"ContainerStarted","Data":"50fb3ec05db2f2c28fce94318c7d3ce760a45a64f8c273d9cf5a11f84adbc0bc"} Jul 09 15:31:00.731938 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:00.731871 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56df5b4bb5-ff4zk" podStartSLOduration=1.731849338 podStartE2EDuration="1.731849338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:00.731228301 +0000 UTC m=+274.648927936" watchObservedRunningTime="2026-07-09 15:31:00.731849338 +0000 UTC m=+274.649548975" Jul 09 15:31:01.378513 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.378483 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:31:01.382377 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.382357 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.385093 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385070 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 15:31:01.385483 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385460 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 15:31:01.385638 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385508 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 15:31:01.385717 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385521 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 15:31:01.385717 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385682 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 15:31:01.385717 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385689 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 15:31:01.385717 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385697 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fk59tifsc2qks\"" Jul 09 15:31:01.385861 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385574 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 15:31:01.385861 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385543 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 15:31:01.385861 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385604 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 15:31:01.386035 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.385937 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 15:31:01.386780 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.386757 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 15:31:01.386874 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.386770 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tx285\"" Jul 09 15:31:01.386874 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.386810 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 15:31:01.386874 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.386779 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 15:31:01.393865 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.393841 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 15:31:01.395578 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.395558 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 15:31:01.398548 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.398529 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:31:01.467193 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467162 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467193 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467194 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-web-config\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467428 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467428 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467238 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467428 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467273 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467428 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467428 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467428 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467492 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467523 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-config\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467538 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-config-out\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467562 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467651 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467605 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467864 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467655 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467864 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467682 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467864 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467703 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467864 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467717 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467864 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjpdp\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-kube-api-access-fjpdp\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.467864 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.467755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569196 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569196 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569197 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569402 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569214 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjpdp\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-kube-api-access-fjpdp\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569402 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569402 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569266 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569527 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569412 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-web-config\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569527 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569623 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569662 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569709 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569760 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569760 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569746 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569847 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569773 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569904 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569844 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.569904 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569890 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-config\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.570007 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569946 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-config-out\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.570007 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.570007 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.569995 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.570086 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.570022 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.570136 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.570110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.571345 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.571314 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.571475 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.571316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.571770 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.571744 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.572285 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.571890 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.572285 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.572232 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.572479 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.572427 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.572657 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.572634 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.573333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.573305 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.574177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.574131 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.574278 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.574225 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.575179 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.574834 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.575179 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.574852 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-config-out\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.575337 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.575316 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.575437 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.575377 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-web-config\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.575530 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.575452 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.575530 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.575495 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.576095 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.576078 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-config\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.576149 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.576096 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.576632 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.576617 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.588559 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.588534 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjpdp\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-kube-api-access-fjpdp\") pod \"prometheus-k8s-0\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.697155 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.697069 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:01.841981 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:01.841943 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:31:01.844551 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:31:01.844525 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af6fd76_27ce_4506_bf25_bde2e5ace548.slice/crio-ff6d130f391a8a5c4fa24b95eaf31a7e3091daa6e6b01455fd81cd95ad0b6485 WatchSource:0}: Error finding container ff6d130f391a8a5c4fa24b95eaf31a7e3091daa6e6b01455fd81cd95ad0b6485: Status 404 returned error can't find the container with id ff6d130f391a8a5c4fa24b95eaf31a7e3091daa6e6b01455fd81cd95ad0b6485 Jul 09 15:31:02.716127 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:02.716092 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerStarted","Data":"ff6d130f391a8a5c4fa24b95eaf31a7e3091daa6e6b01455fd81cd95ad0b6485"} Jul 09 15:31:05.343020 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:05.342986 2564 patch_prober.go:28] interesting pod/console-8666df6c97-vdmjd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jul 09 15:31:05.343401 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:05.343058 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8666df6c97-vdmjd" podUID="17f46189-b120-45ce-a187-074ac888e842" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jul 09 15:31:06.732584 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:06.732554 2564 generic.go:356] "Generic (PLEG): container finished" podID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" exitCode=0 Jul 09 15:31:06.732987 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:06.732643 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerDied","Data":"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66"} Jul 09 15:31:08.306843 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:31:08.306792 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pq9ph" podUID="61052b40-9684-41e8-ac97-f6633e32a3ff" Jul 09 15:31:08.739745 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:08.739706 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pq9ph" Jul 09 15:31:10.193352 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:10.193312 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:10.193818 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:10.193380 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:10.194839 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:10.194815 2564 patch_prober.go:28] interesting pod/console-56df5b4bb5-ff4zk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jul 09 15:31:10.194950 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:10.194868 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56df5b4bb5-ff4zk" podUID="f2239d1e-d4fc-465b-bdef-9c989cf05736" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jul 09 15:31:10.750373 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:10.750330 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerStarted","Data":"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4"} Jul 09 15:31:10.750539 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:10.750405 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerStarted","Data":"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805"} Jul 09 15:31:11.469003 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:11.468962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:31:11.471795 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:11.471771 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/61052b40-9684-41e8-ac97-f6633e32a3ff-metrics-tls\") pod \"dns-default-pq9ph\" (UID: \"61052b40-9684-41e8-ac97-f6633e32a3ff\") " pod="openshift-dns/dns-default-pq9ph" Jul 09 15:31:11.742906 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:11.742883 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jqnp4\"" Jul 09 15:31:11.750735 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:11.750707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pq9ph" Jul 09 15:31:11.758435 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:11.758410 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerStarted","Data":"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff"} Jul 09 15:31:11.758540 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:11.758473 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerStarted","Data":"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258"} Jul 09 15:31:11.758540 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:11.758506 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerStarted","Data":"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc"} Jul 09 15:31:11.898086 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:11.898055 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pq9ph"] Jul 09 15:31:11.901359 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:31:11.901330 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61052b40_9684_41e8_ac97_f6633e32a3ff.slice/crio-519d1efd937a7dc5a5f5d2d3297210e9a9ca967782a0dc53b04f2334bf12a157 WatchSource:0}: Error finding container 519d1efd937a7dc5a5f5d2d3297210e9a9ca967782a0dc53b04f2334bf12a157: Status 404 returned error can't find the container with id 519d1efd937a7dc5a5f5d2d3297210e9a9ca967782a0dc53b04f2334bf12a157 Jul 09 15:31:12.764324 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:12.764285 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pq9ph" event={"ID":"61052b40-9684-41e8-ac97-f6633e32a3ff","Type":"ContainerStarted","Data":"519d1efd937a7dc5a5f5d2d3297210e9a9ca967782a0dc53b04f2334bf12a157"} Jul 09 15:31:12.768033 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:12.767997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerStarted","Data":"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81"} Jul 09 15:31:12.819860 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:12.819797 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.1462529630000002 podStartE2EDuration="11.819775498s" totalImagesPullingTime="8.654272101s" totalInitContainerRuntime="19.250434ms" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:12.810060274 +0000 UTC m=+286.727759909" watchObservedRunningTime="2026-07-09 15:31:12.819775498 +0000 UTC m=+286.737475136" Jul 09 15:31:13.773639 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:13.773526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pq9ph" event={"ID":"61052b40-9684-41e8-ac97-f6633e32a3ff","Type":"ContainerStarted","Data":"828740fbdc435fdde1d657d2ede464d1e12008c58ffcbc1c08262cbbd2af501a"} Jul 09 15:31:13.773639 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:13.773599 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pq9ph" event={"ID":"61052b40-9684-41e8-ac97-f6633e32a3ff","Type":"ContainerStarted","Data":"d7bede34b9321fd1a1fb83df92cf2ed8ead414cf674af81e1f157669f5579386"} Jul 09 15:31:13.774072 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:13.773951 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pq9ph" Jul 09 15:31:13.793621 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:13.793565 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pq9ph" podStartSLOduration=251.219838328 podStartE2EDuration="4m12.793549606s" totalImagesPullingTime="1.573711278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:13.792467231 +0000 UTC m=+287.710166871" watchObservedRunningTime="2026-07-09 15:31:13.793549606 +0000 UTC m=+287.711249242" Jul 09 15:31:15.342642 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:15.342602 2564 patch_prober.go:28] interesting pod/console-8666df6c97-vdmjd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jul 09 15:31:15.343059 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:15.342674 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-8666df6c97-vdmjd" podUID="17f46189-b120-45ce-a187-074ac888e842" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jul 09 15:31:16.697907 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:16.697870 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:31:20.194165 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:20.194128 2564 patch_prober.go:28] interesting pod/console-56df5b4bb5-ff4zk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jul 09 15:31:20.194550 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:20.194184 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56df5b4bb5-ff4zk" podUID="f2239d1e-d4fc-465b-bdef-9c989cf05736" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jul 09 15:31:24.784939 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:24.784892 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pq9ph" Jul 09 15:31:24.822898 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:24.822866 2564 generic.go:356] "Generic (PLEG): container finished" podID="e9a06d1f-3c53-496b-a1e0-588a1a4fb21e" containerID="ff99a2698ba980955920172269cf1a4e0db56ccf08d1c57aa7d8210ffbb998db" exitCode=0 Jul 09 15:31:24.823077 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:24.822954 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" event={"ID":"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e","Type":"ContainerDied","Data":"ff99a2698ba980955920172269cf1a4e0db56ccf08d1c57aa7d8210ffbb998db"} Jul 09 15:31:24.823330 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:24.823310 2564 scope.go:117] "RemoveContainer" containerID="ff99a2698ba980955920172269cf1a4e0db56ccf08d1c57aa7d8210ffbb998db" Jul 09 15:31:25.346284 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:25.346257 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:31:25.349940 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:25.349896 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:31:25.828614 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:25.828526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7ff8j" event={"ID":"e9a06d1f-3c53-496b-a1e0-588a1a4fb21e","Type":"ContainerStarted","Data":"29cb6a0cbfb7fbfc0d5fa054d6c942fafc7bfb2f01bcabce57a7b079996d58f2"} Jul 09 15:31:26.473935 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:26.473901 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:31:26.474057 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:26.474018 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:31:26.479506 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:26.479484 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:31:26.479965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:26.479945 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:31:26.485603 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:26.485581 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 15:31:29.089758 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:29.089728 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ssv7m_5aa25c3d-8adc-4aed-bd2c-b471ea931579/kube-state-metrics/0.log" Jul 09 15:31:29.288987 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:29.288954 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ssv7m_5aa25c3d-8adc-4aed-bd2c-b471ea931579/kube-rbac-proxy-main/0.log" Jul 09 15:31:29.487134 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:29.487047 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ssv7m_5aa25c3d-8adc-4aed-bd2c-b471ea931579/kube-rbac-proxy-self/0.log" Jul 09 15:31:30.198281 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:30.198254 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:30.202177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:30.202157 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:31:30.292942 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:30.292886 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8666df6c97-vdmjd"] Jul 09 15:31:30.684807 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:30.684782 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwvhq_b4c5fcfe-1587-4aca-a297-0c5b41e2d822/init-textfile/0.log" Jul 09 15:31:30.890012 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:30.889982 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwvhq_b4c5fcfe-1587-4aca-a297-0c5b41e2d822/node-exporter/0.log" Jul 09 15:31:31.089213 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:31.089131 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwvhq_b4c5fcfe-1587-4aca-a297-0c5b41e2d822/kube-rbac-proxy/0.log" Jul 09 15:31:31.888457 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:31.888426 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skmjc_5f305e93-8838-45d8-953b-b4aafcea2982/kube-rbac-proxy-main/0.log" Jul 09 15:31:32.085629 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:32.085570 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skmjc_5f305e93-8838-45d8-953b-b4aafcea2982/kube-rbac-proxy-self/0.log" Jul 09 15:31:32.286942 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:32.286805 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skmjc_5f305e93-8838-45d8-953b-b4aafcea2982/openshift-state-metrics/0.log" Jul 09 15:31:32.489157 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:32.489128 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4af6fd76-27ce-4506-bf25-bde2e5ace548/init-config-reloader/0.log" Jul 09 15:31:32.687101 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:32.687061 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4af6fd76-27ce-4506-bf25-bde2e5ace548/prometheus/0.log" Jul 09 15:31:32.885431 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:32.885400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4af6fd76-27ce-4506-bf25-bde2e5ace548/config-reloader/0.log" Jul 09 15:31:33.085885 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:33.085800 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4af6fd76-27ce-4506-bf25-bde2e5ace548/thanos-sidecar/0.log" Jul 09 15:31:33.285602 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:33.285571 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4af6fd76-27ce-4506-bf25-bde2e5ace548/kube-rbac-proxy-web/0.log" Jul 09 15:31:33.485274 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:33.485247 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4af6fd76-27ce-4506-bf25-bde2e5ace548/kube-rbac-proxy/0.log" Jul 09 15:31:33.685461 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:33.685426 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4af6fd76-27ce-4506-bf25-bde2e5ace548/kube-rbac-proxy-thanos/0.log" Jul 09 15:31:35.885293 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:35.885258 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:31:36.096106 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:36.096079 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/2.log" Jul 09 15:31:36.286269 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:36.286190 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56df5b4bb5-ff4zk_f2239d1e-d4fc-465b-bdef-9c989cf05736/console/0.log" Jul 09 15:31:36.687389 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:36.687336 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8666df6c97-vdmjd_17f46189-b120-45ce-a187-074ac888e842/console/0.log" Jul 09 15:31:37.890615 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:37.890589 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pq9ph_61052b40-9684-41e8-ac97-f6633e32a3ff/dns/0.log" Jul 09 15:31:38.086099 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:38.086071 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pq9ph_61052b40-9684-41e8-ac97-f6633e32a3ff/kube-rbac-proxy/0.log" Jul 09 15:31:38.486911 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:38.486883 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d7mnj_dc1e8316-7b3f-47b7-b7b0-6831130b9e5d/dns-node-resolver/0.log" Jul 09 15:31:38.886615 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:38.886592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7548f45bc4-xvtw4_241bdd29-60e6-4961-9a09-a9c1d60a482a/router/0.log" Jul 09 15:31:39.089191 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:39.089159 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gk4kc_21f631c8-0b85-4b98-a556-149dfc315f9b/serve-healthcheck-canary/0.log" Jul 09 15:31:55.315174 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.315114 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8666df6c97-vdmjd" podUID="17f46189-b120-45ce-a187-074ac888e842" containerName="console" containerID="cri-o://73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902" gracePeriod=15 Jul 09 15:31:55.347119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.347083 2564 patch_prober.go:28] interesting pod/console-8666df6c97-vdmjd container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jul 09 15:31:55.347264 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.347173 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-8666df6c97-vdmjd" podUID="17f46189-b120-45ce-a187-074ac888e842" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jul 09 15:31:55.568630 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.568573 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:31:55.642176 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642137 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-console-config\") pod \"17f46189-b120-45ce-a187-074ac888e842\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " Jul 09 15:31:55.642176 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642184 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-service-ca\") pod \"17f46189-b120-45ce-a187-074ac888e842\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " Jul 09 15:31:55.642429 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642207 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-oauth-config\") pod \"17f46189-b120-45ce-a187-074ac888e842\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " Jul 09 15:31:55.642429 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642263 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-trusted-ca-bundle\") pod \"17f46189-b120-45ce-a187-074ac888e842\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " Jul 09 15:31:55.642429 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642286 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-serving-cert\") pod \"17f46189-b120-45ce-a187-074ac888e842\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " Jul 09 15:31:55.642429 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642329 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-oauth-serving-cert\") pod \"17f46189-b120-45ce-a187-074ac888e842\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " Jul 09 15:31:55.642429 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642359 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w596\" (UniqueName: \"kubernetes.io/projected/17f46189-b120-45ce-a187-074ac888e842-kube-api-access-5w596\") pod \"17f46189-b120-45ce-a187-074ac888e842\" (UID: \"17f46189-b120-45ce-a187-074ac888e842\") " Jul 09 15:31:55.642742 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642595 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-console-config" (OuterVolumeSpecName: "console-config") pod "17f46189-b120-45ce-a187-074ac888e842" (UID: "17f46189-b120-45ce-a187-074ac888e842"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:55.642854 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642707 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-service-ca" (OuterVolumeSpecName: "service-ca") pod "17f46189-b120-45ce-a187-074ac888e842" (UID: "17f46189-b120-45ce-a187-074ac888e842"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:55.642854 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642820 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "17f46189-b120-45ce-a187-074ac888e842" (UID: "17f46189-b120-45ce-a187-074ac888e842"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:55.642854 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.642817 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "17f46189-b120-45ce-a187-074ac888e842" (UID: "17f46189-b120-45ce-a187-074ac888e842"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:55.644794 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.644767 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "17f46189-b120-45ce-a187-074ac888e842" (UID: "17f46189-b120-45ce-a187-074ac888e842"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:55.644794 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.644784 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17f46189-b120-45ce-a187-074ac888e842-kube-api-access-5w596" (OuterVolumeSpecName: "kube-api-access-5w596") pod "17f46189-b120-45ce-a187-074ac888e842" (UID: "17f46189-b120-45ce-a187-074ac888e842"). InnerVolumeSpecName "kube-api-access-5w596". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:55.644931 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.644800 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "17f46189-b120-45ce-a187-074ac888e842" (UID: "17f46189-b120-45ce-a187-074ac888e842"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:55.743015 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.742978 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-console-config\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:31:55.743015 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.743009 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:31:55.743015 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.743018 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-oauth-config\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:31:55.743239 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.743029 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-trusted-ca-bundle\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:31:55.743239 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.743038 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/17f46189-b120-45ce-a187-074ac888e842-console-serving-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:31:55.743239 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.743048 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/17f46189-b120-45ce-a187-074ac888e842-oauth-serving-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:31:55.743239 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.743056 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w596\" (UniqueName: \"kubernetes.io/projected/17f46189-b120-45ce-a187-074ac888e842-kube-api-access-5w596\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:31:55.952570 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.952534 2564 generic.go:356] "Generic (PLEG): container finished" podID="17f46189-b120-45ce-a187-074ac888e842" containerID="73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902" exitCode=0 Jul 09 15:31:55.952712 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.952579 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8666df6c97-vdmjd" Jul 09 15:31:55.952712 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.952596 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666df6c97-vdmjd" event={"ID":"17f46189-b120-45ce-a187-074ac888e842","Type":"ContainerDied","Data":"73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902"} Jul 09 15:31:55.952712 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.952647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8666df6c97-vdmjd" event={"ID":"17f46189-b120-45ce-a187-074ac888e842","Type":"ContainerDied","Data":"9cd772c30a903a5aaf09280cf99c07f10a9238e7f50d69b7926009e6011c8fa6"} Jul 09 15:31:55.952712 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.952677 2564 scope.go:117] "RemoveContainer" containerID="73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902" Jul 09 15:31:55.961133 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.961114 2564 scope.go:117] "RemoveContainer" containerID="73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902" Jul 09 15:31:55.961424 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:31:55.961404 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902\": container with ID starting with 73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902 not found: ID does not exist" containerID="73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902" Jul 09 15:31:55.961481 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.961433 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902"} err="failed to get container status \"73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902\": rpc error: code = NotFound desc = could not find container \"73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902\": container with ID starting with 73d6c05cce4c54bbd0df22a6bcd5155d950db39e3dd98ab31cf042ec22c20902 not found: ID does not exist" Jul 09 15:31:55.975665 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.975636 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8666df6c97-vdmjd"] Jul 09 15:31:55.982067 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:55.982036 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8666df6c97-vdmjd"] Jul 09 15:31:56.679591 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:31:56.679553 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17f46189-b120-45ce-a187-074ac888e842" path="/var/lib/kubelet/pods/17f46189-b120-45ce-a187-074ac888e842/volumes" Jul 09 15:32:01.698265 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:01.698202 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:01.715029 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:01.714999 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:01.995452 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:01.995370 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:19.795235 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:19.795159 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:32:19.795648 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:19.795436 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="prometheus" containerID="cri-o://2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" gracePeriod=600 Jul 09 15:32:19.795648 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:19.795455 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy" containerID="cri-o://dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" gracePeriod=600 Jul 09 15:32:19.795648 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:19.795477 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="thanos-sidecar" containerID="cri-o://55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" gracePeriod=600 Jul 09 15:32:19.795648 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:19.795532 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy-thanos" containerID="cri-o://27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" gracePeriod=600 Jul 09 15:32:19.795648 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:19.795549 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="config-reloader" containerID="cri-o://3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" gracePeriod=600 Jul 09 15:32:19.795648 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:19.795531 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy-web" containerID="cri-o://66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" gracePeriod=600 Jul 09 15:32:20.042715 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.042692 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.048691 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048625 2564 generic.go:356] "Generic (PLEG): container finished" podID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" exitCode=0 Jul 09 15:32:20.048691 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048650 2564 generic.go:356] "Generic (PLEG): container finished" podID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" exitCode=0 Jul 09 15:32:20.048691 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048658 2564 generic.go:356] "Generic (PLEG): container finished" podID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" exitCode=0 Jul 09 15:32:20.048691 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048666 2564 generic.go:356] "Generic (PLEG): container finished" podID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" exitCode=0 Jul 09 15:32:20.048691 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048675 2564 generic.go:356] "Generic (PLEG): container finished" podID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" exitCode=0 Jul 09 15:32:20.048691 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048682 2564 generic.go:356] "Generic (PLEG): container finished" podID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" exitCode=0 Jul 09 15:32:20.048967 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048707 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.048967 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerDied","Data":"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81"} Jul 09 15:32:20.048967 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048786 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerDied","Data":"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff"} Jul 09 15:32:20.048967 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048821 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerDied","Data":"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258"} Jul 09 15:32:20.048967 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048847 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerDied","Data":"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc"} Jul 09 15:32:20.048967 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048858 2564 scope.go:117] "RemoveContainer" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" Jul 09 15:32:20.048967 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048874 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerDied","Data":"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4"} Jul 09 15:32:20.048967 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerDied","Data":"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805"} Jul 09 15:32:20.049206 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.048978 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4af6fd76-27ce-4506-bf25-bde2e5ace548","Type":"ContainerDied","Data":"ff6d130f391a8a5c4fa24b95eaf31a7e3091daa6e6b01455fd81cd95ad0b6485"} Jul 09 15:32:20.056321 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.056297 2564 scope.go:117] "RemoveContainer" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" Jul 09 15:32:20.063854 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.063834 2564 scope.go:117] "RemoveContainer" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" Jul 09 15:32:20.070901 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.070874 2564 scope.go:117] "RemoveContainer" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" Jul 09 15:32:20.077483 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.077468 2564 scope.go:117] "RemoveContainer" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" Jul 09 15:32:20.088957 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.088935 2564 scope.go:117] "RemoveContainer" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" Jul 09 15:32:20.096675 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.096656 2564 scope.go:117] "RemoveContainer" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" Jul 09 15:32:20.106253 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.106232 2564 scope.go:117] "RemoveContainer" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" Jul 09 15:32:20.106577 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:32:20.106553 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": container with ID starting with 27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81 not found: ID does not exist" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" Jul 09 15:32:20.106671 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.106583 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81"} err="failed to get container status \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": rpc error: code = NotFound desc = could not find container \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": container with ID starting with 27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81 not found: ID does not exist" Jul 09 15:32:20.106671 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.106603 2564 scope.go:117] "RemoveContainer" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" Jul 09 15:32:20.106894 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:32:20.106872 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": container with ID starting with dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff not found: ID does not exist" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" Jul 09 15:32:20.106990 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.106903 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff"} err="failed to get container status \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": rpc error: code = NotFound desc = could not find container \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": container with ID starting with dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff not found: ID does not exist" Jul 09 15:32:20.106990 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.106954 2564 scope.go:117] "RemoveContainer" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" Jul 09 15:32:20.107216 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:32:20.107197 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": container with ID starting with 66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258 not found: ID does not exist" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" Jul 09 15:32:20.107265 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.107223 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258"} err="failed to get container status \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": rpc error: code = NotFound desc = could not find container \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": container with ID starting with 66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258 not found: ID does not exist" Jul 09 15:32:20.107265 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.107244 2564 scope.go:117] "RemoveContainer" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" Jul 09 15:32:20.107497 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:32:20.107463 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": container with ID starting with 55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc not found: ID does not exist" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" Jul 09 15:32:20.107548 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.107502 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc"} err="failed to get container status \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": rpc error: code = NotFound desc = could not find container \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": container with ID starting with 55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc not found: ID does not exist" Jul 09 15:32:20.107548 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.107521 2564 scope.go:117] "RemoveContainer" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" Jul 09 15:32:20.107780 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:32:20.107763 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": container with ID starting with 3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4 not found: ID does not exist" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" Jul 09 15:32:20.107833 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.107786 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4"} err="failed to get container status \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": rpc error: code = NotFound desc = could not find container \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": container with ID starting with 3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4 not found: ID does not exist" Jul 09 15:32:20.107833 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.107801 2564 scope.go:117] "RemoveContainer" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" Jul 09 15:32:20.108065 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:32:20.108047 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": container with ID starting with 2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805 not found: ID does not exist" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" Jul 09 15:32:20.108119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.108068 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805"} err="failed to get container status \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": rpc error: code = NotFound desc = could not find container \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": container with ID starting with 2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805 not found: ID does not exist" Jul 09 15:32:20.108119 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.108080 2564 scope.go:117] "RemoveContainer" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" Jul 09 15:32:20.108321 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:32:20.108307 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": container with ID starting with 2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66 not found: ID does not exist" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" Jul 09 15:32:20.108369 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.108324 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66"} err="failed to get container status \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": rpc error: code = NotFound desc = could not find container \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": container with ID starting with 2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66 not found: ID does not exist" Jul 09 15:32:20.108369 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.108336 2564 scope.go:117] "RemoveContainer" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" Jul 09 15:32:20.108588 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.108569 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81"} err="failed to get container status \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": rpc error: code = NotFound desc = could not find container \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": container with ID starting with 27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81 not found: ID does not exist" Jul 09 15:32:20.108637 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.108588 2564 scope.go:117] "RemoveContainer" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" Jul 09 15:32:20.108826 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.108805 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff"} err="failed to get container status \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": rpc error: code = NotFound desc = could not find container \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": container with ID starting with dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff not found: ID does not exist" Jul 09 15:32:20.108892 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.108828 2564 scope.go:117] "RemoveContainer" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" Jul 09 15:32:20.109529 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.109506 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258"} err="failed to get container status \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": rpc error: code = NotFound desc = could not find container \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": container with ID starting with 66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258 not found: ID does not exist" Jul 09 15:32:20.109605 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.109523 2564 scope.go:117] "RemoveContainer" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" Jul 09 15:32:20.109766 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.109741 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc"} err="failed to get container status \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": rpc error: code = NotFound desc = could not find container \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": container with ID starting with 55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc not found: ID does not exist" Jul 09 15:32:20.109821 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.109769 2564 scope.go:117] "RemoveContainer" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" Jul 09 15:32:20.110033 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110015 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4"} err="failed to get container status \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": rpc error: code = NotFound desc = could not find container \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": container with ID starting with 3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4 not found: ID does not exist" Jul 09 15:32:20.110033 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110033 2564 scope.go:117] "RemoveContainer" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" Jul 09 15:32:20.110254 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110234 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805"} err="failed to get container status \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": rpc error: code = NotFound desc = could not find container \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": container with ID starting with 2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805 not found: ID does not exist" Jul 09 15:32:20.110298 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110256 2564 scope.go:117] "RemoveContainer" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" Jul 09 15:32:20.110492 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110474 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66"} err="failed to get container status \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": rpc error: code = NotFound desc = could not find container \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": container with ID starting with 2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66 not found: ID does not exist" Jul 09 15:32:20.110559 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110494 2564 scope.go:117] "RemoveContainer" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" Jul 09 15:32:20.110718 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110698 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81"} err="failed to get container status \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": rpc error: code = NotFound desc = could not find container \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": container with ID starting with 27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81 not found: ID does not exist" Jul 09 15:32:20.110769 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110718 2564 scope.go:117] "RemoveContainer" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" Jul 09 15:32:20.110988 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110970 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff"} err="failed to get container status \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": rpc error: code = NotFound desc = could not find container \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": container with ID starting with dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff not found: ID does not exist" Jul 09 15:32:20.111041 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.110989 2564 scope.go:117] "RemoveContainer" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" Jul 09 15:32:20.111218 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.111198 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258"} err="failed to get container status \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": rpc error: code = NotFound desc = could not find container \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": container with ID starting with 66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258 not found: ID does not exist" Jul 09 15:32:20.111218 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.111216 2564 scope.go:117] "RemoveContainer" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" Jul 09 15:32:20.111423 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.111401 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc"} err="failed to get container status \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": rpc error: code = NotFound desc = could not find container \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": container with ID starting with 55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc not found: ID does not exist" Jul 09 15:32:20.111486 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.111423 2564 scope.go:117] "RemoveContainer" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" Jul 09 15:32:20.111642 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.111624 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4"} err="failed to get container status \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": rpc error: code = NotFound desc = could not find container \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": container with ID starting with 3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4 not found: ID does not exist" Jul 09 15:32:20.111709 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.111643 2564 scope.go:117] "RemoveContainer" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" Jul 09 15:32:20.111878 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.111856 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805"} err="failed to get container status \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": rpc error: code = NotFound desc = could not find container \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": container with ID starting with 2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805 not found: ID does not exist" Jul 09 15:32:20.111878 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.111878 2564 scope.go:117] "RemoveContainer" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" Jul 09 15:32:20.112123 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.112108 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66"} err="failed to get container status \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": rpc error: code = NotFound desc = could not find container \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": container with ID starting with 2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66 not found: ID does not exist" Jul 09 15:32:20.112163 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.112124 2564 scope.go:117] "RemoveContainer" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" Jul 09 15:32:20.112336 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.112321 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81"} err="failed to get container status \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": rpc error: code = NotFound desc = could not find container \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": container with ID starting with 27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81 not found: ID does not exist" Jul 09 15:32:20.112391 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.112338 2564 scope.go:117] "RemoveContainer" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" Jul 09 15:32:20.112518 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.112497 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff"} err="failed to get container status \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": rpc error: code = NotFound desc = could not find container \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": container with ID starting with dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff not found: ID does not exist" Jul 09 15:32:20.112575 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.112528 2564 scope.go:117] "RemoveContainer" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" Jul 09 15:32:20.112749 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.112734 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258"} err="failed to get container status \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": rpc error: code = NotFound desc = could not find container \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": container with ID starting with 66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258 not found: ID does not exist" Jul 09 15:32:20.112801 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.112750 2564 scope.go:117] "RemoveContainer" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" Jul 09 15:32:20.113038 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113014 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc"} err="failed to get container status \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": rpc error: code = NotFound desc = could not find container \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": container with ID starting with 55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc not found: ID does not exist" Jul 09 15:32:20.113101 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113040 2564 scope.go:117] "RemoveContainer" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" Jul 09 15:32:20.113278 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113259 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4"} err="failed to get container status \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": rpc error: code = NotFound desc = could not find container \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": container with ID starting with 3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4 not found: ID does not exist" Jul 09 15:32:20.113333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113279 2564 scope.go:117] "RemoveContainer" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" Jul 09 15:32:20.113522 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113507 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805"} err="failed to get container status \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": rpc error: code = NotFound desc = could not find container \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": container with ID starting with 2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805 not found: ID does not exist" Jul 09 15:32:20.113561 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113523 2564 scope.go:117] "RemoveContainer" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" Jul 09 15:32:20.113739 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113725 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66"} err="failed to get container status \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": rpc error: code = NotFound desc = could not find container \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": container with ID starting with 2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66 not found: ID does not exist" Jul 09 15:32:20.113780 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113739 2564 scope.go:117] "RemoveContainer" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" Jul 09 15:32:20.114002 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.113983 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81"} err="failed to get container status \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": rpc error: code = NotFound desc = could not find container \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": container with ID starting with 27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81 not found: ID does not exist" Jul 09 15:32:20.114049 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.114003 2564 scope.go:117] "RemoveContainer" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" Jul 09 15:32:20.114288 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.114269 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff"} err="failed to get container status \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": rpc error: code = NotFound desc = could not find container \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": container with ID starting with dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff not found: ID does not exist" Jul 09 15:32:20.114288 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.114288 2564 scope.go:117] "RemoveContainer" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" Jul 09 15:32:20.114535 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.114508 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258"} err="failed to get container status \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": rpc error: code = NotFound desc = could not find container \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": container with ID starting with 66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258 not found: ID does not exist" Jul 09 15:32:20.114535 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.114534 2564 scope.go:117] "RemoveContainer" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" Jul 09 15:32:20.114848 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.114830 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc"} err="failed to get container status \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": rpc error: code = NotFound desc = could not find container \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": container with ID starting with 55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc not found: ID does not exist" Jul 09 15:32:20.114931 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.114857 2564 scope.go:117] "RemoveContainer" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" Jul 09 15:32:20.115116 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.115097 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4"} err="failed to get container status \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": rpc error: code = NotFound desc = could not find container \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": container with ID starting with 3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4 not found: ID does not exist" Jul 09 15:32:20.115189 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.115119 2564 scope.go:117] "RemoveContainer" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" Jul 09 15:32:20.115333 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.115317 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805"} err="failed to get container status \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": rpc error: code = NotFound desc = could not find container \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": container with ID starting with 2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805 not found: ID does not exist" Jul 09 15:32:20.115396 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.115334 2564 scope.go:117] "RemoveContainer" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" Jul 09 15:32:20.115555 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.115537 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66"} err="failed to get container status \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": rpc error: code = NotFound desc = could not find container \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": container with ID starting with 2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66 not found: ID does not exist" Jul 09 15:32:20.115610 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.115555 2564 scope.go:117] "RemoveContainer" containerID="27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81" Jul 09 15:32:20.115773 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.115755 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81"} err="failed to get container status \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": rpc error: code = NotFound desc = could not find container \"27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81\": container with ID starting with 27aa0280fcab76135bf5a871cae20963f1c5a41a30aaa8bec559bff606ad1f81 not found: ID does not exist" Jul 09 15:32:20.115867 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.115782 2564 scope.go:117] "RemoveContainer" containerID="dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff" Jul 09 15:32:20.116020 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116002 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff"} err="failed to get container status \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": rpc error: code = NotFound desc = could not find container \"dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff\": container with ID starting with dfd66ac0bf733721d0c7cb267251eeb5c6d30c15ffa1d59a546c20f03a4b21ff not found: ID does not exist" Jul 09 15:32:20.116087 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116019 2564 scope.go:117] "RemoveContainer" containerID="66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258" Jul 09 15:32:20.116235 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116218 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258"} err="failed to get container status \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": rpc error: code = NotFound desc = could not find container \"66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258\": container with ID starting with 66d52bde38a99ec0acba39f430f6eb841553246835e5e2a45e2e473813181258 not found: ID does not exist" Jul 09 15:32:20.116298 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116236 2564 scope.go:117] "RemoveContainer" containerID="55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc" Jul 09 15:32:20.116528 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116435 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc"} err="failed to get container status \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": rpc error: code = NotFound desc = could not find container \"55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc\": container with ID starting with 55ecd6ba6942764d13e70d021f52cc5dbed1c16dcdaa2add6db1900d4465bacc not found: ID does not exist" Jul 09 15:32:20.116528 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116454 2564 scope.go:117] "RemoveContainer" containerID="3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4" Jul 09 15:32:20.116679 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116660 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4"} err="failed to get container status \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": rpc error: code = NotFound desc = could not find container \"3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4\": container with ID starting with 3610cc2ab04f18636ee2961dc082f7630dccbfa4c658f17e18b1c5b98e6ac5e4 not found: ID does not exist" Jul 09 15:32:20.116742 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116678 2564 scope.go:117] "RemoveContainer" containerID="2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805" Jul 09 15:32:20.116903 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116884 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805"} err="failed to get container status \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": rpc error: code = NotFound desc = could not find container \"2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805\": container with ID starting with 2a2c9db17457852bde13a8c9112e5b9e0e582e9a6790aab96657bcf352c00805 not found: ID does not exist" Jul 09 15:32:20.117002 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.116904 2564 scope.go:117] "RemoveContainer" containerID="2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66" Jul 09 15:32:20.117118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.117103 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66"} err="failed to get container status \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": rpc error: code = NotFound desc = could not find container \"2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66\": container with ID starting with 2f2309f1e812cf38277654abf0a0cda0dcda7bd46e5e29d5223131764fc79a66 not found: ID does not exist" Jul 09 15:32:20.156447 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156416 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-metrics-client-ca\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156620 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156457 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-metrics-client-certs\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156620 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156475 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-grpc-tls\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156620 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156494 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjpdp\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-kube-api-access-fjpdp\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156620 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156521 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-thanos-prometheus-http-client-file\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156620 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156581 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-web-config\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156620 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156613 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156648 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156672 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-kube-rbac-proxy\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156723 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-kubelet-serving-ca-bundle\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156763 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-serving-certs-ca-bundle\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156793 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-db\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156821 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-tls-assets\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156854 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-trusted-ca-bundle\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156882 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.156948 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156910 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-config-out\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.157443 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.156972 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-tls\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.157443 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.157008 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-config\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.157443 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.157032 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-1\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.157443 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.157057 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-2\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.157443 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.157087 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-0\") pod \"4af6fd76-27ce-4506-bf25-bde2e5ace548\" (UID: \"4af6fd76-27ce-4506-bf25-bde2e5ace548\") " Jul 09 15:32:20.157685 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.157519 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-metrics-client-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.158291 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.157760 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.158291 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.157781 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.158709 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.158683 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.158709 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.158697 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.158826 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.158721 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.158882 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.158825 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:32:20.159097 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.159073 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.160721 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.160691 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.161014 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.160905 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.161014 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.160977 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.161014 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.160993 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.161310 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.161286 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-config-out" (OuterVolumeSpecName: "config-out") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:32:20.161675 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.161629 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.161769 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.161720 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.161824 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.161788 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-config" (OuterVolumeSpecName: "config") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.162068 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.162038 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:32:20.162339 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.162318 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-kube-api-access-fjpdp" (OuterVolumeSpecName: "kube-api-access-fjpdp") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "kube-api-access-fjpdp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:32:20.162339 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.162324 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.172124 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.172103 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-web-config" (OuterVolumeSpecName: "web-config") pod "4af6fd76-27ce-4506-bf25-bde2e5ace548" (UID: "4af6fd76-27ce-4506-bf25-bde2e5ace548"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.258719 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258684 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.258719 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258709 2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-config-out\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.258719 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258720 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.258719 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258729 2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-config\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258737 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258746 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258756 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258764 2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-metrics-client-certs\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258773 2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-grpc-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258781 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjpdp\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-kube-api-access-fjpdp\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258789 2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258797 2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-web-config\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258805 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258812 2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258821 2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4af6fd76-27ce-4506-bf25-bde2e5ace548-secret-kube-rbac-proxy\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258829 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258838 2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4af6fd76-27ce-4506-bf25-bde2e5ace548-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258846 2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4af6fd76-27ce-4506-bf25-bde2e5ace548-prometheus-k8s-db\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.259001 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.258855 2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4af6fd76-27ce-4506-bf25-bde2e5ace548-tls-assets\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.375082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.375046 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:32:20.380342 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.380313 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:32:20.409592 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409558 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:32:20.409845 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409832 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="prometheus" Jul 09 15:32:20.409892 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409847 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="prometheus" Jul 09 15:32:20.409892 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409861 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy" Jul 09 15:32:20.409892 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409867 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy" Jul 09 15:32:20.409892 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409876 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy-web" Jul 09 15:32:20.409892 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409882 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy-web" Jul 09 15:32:20.409892 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409891 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17f46189-b120-45ce-a187-074ac888e842" containerName="console" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409896 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="17f46189-b120-45ce-a187-074ac888e842" containerName="console" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409903 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="init-config-reloader" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409908 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="init-config-reloader" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409928 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="thanos-sidecar" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409934 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="thanos-sidecar" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409944 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="config-reloader" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409949 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="config-reloader" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409958 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy-thanos" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.409963 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy-thanos" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.410023 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.410030 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy-web" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.410038 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="thanos-sidecar" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.410044 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="17f46189-b120-45ce-a187-074ac888e842" containerName="console" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.410050 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="prometheus" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.410055 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="kube-rbac-proxy-thanos" Jul 09 15:32:20.410105 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.410060 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" containerName="config-reloader" Jul 09 15:32:20.413949 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.413903 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.416935 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.416901 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 15:32:20.417056 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.416970 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 15:32:20.417267 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.417201 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tx285\"" Jul 09 15:32:20.417267 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.417243 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 15:32:20.417267 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.417248 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 15:32:20.417444 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.417268 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 15:32:20.417554 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.417539 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 15:32:20.417614 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.417543 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 15:32:20.417848 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.417833 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fk59tifsc2qks\"" Jul 09 15:32:20.417946 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.417848 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 15:32:20.418102 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.418088 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 15:32:20.418278 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.418258 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 15:32:20.418387 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.418298 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 15:32:20.418387 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.418322 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 15:32:20.418639 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.418620 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 15:32:20.420668 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.420648 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 15:32:20.423427 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.423408 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 15:32:20.432597 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.432569 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:32:20.561063 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561025 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561245 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561065 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561245 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561161 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-config\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561245 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf6b6\" (UniqueName: \"kubernetes.io/projected/c5f08365-9153-4c42-8907-8113f26bc0a2-kube-api-access-jf6b6\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561395 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561265 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5f08365-9153-4c42-8907-8113f26bc0a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561395 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561285 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561395 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561306 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561395 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561329 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561395 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561352 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5f08365-9153-4c42-8907-8113f26bc0a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561395 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561366 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561395 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561382 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561663 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561663 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561663 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561663 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561663 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561554 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561663 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561571 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561663 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561883 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.561883 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.561691 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.662942 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.662810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.662942 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.662865 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663175 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.662988 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5f08365-9153-4c42-8907-8113f26bc0a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663175 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663024 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663175 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663175 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663085 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663175 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663119 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663175 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663151 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663183 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663215 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663244 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663323 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663352 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663376 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663406 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.663465 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-config\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.664082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663472 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf6b6\" (UniqueName: \"kubernetes.io/projected/c5f08365-9153-4c42-8907-8113f26bc0a2-kube-api-access-jf6b6\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.664082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663514 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5f08365-9153-4c42-8907-8113f26bc0a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.664082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.664082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.663768 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.664282 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.664163 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.664282 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.664168 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.664282 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.664236 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.665757 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.664497 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.665757 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.665417 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.666207 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.665873 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5f08365-9153-4c42-8907-8113f26bc0a2-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.666207 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.666065 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.666437 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.666335 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.667654 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.667190 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.667654 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.667208 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.667654 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.667581 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.667854 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.667781 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.668176 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.668157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5f08365-9153-4c42-8907-8113f26bc0a2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.668601 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.668584 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-config\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.668858 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.668837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.668899 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.668847 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.669304 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.669281 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5f08365-9153-4c42-8907-8113f26bc0a2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.669371 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.669330 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5f08365-9153-4c42-8907-8113f26bc0a2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.675672 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.675651 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf6b6\" (UniqueName: \"kubernetes.io/projected/c5f08365-9153-4c42-8907-8113f26bc0a2-kube-api-access-jf6b6\") pod \"prometheus-k8s-0\" (UID: \"c5f08365-9153-4c42-8907-8113f26bc0a2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.684145 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.680880 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4af6fd76-27ce-4506-bf25-bde2e5ace548" path="/var/lib/kubelet/pods/4af6fd76-27ce-4506-bf25-bde2e5ace548/volumes" Jul 09 15:32:20.723788 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.723752 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:20.870988 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:20.868531 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 15:32:20.874953 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:32:20.874891 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5f08365_9153_4c42_8907_8113f26bc0a2.slice/crio-07939a6f60d460c75cee65f6556c21b068c87dc90fb06eab549c14d08b6d8973 WatchSource:0}: Error finding container 07939a6f60d460c75cee65f6556c21b068c87dc90fb06eab549c14d08b6d8973: Status 404 returned error can't find the container with id 07939a6f60d460c75cee65f6556c21b068c87dc90fb06eab549c14d08b6d8973 Jul 09 15:32:21.055461 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:21.055426 2564 generic.go:356] "Generic (PLEG): container finished" podID="c5f08365-9153-4c42-8907-8113f26bc0a2" containerID="7052fdb64e4f3a0bf631e74a4bd04713542390546540ec5e46e902d612e893e5" exitCode=0 Jul 09 15:32:21.055613 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:21.055486 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f08365-9153-4c42-8907-8113f26bc0a2","Type":"ContainerDied","Data":"7052fdb64e4f3a0bf631e74a4bd04713542390546540ec5e46e902d612e893e5"} Jul 09 15:32:21.055613 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:21.055555 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f08365-9153-4c42-8907-8113f26bc0a2","Type":"ContainerStarted","Data":"07939a6f60d460c75cee65f6556c21b068c87dc90fb06eab549c14d08b6d8973"} Jul 09 15:32:22.063524 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:22.063433 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f08365-9153-4c42-8907-8113f26bc0a2","Type":"ContainerStarted","Data":"28d2f6fc780a03c9a1acb257eae23cf8ccd1066ac6786b5941f1beb2ce36d50d"} Jul 09 15:32:22.063524 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:22.063509 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f08365-9153-4c42-8907-8113f26bc0a2","Type":"ContainerStarted","Data":"70a12982fdfba07f371a917bcaef6af81859abe7757f5c1df135dbcaeec2269a"} Jul 09 15:32:22.064042 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:22.063550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f08365-9153-4c42-8907-8113f26bc0a2","Type":"ContainerStarted","Data":"f8a879eb61c4cb94748dc2512315142e649356b764305d718a6733b454f3c7f3"} Jul 09 15:32:22.064042 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:22.063592 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f08365-9153-4c42-8907-8113f26bc0a2","Type":"ContainerStarted","Data":"a4f5d241100d8d7fdedf064eb93c7065bf977745276f48947262794ae1f951f5"} Jul 09 15:32:22.064042 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:22.063630 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f08365-9153-4c42-8907-8113f26bc0a2","Type":"ContainerStarted","Data":"ff50eb6ecf604fdfc6081adf87a566c34f35a0d6904d7ba7af31933bcf11e956"} Jul 09 15:32:22.064042 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:22.063675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5f08365-9153-4c42-8907-8113f26bc0a2","Type":"ContainerStarted","Data":"4e35dd96c5809610337d37234a2e1d9014c23f754fddd5de304d8a111ea475d6"} Jul 09 15:32:22.095904 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:22.095458 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.075089191 podStartE2EDuration="2.09541065s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.321459ms" isStatefulPod=false podCreationTimestamp="2026-07-09 15:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:22.093541645 +0000 UTC m=+356.011241281" watchObservedRunningTime="2026-07-09 15:32:22.09541065 +0000 UTC m=+356.013110279" Jul 09 15:32:25.724272 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:25.724239 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:32:37.259236 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:32:37.259195 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56df5b4bb5-ff4zk"] Jul 09 15:33:02.280612 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.280566 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56df5b4bb5-ff4zk" podUID="f2239d1e-d4fc-465b-bdef-9c989cf05736" containerName="console" containerID="cri-o://682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35" gracePeriod=15 Jul 09 15:33:02.522256 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.522233 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:33:02.629689 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.629658 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-trusted-ca-bundle\") pod \"f2239d1e-d4fc-465b-bdef-9c989cf05736\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " Jul 09 15:33:02.629689 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.629706 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-oauth-config\") pod \"f2239d1e-d4fc-465b-bdef-9c989cf05736\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " Jul 09 15:33:02.629965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.629740 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-service-ca\") pod \"f2239d1e-d4fc-465b-bdef-9c989cf05736\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " Jul 09 15:33:02.629965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.629766 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-config\") pod \"f2239d1e-d4fc-465b-bdef-9c989cf05736\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " Jul 09 15:33:02.629965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.629801 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-serving-cert\") pod \"f2239d1e-d4fc-465b-bdef-9c989cf05736\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " Jul 09 15:33:02.629965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.629825 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-oauth-serving-cert\") pod \"f2239d1e-d4fc-465b-bdef-9c989cf05736\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " Jul 09 15:33:02.629965 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.629861 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjp7g\" (UniqueName: \"kubernetes.io/projected/f2239d1e-d4fc-465b-bdef-9c989cf05736-kube-api-access-jjp7g\") pod \"f2239d1e-d4fc-465b-bdef-9c989cf05736\" (UID: \"f2239d1e-d4fc-465b-bdef-9c989cf05736\") " Jul 09 15:33:02.630287 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.630261 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f2239d1e-d4fc-465b-bdef-9c989cf05736" (UID: "f2239d1e-d4fc-465b-bdef-9c989cf05736"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:02.630407 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.630303 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-config" (OuterVolumeSpecName: "console-config") pod "f2239d1e-d4fc-465b-bdef-9c989cf05736" (UID: "f2239d1e-d4fc-465b-bdef-9c989cf05736"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:02.630407 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.630315 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-service-ca" (OuterVolumeSpecName: "service-ca") pod "f2239d1e-d4fc-465b-bdef-9c989cf05736" (UID: "f2239d1e-d4fc-465b-bdef-9c989cf05736"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:02.630407 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.630378 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f2239d1e-d4fc-465b-bdef-9c989cf05736" (UID: "f2239d1e-d4fc-465b-bdef-9c989cf05736"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:33:02.632183 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.632148 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f2239d1e-d4fc-465b-bdef-9c989cf05736" (UID: "f2239d1e-d4fc-465b-bdef-9c989cf05736"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:33:02.632273 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.632198 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2239d1e-d4fc-465b-bdef-9c989cf05736-kube-api-access-jjp7g" (OuterVolumeSpecName: "kube-api-access-jjp7g") pod "f2239d1e-d4fc-465b-bdef-9c989cf05736" (UID: "f2239d1e-d4fc-465b-bdef-9c989cf05736"). InnerVolumeSpecName "kube-api-access-jjp7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:33:02.632273 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.632237 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f2239d1e-d4fc-465b-bdef-9c989cf05736" (UID: "f2239d1e-d4fc-465b-bdef-9c989cf05736"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:33:02.730964 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.730905 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjp7g\" (UniqueName: \"kubernetes.io/projected/f2239d1e-d4fc-465b-bdef-9c989cf05736-kube-api-access-jjp7g\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:33:02.730964 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.730958 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-trusted-ca-bundle\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:33:02.730964 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.730967 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-oauth-config\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:33:02.730964 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.730976 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-service-ca\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:33:02.731224 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.730985 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-config\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:33:02.731224 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.730993 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2239d1e-d4fc-465b-bdef-9c989cf05736-console-serving-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:33:02.731224 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:02.731001 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2239d1e-d4fc-465b-bdef-9c989cf05736-oauth-serving-cert\") on node \"ip-10-0-130-178.ec2.internal\" DevicePath \"\"" Jul 09 15:33:03.233554 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.233514 2564 generic.go:356] "Generic (PLEG): container finished" podID="f2239d1e-d4fc-465b-bdef-9c989cf05736" containerID="682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35" exitCode=0 Jul 09 15:33:03.233754 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.233585 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56df5b4bb5-ff4zk" Jul 09 15:33:03.233754 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.233615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56df5b4bb5-ff4zk" event={"ID":"f2239d1e-d4fc-465b-bdef-9c989cf05736","Type":"ContainerDied","Data":"682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35"} Jul 09 15:33:03.233754 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.233673 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56df5b4bb5-ff4zk" event={"ID":"f2239d1e-d4fc-465b-bdef-9c989cf05736","Type":"ContainerDied","Data":"50fb3ec05db2f2c28fce94318c7d3ce760a45a64f8c273d9cf5a11f84adbc0bc"} Jul 09 15:33:03.233754 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.233698 2564 scope.go:117] "RemoveContainer" containerID="682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35" Jul 09 15:33:03.241951 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.241933 2564 scope.go:117] "RemoveContainer" containerID="682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35" Jul 09 15:33:03.242213 ip-10-0-130-178 kubenswrapper[2564]: E0709 15:33:03.242194 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35\": container with ID starting with 682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35 not found: ID does not exist" containerID="682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35" Jul 09 15:33:03.242261 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.242223 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35"} err="failed to get container status \"682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35\": rpc error: code = NotFound desc = could not find container \"682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35\": container with ID starting with 682d19bc761db797a63ef06cfafed88ed55d5b41662c2fac387e5c6350bc5f35 not found: ID does not exist" Jul 09 15:33:03.252382 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.252361 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56df5b4bb5-ff4zk"] Jul 09 15:33:03.256016 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:03.255996 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56df5b4bb5-ff4zk"] Jul 09 15:33:04.679949 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:04.679893 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2239d1e-d4fc-465b-bdef-9c989cf05736" path="/var/lib/kubelet/pods/f2239d1e-d4fc-465b-bdef-9c989cf05736/volumes" Jul 09 15:33:20.724358 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:20.724318 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:33:20.740440 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:20.740411 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:33:21.319807 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:33:21.319781 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 15:36:26.498118 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:36:26.498087 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:36:26.498665 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:36:26.498648 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:36:26.502999 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:36:26.502980 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:36:26.503665 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:36:26.503649 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:41:26.520552 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:41:26.520464 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:41:26.523036 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:41:26.523014 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:41:26.526128 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:41:26.526105 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:41:26.527855 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:41:26.527831 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:44:53.518360 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.518326 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88bmh/must-gather-kkjnp"] Jul 09 15:44:53.520733 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.518618 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2239d1e-d4fc-465b-bdef-9c989cf05736" containerName="console" Jul 09 15:44:53.520733 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.518633 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2239d1e-d4fc-465b-bdef-9c989cf05736" containerName="console" Jul 09 15:44:53.520733 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.518692 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2239d1e-d4fc-465b-bdef-9c989cf05736" containerName="console" Jul 09 15:44:53.521622 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.521608 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88bmh/must-gather-kkjnp" Jul 09 15:44:53.524135 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.524110 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88bmh\"/\"kube-root-ca.crt\"" Jul 09 15:44:53.524135 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.524129 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88bmh\"/\"openshift-service-ca.crt\"" Jul 09 15:44:53.524290 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.524160 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-88bmh\"/\"default-dockercfg-82rxv\"" Jul 09 15:44:53.530448 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.530421 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rv6l\" (UniqueName: \"kubernetes.io/projected/35398409-a163-415b-8fd7-8c0ea689fdea-kube-api-access-9rv6l\") pod \"must-gather-kkjnp\" (UID: \"35398409-a163-415b-8fd7-8c0ea689fdea\") " pod="openshift-must-gather-88bmh/must-gather-kkjnp" Jul 09 15:44:53.530638 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.530612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/35398409-a163-415b-8fd7-8c0ea689fdea-must-gather-output\") pod \"must-gather-kkjnp\" (UID: \"35398409-a163-415b-8fd7-8c0ea689fdea\") " pod="openshift-must-gather-88bmh/must-gather-kkjnp" Jul 09 15:44:53.531015 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.530995 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88bmh/must-gather-kkjnp"] Jul 09 15:44:53.631865 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.631826 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/35398409-a163-415b-8fd7-8c0ea689fdea-must-gather-output\") pod \"must-gather-kkjnp\" (UID: \"35398409-a163-415b-8fd7-8c0ea689fdea\") " pod="openshift-must-gather-88bmh/must-gather-kkjnp" Jul 09 15:44:53.632082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.631880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rv6l\" (UniqueName: \"kubernetes.io/projected/35398409-a163-415b-8fd7-8c0ea689fdea-kube-api-access-9rv6l\") pod \"must-gather-kkjnp\" (UID: \"35398409-a163-415b-8fd7-8c0ea689fdea\") " pod="openshift-must-gather-88bmh/must-gather-kkjnp" Jul 09 15:44:53.632177 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.632157 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/35398409-a163-415b-8fd7-8c0ea689fdea-must-gather-output\") pod \"must-gather-kkjnp\" (UID: \"35398409-a163-415b-8fd7-8c0ea689fdea\") " pod="openshift-must-gather-88bmh/must-gather-kkjnp" Jul 09 15:44:53.640291 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.640266 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rv6l\" (UniqueName: \"kubernetes.io/projected/35398409-a163-415b-8fd7-8c0ea689fdea-kube-api-access-9rv6l\") pod \"must-gather-kkjnp\" (UID: \"35398409-a163-415b-8fd7-8c0ea689fdea\") " pod="openshift-must-gather-88bmh/must-gather-kkjnp" Jul 09 15:44:53.831568 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.831483 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88bmh/must-gather-kkjnp" Jul 09 15:44:53.959476 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.959445 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88bmh/must-gather-kkjnp"] Jul 09 15:44:53.962448 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:44:53.962424 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod35398409_a163_415b_8fd7_8c0ea689fdea.slice/crio-bb6b5618f84eaec5a0d4a400e830ea017c23a401f3314d3f6d21a7570520bcef WatchSource:0}: Error finding container bb6b5618f84eaec5a0d4a400e830ea017c23a401f3314d3f6d21a7570520bcef: Status 404 returned error can't find the container with id bb6b5618f84eaec5a0d4a400e830ea017c23a401f3314d3f6d21a7570520bcef Jul 09 15:44:53.964680 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:53.964665 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:44:54.856153 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:54.856128 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88bmh/must-gather-kkjnp" event={"ID":"35398409-a163-415b-8fd7-8c0ea689fdea","Type":"ContainerStarted","Data":"bb6b5618f84eaec5a0d4a400e830ea017c23a401f3314d3f6d21a7570520bcef"} Jul 09 15:44:55.862031 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:55.862002 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88bmh/must-gather-kkjnp" event={"ID":"35398409-a163-415b-8fd7-8c0ea689fdea","Type":"ContainerStarted","Data":"83cec7ea35c1d0ebe680d491d791b98eb07659597488b9c8d8fd88527a53644f"} Jul 09 15:44:55.862396 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:55.862040 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88bmh/must-gather-kkjnp" event={"ID":"35398409-a163-415b-8fd7-8c0ea689fdea","Type":"ContainerStarted","Data":"a1e897ed9c5abdc0b8567975f18076f822e1f01a9dddc2ce8061ecfed0a26abd"} Jul 09 15:44:55.879533 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:55.879478 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88bmh/must-gather-kkjnp" podStartSLOduration=1.996998321 podStartE2EDuration="2.879461475s" totalImagesPullingTime="882.463154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:44:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:44:55.877856391 +0000 UTC m=+1109.795556024" watchObservedRunningTime="2026-07-09 15:44:55.879461475 +0000 UTC m=+1109.797161104" Jul 09 15:44:56.273483 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:56.273414 2564 ???:1] "http2: server: error reading preface from client 10.0.130.178:53576: read tcp 10.0.130.178:10250->10.0.130.178:53576: read: connection reset by peer" Jul 09 15:44:56.277311 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:56.277287 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rfwbj_b7a7bac9-274f-43b3-8b11-86b27ec0b39f/global-pull-secret-syncer/0.log" Jul 09 15:44:56.421495 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:56.421468 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wqfxp_28bc495a-fda4-427f-ad3d-0dd1486047c3/konnectivity-agent/0.log" Jul 09 15:44:56.442892 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:44:56.442865 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-178.ec2.internal_7e5861fb7c10128f501f80d1aa143731/haproxy/0.log" Jul 09 15:45:00.879555 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:00.879523 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ssv7m_5aa25c3d-8adc-4aed-bd2c-b471ea931579/kube-state-metrics/0.log" Jul 09 15:45:00.921856 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:00.921826 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ssv7m_5aa25c3d-8adc-4aed-bd2c-b471ea931579/kube-rbac-proxy-main/0.log" Jul 09 15:45:00.958374 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:00.958345 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-ssv7m_5aa25c3d-8adc-4aed-bd2c-b471ea931579/kube-rbac-proxy-self/0.log" Jul 09 15:45:01.242088 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.242011 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwvhq_b4c5fcfe-1587-4aca-a297-0c5b41e2d822/node-exporter/0.log" Jul 09 15:45:01.294306 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.294260 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwvhq_b4c5fcfe-1587-4aca-a297-0c5b41e2d822/kube-rbac-proxy/0.log" Jul 09 15:45:01.402298 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.402264 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dwvhq_b4c5fcfe-1587-4aca-a297-0c5b41e2d822/init-textfile/0.log" Jul 09 15:45:01.629048 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.629012 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skmjc_5f305e93-8838-45d8-953b-b4aafcea2982/kube-rbac-proxy-main/0.log" Jul 09 15:45:01.669511 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.669475 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skmjc_5f305e93-8838-45d8-953b-b4aafcea2982/kube-rbac-proxy-self/0.log" Jul 09 15:45:01.703644 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.703594 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-skmjc_5f305e93-8838-45d8-953b-b4aafcea2982/openshift-state-metrics/0.log" Jul 09 15:45:01.772681 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.772648 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f08365-9153-4c42-8907-8113f26bc0a2/prometheus/0.log" Jul 09 15:45:01.804257 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.804215 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f08365-9153-4c42-8907-8113f26bc0a2/config-reloader/0.log" Jul 09 15:45:01.835427 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.835364 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f08365-9153-4c42-8907-8113f26bc0a2/thanos-sidecar/0.log" Jul 09 15:45:01.866255 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.866220 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f08365-9153-4c42-8907-8113f26bc0a2/kube-rbac-proxy-web/0.log" Jul 09 15:45:01.902542 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.902513 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f08365-9153-4c42-8907-8113f26bc0a2/kube-rbac-proxy/0.log" Jul 09 15:45:01.933372 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.933350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f08365-9153-4c42-8907-8113f26bc0a2/kube-rbac-proxy-thanos/0.log" Jul 09 15:45:01.987710 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:01.987676 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c5f08365-9153-4c42-8907-8113f26bc0a2/init-config-reloader/0.log" Jul 09 15:45:04.154335 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.154305 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg"] Jul 09 15:45:04.159901 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.159870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.168899 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.168877 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/1.log" Jul 09 15:45:04.169792 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.169768 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg"] Jul 09 15:45:04.178642 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.178606 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-c6v9j_d9a72df8-24c2-4ccc-ba69-26ee5a2801c9/console-operator/2.log" Jul 09 15:45:04.232438 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.232393 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jgks\" (UniqueName: \"kubernetes.io/projected/c94518e4-004e-47db-9462-bf2c9ffb2a33-kube-api-access-7jgks\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.232638 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.232457 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-proc\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.232638 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.232490 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-podres\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.232638 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.232527 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-lib-modules\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.232638 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.232596 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-sys\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.333895 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.333864 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-sys\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.334090 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.333908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jgks\" (UniqueName: \"kubernetes.io/projected/c94518e4-004e-47db-9462-bf2c9ffb2a33-kube-api-access-7jgks\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.334090 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.333960 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-proc\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.334090 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.333984 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-podres\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.334090 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.334013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-lib-modules\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.334090 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.334013 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-sys\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.334090 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.334073 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-proc\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.334316 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.334126 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-podres\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.334316 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.334160 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c94518e4-004e-47db-9462-bf2c9ffb2a33-lib-modules\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.342726 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.342699 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jgks\" (UniqueName: \"kubernetes.io/projected/c94518e4-004e-47db-9462-bf2c9ffb2a33-kube-api-access-7jgks\") pod \"perf-node-gather-daemonset-562pg\" (UID: \"c94518e4-004e-47db-9462-bf2c9ffb2a33\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.472073 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.471980 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.651515 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.650977 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg"] Jul 09 15:45:04.658631 ip-10-0-130-178 kubenswrapper[2564]: W0709 15:45:04.658571 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc94518e4_004e_47db_9462_bf2c9ffb2a33.slice/crio-a15cc39e9598101cd3cc6d94a46af9dd46090aeb1748808cd53144a1dbe34b70 WatchSource:0}: Error finding container a15cc39e9598101cd3cc6d94a46af9dd46090aeb1748808cd53144a1dbe34b70: Status 404 returned error can't find the container with id a15cc39e9598101cd3cc6d94a46af9dd46090aeb1748808cd53144a1dbe34b70 Jul 09 15:45:04.910471 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.910356 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" event={"ID":"c94518e4-004e-47db-9462-bf2c9ffb2a33","Type":"ContainerStarted","Data":"4ca0e7ae3c0d6941e7264483ab80167c3739bcb1beb60a458f42685400da62b4"} Jul 09 15:45:04.910471 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.910424 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" event={"ID":"c94518e4-004e-47db-9462-bf2c9ffb2a33","Type":"ContainerStarted","Data":"a15cc39e9598101cd3cc6d94a46af9dd46090aeb1748808cd53144a1dbe34b70"} Jul 09 15:45:04.910844 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.910799 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:04.930486 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:04.930432 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" podStartSLOduration=0.930414195 podStartE2EDuration="930.414195ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:45:04.929552732 +0000 UTC m=+1118.847252366" watchObservedRunningTime="2026-07-09 15:45:04.930414195 +0000 UTC m=+1118.848113857" Jul 09 15:45:06.168077 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:06.168049 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pq9ph_61052b40-9684-41e8-ac97-f6633e32a3ff/dns/0.log" Jul 09 15:45:06.190302 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:06.190274 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pq9ph_61052b40-9684-41e8-ac97-f6633e32a3ff/kube-rbac-proxy/0.log" Jul 09 15:45:06.240195 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:06.240146 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-d7mnj_dc1e8316-7b3f-47b7-b7b0-6831130b9e5d/dns-node-resolver/0.log" Jul 09 15:45:06.824579 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:06.824554 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-df9fw_cf35a2fc-9f61-4605-a428-033b174483ce/node-ca/0.log" Jul 09 15:45:07.635440 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:07.635412 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7548f45bc4-xvtw4_241bdd29-60e6-4961-9a09-a9c1d60a482a/router/0.log" Jul 09 15:45:07.970316 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:07.970246 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gk4kc_21f631c8-0b85-4b98-a556-149dfc315f9b/serve-healthcheck-canary/0.log" Jul 09 15:45:08.405705 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:08.405655 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7ff8j_e9a06d1f-3c53-496b-a1e0-588a1a4fb21e/insights-operator/0.log" Jul 09 15:45:08.406624 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:08.406605 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7ff8j_e9a06d1f-3c53-496b-a1e0-588a1a4fb21e/insights-operator/1.log" Jul 09 15:45:08.613368 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:08.613336 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-prh5h_40808fa7-0ac9-461f-b481-c725a1917cee/kube-rbac-proxy/0.log" Jul 09 15:45:08.636845 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:08.636815 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-prh5h_40808fa7-0ac9-461f-b481-c725a1917cee/exporter/0.log" Jul 09 15:45:08.671082 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:08.671013 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-prh5h_40808fa7-0ac9-461f-b481-c725a1917cee/extractor/0.log" Jul 09 15:45:10.931401 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:10.931371 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-562pg" Jul 09 15:45:17.299730 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:17.299704 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ksf9_f1d10af5-0153-41c0-8cca-a7c6ad1252da/kube-multus-additional-cni-plugins/0.log" Jul 09 15:45:17.333353 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:17.333325 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ksf9_f1d10af5-0153-41c0-8cca-a7c6ad1252da/egress-router-binary-copy/0.log" Jul 09 15:45:17.364517 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:17.364491 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ksf9_f1d10af5-0153-41c0-8cca-a7c6ad1252da/cni-plugins/0.log" Jul 09 15:45:17.405537 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:17.405503 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ksf9_f1d10af5-0153-41c0-8cca-a7c6ad1252da/bond-cni-plugin/0.log" Jul 09 15:45:17.436369 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:17.436337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ksf9_f1d10af5-0153-41c0-8cca-a7c6ad1252da/routeoverride-cni/0.log" Jul 09 15:45:17.470165 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:17.470129 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ksf9_f1d10af5-0153-41c0-8cca-a7c6ad1252da/whereabouts-cni-bincopy/0.log" Jul 09 15:45:17.501268 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:17.501235 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7ksf9_f1d10af5-0153-41c0-8cca-a7c6ad1252da/whereabouts-cni/0.log" Jul 09 15:45:17.759593 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:17.759566 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-h7h7h_1789c039-b1fb-4746-a9e6-c4a1f0d4402e/kube-multus/0.log" Jul 09 15:45:18.000586 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.000544 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hcp4j_570094ba-60a1-43c6-b3b0-02964cbe6af0/network-metrics-daemon/0.log" Jul 09 15:45:18.025514 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.025449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hcp4j_570094ba-60a1-43c6-b3b0-02964cbe6af0/kube-rbac-proxy/0.log" Jul 09 15:45:18.821396 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.821372 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-controller/0.log" Jul 09 15:45:18.843826 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.843799 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/1.log" Jul 09 15:45:18.843986 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.843955 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovn-acl-logging/0.log" Jul 09 15:45:18.869638 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.869613 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/kube-rbac-proxy-node/0.log" Jul 09 15:45:18.897457 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.897435 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 15:45:18.919614 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.919588 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/northd/0.log" Jul 09 15:45:18.941179 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.941151 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/nbdb/0.log" Jul 09 15:45:18.964016 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:18.963995 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/sbdb/0.log" Jul 09 15:45:19.004947 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:19.004893 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9p68n_93cc2f34-c3c3-464b-ab40-a12deccc6f1e/ovnkube-controller/0.log" Jul 09 15:45:20.564521 ip-10-0-130-178 kubenswrapper[2564]: I0709 15:45:20.564492 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pqfh9_f7040f84-4e0f-4952-8fae-87389c8a8b65/network-check-target-container/0.log"