Jul 20 09:55:09.905078 ip-10-0-133-245 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 20 09:55:09.905089 ip-10-0-133-245 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 20 09:55:09.905095 ip-10-0-133-245 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 20 09:55:09.905300 ip-10-0-133-245 systemd[1]: Failed to start Kubernetes Kubelet. Jul 20 09:55:19.913062 ip-10-0-133-245 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 20 09:55:19.913079 ip-10-0-133-245 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2c04f944fa2b47029ad21d24138021d7 -- Jul 20 09:56:49.530383 ip-10-0-133-245 systemd[1]: Starting Kubernetes Kubelet... Jul 20 09:56:49.987862 ip-10-0-133-245 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:56:49.987862 ip-10-0-133-245 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 20 09:56:49.987862 ip-10-0-133-245 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:56:49.987862 ip-10-0-133-245 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 20 09:56:49.987862 ip-10-0-133-245 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 20 09:56:49.990149 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.990016 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 20 09:56:49.996904 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996886 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:56:49.996904 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996903 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:56:49.996904 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996907 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996913 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996917 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996921 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996927 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996933 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996936 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996940 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996944 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996948 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996951 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996957 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996962 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996967 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996971 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996983 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996987 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996992 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996995 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:56:49.997123 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.996999 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997003 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997007 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997010 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997014 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997018 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997023 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997027 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997031 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997035 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997039 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997043 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997047 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997052 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997057 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997078 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997084 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997089 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997093 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997098 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:56:49.997717 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997102 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997106 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997110 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997115 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997119 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997123 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997126 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997131 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997136 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997141 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997145 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997149 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997153 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997158 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997162 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997167 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997171 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997175 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997179 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997183 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:56:49.998252 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997187 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997191 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997195 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997200 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997204 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997208 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997214 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997219 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997223 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997227 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997233 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997237 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997241 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997245 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997249 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997254 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997258 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997262 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997266 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997270 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:56:49.998729 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997274 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997278 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997283 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997286 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997293 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997297 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997301 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997305 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997309 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997313 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997320 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997325 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997330 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997335 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997340 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997344 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997348 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.997352 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998162 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998174 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:56:49.999230 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998177 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998181 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998184 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998186 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998190 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998193 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998196 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998199 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998201 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998205 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998207 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998210 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998212 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998215 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998217 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998220 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998223 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998225 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998227 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:56:49.999720 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998230 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998232 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998234 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998237 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998239 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998242 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998244 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998247 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998249 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998252 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998254 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998257 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998260 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998264 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998266 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998271 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998274 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998277 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998280 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:56:50.000204 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998282 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998285 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998288 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998291 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998293 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998296 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998298 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998301 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998303 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998305 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998308 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998310 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998313 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998315 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998317 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998320 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998323 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998326 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998328 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998331 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:56:50.000659 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998333 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998336 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998338 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998341 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998343 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998346 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998350 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998352 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998355 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998358 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998360 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998364 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998368 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998371 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998374 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998377 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998379 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998382 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998385 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:56:50.001200 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998388 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998390 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998393 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998395 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998397 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998400 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998402 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998405 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998407 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998410 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998412 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998415 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998417 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998421 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998424 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998427 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998429 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998432 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998436 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:56:50.001673 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998438 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998855 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998861 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998864 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998867 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998870 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998872 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998875 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998879 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998882 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998885 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998887 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998890 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998892 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998895 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998897 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998900 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998902 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998904 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:56:50.002155 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998906 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998909 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998911 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998913 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998916 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998918 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998921 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998924 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998927 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998931 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998934 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998937 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998940 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998943 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998948 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998951 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998953 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998956 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998958 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:56:50.002605 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998961 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998963 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998966 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998969 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998971 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998974 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998976 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998979 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998982 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998984 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998987 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998989 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998992 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998995 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.998998 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999001 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999004 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999006 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999009 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999011 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:56:50.003054 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999014 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999018 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999020 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999022 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999025 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999028 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999030 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999033 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999036 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999038 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999040 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999043 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999045 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999047 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999050 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999052 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999054 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999057 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999059 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999076 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:56:50.003562 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999079 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999082 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999084 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999087 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999089 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999092 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999094 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999097 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999100 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999102 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999105 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999108 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999110 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999113 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999115 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999118 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999120 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999123 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999125 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999128 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:56:50.004164 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999130 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999133 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999200 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999207 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999214 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999221 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999225 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999228 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999232 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999237 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999240 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999243 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999247 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999250 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999253 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999256 2583 flags.go:64] FLAG: --cgroup-root="" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999259 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999262 2583 flags.go:64] FLAG: --client-ca-file="" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999265 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999267 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999293 2583 flags.go:64] FLAG: --cluster-domain="" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999297 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999300 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999303 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 20 09:56:50.004665 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999307 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999310 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999313 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999316 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999319 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999322 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999325 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999327 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999330 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999333 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999337 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999340 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999344 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999346 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999349 2583 flags.go:64] FLAG: --enable-server="true" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999352 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999356 2583 flags.go:64] FLAG: --event-burst="100" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999359 2583 flags.go:64] FLAG: --event-qps="50" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999362 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999365 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999367 2583 flags.go:64] FLAG: --eviction-hard="" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999371 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999374 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999377 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999380 2583 flags.go:64] FLAG: --eviction-soft="" Jul 20 09:56:50.005264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999383 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999385 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999388 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999393 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999396 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999398 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999401 2583 flags.go:64] FLAG: --feature-gates="" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999404 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999407 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999410 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999413 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999416 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999419 2583 flags.go:64] FLAG: --help="false" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999422 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999425 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999427 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999430 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999433 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999437 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999439 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999442 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999445 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999447 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 20 09:56:50.005858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999450 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999453 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999455 2583 flags.go:64] FLAG: --kube-reserved="" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999458 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999461 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999464 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999466 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999469 2583 flags.go:64] FLAG: --lock-file="" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999471 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999474 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999476 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999482 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999486 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999489 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999492 2583 flags.go:64] FLAG: --logging-format="text" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999495 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999498 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999501 2583 flags.go:64] FLAG: --manifest-url="" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999503 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999508 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999511 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999515 2583 flags.go:64] FLAG: --max-pods="110" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999518 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999521 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999524 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 20 09:56:50.006509 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999527 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999530 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999532 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999536 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999542 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999545 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999548 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999551 2583 flags.go:64] FLAG: --pod-cidr="" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999554 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999559 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999562 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999565 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999569 2583 flags.go:64] FLAG: --port="10250" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999572 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999575 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09146a78fc7c347aa" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999578 2583 flags.go:64] FLAG: --qos-reserved="" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999581 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999584 2583 flags.go:64] FLAG: --register-node="true" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999587 2583 flags.go:64] FLAG: --register-with-taints="" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999591 2583 flags.go:64] FLAG: --registry-burst="10" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999594 2583 flags.go:64] FLAG: --registry-qps="5" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999597 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999600 2583 flags.go:64] FLAG: --reserved-memory="" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999604 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999607 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 20 09:56:50.007146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999609 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999612 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999615 2583 flags.go:64] FLAG: --runonce="false" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999617 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999620 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999623 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999626 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999628 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999631 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999635 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999638 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999641 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999644 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999646 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999650 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999653 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999655 2583 flags.go:64] FLAG: --system-cgroups="" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999658 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999663 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999667 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999670 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999673 2583 flags.go:64] FLAG: --tls-min-version="" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999676 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999679 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999682 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 20 09:56:50.007748 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999684 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999689 2583 flags.go:64] FLAG: --v="2" Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999693 2583 flags.go:64] FLAG: --version="false" Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999697 2583 flags.go:64] FLAG: --vmodule="" Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999700 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:49.999703 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999812 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999817 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999822 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999825 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999829 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999831 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999834 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999837 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999840 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999843 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999845 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999848 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999850 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999853 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999856 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:56:50.008376 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999859 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999862 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999865 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999868 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999870 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999874 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999877 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999879 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999881 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999884 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999887 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999889 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999893 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999895 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999898 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999900 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999904 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999908 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999910 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:56:50.008883 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999913 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999916 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999918 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999920 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999923 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999925 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999928 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999930 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999932 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999935 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999937 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999940 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999943 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999945 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999947 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999950 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999952 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999955 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999958 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:56:50.009370 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999961 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999963 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999966 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999968 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999970 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999973 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999976 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999979 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999981 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999984 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999986 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999989 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999991 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999994 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999996 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:49.999999 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000001 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000003 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000006 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000008 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:56:50.009826 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000010 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000013 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000015 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000018 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000020 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000023 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000026 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000028 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000031 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000033 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000035 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000039 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000042 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000044 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000046 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000049 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000051 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000054 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000057 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000059 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:56:50.010362 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000079 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000084 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000087 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000091 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000094 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.000097 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.000757 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.007934 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.007949 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.007968 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.007973 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008028 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008035 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008038 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:56:50.010841 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008041 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008044 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008047 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008050 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008053 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008056 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008059 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008077 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008080 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008083 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008086 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008089 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008092 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008095 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008097 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008100 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008103 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008107 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008111 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008113 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:56:50.011198 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008116 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008119 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008121 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008124 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008127 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008129 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008133 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008135 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008138 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008141 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008143 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008146 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008149 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008151 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008154 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008156 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008159 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008161 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008165 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:56:50.011688 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008168 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008171 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008173 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008176 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008178 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008181 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008183 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008185 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008188 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008190 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008192 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008195 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008197 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008199 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008202 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008204 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008207 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008209 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008211 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008215 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:56:50.012259 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008217 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008220 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008222 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008224 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008227 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008229 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008232 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008234 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008236 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008239 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008241 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008244 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008246 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008248 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008251 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008253 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008255 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008258 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008260 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008262 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:56:50.012739 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008265 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008267 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008269 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008271 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008274 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008276 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008279 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008281 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008284 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008288 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008290 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008293 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008296 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008299 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008302 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008305 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:56:50.013251 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008307 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.008313 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008441 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008446 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008449 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008451 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008454 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008456 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008459 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008461 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008464 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008466 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008468 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008471 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008474 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 20 09:56:50.013669 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008476 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008478 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008481 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008483 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008486 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008488 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008490 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008493 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008495 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008498 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008500 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008503 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008505 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008510 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008513 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008517 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008520 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008522 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008525 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 20 09:56:50.014030 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008528 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008532 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008534 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008537 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008539 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008542 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008544 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008546 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008549 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008551 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008553 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008556 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008558 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008560 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008563 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008565 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008567 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008570 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008572 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 20 09:56:50.014496 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008575 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008577 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008579 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008581 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008584 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008586 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008588 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008591 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008594 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008596 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008598 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008601 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008603 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008605 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008608 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008611 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008613 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008615 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008618 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008622 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 20 09:56:50.014935 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008625 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008627 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008629 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008631 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008634 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008636 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008639 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008641 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008643 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008646 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008648 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008651 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008653 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008656 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008658 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008660 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008663 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008665 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008668 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008670 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 20 09:56:50.015415 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008673 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008675 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008677 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008679 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008682 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008684 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008686 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:50.008689 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.008693 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.008794 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.011884 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.013490 2583 server.go:1019] "Starting client certificate rotation" Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.013595 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 09:56:50.015879 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.013634 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 20 09:56:50.016432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.016419 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 09:56:50.021838 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.021817 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 20 09:56:50.033732 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.033709 2583 log.go:25] "Validated CRI v1 runtime API" Jul 20 09:56:50.036105 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.036090 2583 log.go:25] "Validated CRI v1 image API" Jul 20 09:56:50.036914 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.036895 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 20 09:56:50.041201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.041178 2583 fs.go:135] Filesystem UUIDs: map[67c98079-1181-476a-ad75-a5346bd44dca:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fa2249c5-021a-4687-9fd1-048074f1bbde:/dev/nvme0n1p3] Jul 20 09:56:50.041274 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.041199 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 20 09:56:50.046478 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.046373 2583 manager.go:216] Machine: {Timestamp:2026-07-20 09:56:50.04491923 +0000 UTC m=+0.386593088 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3132438 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20cc30a80ec5bc27f6c215f52ad27e SystemUUID:ec20cc30-a80e-c5bc-27f6-c215f52ad27e BootID:2c04f944-fa2b-4702-9ad2-1d24138021d7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:09:bc:b2:18:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:09:bc:b2:18:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:3f:11:c3:20:85 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 20 09:56:50.046478 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.046474 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 20 09:56:50.046581 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.046549 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 20 09:56:50.049000 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.048986 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 09:56:50.049887 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.049855 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 20 09:56:50.050032 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.049891 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-245.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 20 09:56:50.050715 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.050705 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 20 09:56:50.050751 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.050718 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 20 09:56:50.050751 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.050725 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 09:56:50.051443 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.051431 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 20 09:56:50.053263 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.053253 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 20 09:56:50.056505 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.056495 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 20 09:56:50.056630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.056620 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 20 09:56:50.056664 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.056653 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 20 09:56:50.056691 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.056681 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 20 09:56:50.056720 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.056696 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 20 09:56:50.056720 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.056709 2583 kubelet.go:398] "Adding apiserver pod source" Jul 20 09:56:50.056770 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.056721 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 20 09:56:50.057052 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.057040 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 09:56:50.057134 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.057059 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 20 09:56:50.059482 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.059465 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 20 09:56:50.061950 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.061936 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 20 09:56:50.061992 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.061967 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 20 09:56:50.063477 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063466 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 20 09:56:50.063512 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063484 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 20 09:56:50.063512 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063491 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 20 09:56:50.063512 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063496 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 20 09:56:50.063512 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063504 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 20 09:56:50.063512 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063510 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 20 09:56:50.063680 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063518 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 20 09:56:50.063680 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063523 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 20 09:56:50.063680 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063529 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 20 09:56:50.063680 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063535 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 20 09:56:50.063680 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063542 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 20 09:56:50.063680 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.063556 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 20 09:56:50.064437 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.064424 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 20 09:56:50.064473 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.064442 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 20 09:56:50.067636 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.067618 2583 server.go:1268] "Started kubelet" Jul 20 09:56:50.071983 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.071954 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-245.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 20 09:56:50.072127 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.067789 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 20 09:56:50.072241 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.072189 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 20 09:56:50.072241 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.072241 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 20 09:56:50.072716 ip-10-0-133-245 systemd[1]: Started Kubernetes Kubelet. Jul 20 09:56:50.073429 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.073400 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 20 09:56:50.073949 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.073911 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 20 09:56:50.074610 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.074593 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 20 09:56:50.074719 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.074690 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 20 09:56:50.076318 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.076303 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 20 09:56:50.078102 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.076945 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-245.ec2.internal.18c3f6f5220dc9a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-245.ec2.internal,UID:ip-10-0-133-245.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-245.ec2.internal,},FirstTimestamp:2026-07-20 09:56:50.06759773 +0000 UTC m=+0.409271589,LastTimestamp:2026-07-20 09:56:50.06759773 +0000 UTC m=+0.409271589,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-245.ec2.internal,}" Jul 20 09:56:50.083686 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.083667 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 20 09:56:50.083686 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.083675 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 20 09:56:50.083837 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.083796 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.084416 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.084401 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 20 09:56:50.084505 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.084419 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 20 09:56:50.084559 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.084544 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 20 09:56:50.084559 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.084552 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 20 09:56:50.084653 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.084595 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 20 09:56:50.085020 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.085000 2583 factory.go:55] Registering systemd factory Jul 20 09:56:50.085020 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.085022 2583 factory.go:223] Registration of the systemd container factory successfully Jul 20 09:56:50.085302 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.085282 2583 factory.go:153] Registering CRI-O factory Jul 20 09:56:50.085302 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.085300 2583 factory.go:223] Registration of the crio container factory successfully Jul 20 09:56:50.085407 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.085352 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 20 09:56:50.085407 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.085377 2583 factory.go:103] Registering Raw factory Jul 20 09:56:50.085407 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.085395 2583 manager.go:1196] Started watching for new ooms in manager Jul 20 09:56:50.085905 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.085883 2583 manager.go:349] Starting recovery of all containers Jul 20 09:56:50.092580 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.092555 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-245.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 20 09:56:50.092687 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.092596 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 20 09:56:50.095864 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.095848 2583 manager.go:354] Recovery completed Jul 20 09:56:50.097134 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.097053 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vbzpv" Jul 20 09:56:50.099776 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.099764 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:56:50.101687 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.101669 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:56:50.101760 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.101702 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:56:50.101760 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.101716 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:56:50.102273 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.102257 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 20 09:56:50.102273 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.102270 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 20 09:56:50.102353 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.102262 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:56:50.102395 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.102285 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 20 09:56:50.102909 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.102894 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:56:50.102966 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.102925 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:56:50.102966 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.102941 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:56:50.103418 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.103404 2583 policy_none.go:49] "None policy: Start" Jul 20 09:56:50.103478 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.103423 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 20 09:56:50.103478 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.103439 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 20 09:56:50.104220 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.104210 2583 policy_none.go:47] "Start" Jul 20 09:56:50.104827 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.104811 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vbzpv" Jul 20 09:56:50.149889 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.149704 2583 manager.go:337] "Starting Device Plugin manager" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.149914 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.149929 2583 server.go:87] "Starting device plugin registration server" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.150215 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.150228 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.150326 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.150410 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.150419 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.150978 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 20 09:56:50.158832 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.151021 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.213611 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.213577 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 20 09:56:50.214941 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.214922 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 20 09:56:50.215015 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.214974 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 20 09:56:50.215015 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.214999 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 20 09:56:50.215098 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.215040 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 20 09:56:50.217293 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.217273 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:56:50.251373 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.251297 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:56:50.252300 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.252275 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:56:50.252411 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.252308 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:56:50.252411 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.252322 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:56:50.252411 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.252352 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.264639 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.264622 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.264705 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.264645 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-245.ec2.internal\": node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.275308 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.275282 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.315782 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.315754 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal"] Jul 20 09:56:50.315918 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.315833 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:56:50.317326 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.317313 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:56:50.317381 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.317340 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:56:50.317381 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.317350 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:56:50.319614 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.319602 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:56:50.319717 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.319704 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.319762 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.319735 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:56:50.320278 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.320264 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:56:50.320371 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.320284 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:56:50.320371 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.320295 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:56:50.320371 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.320348 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:56:50.320484 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.320375 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:56:50.320484 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.320388 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:56:50.322626 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.322607 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.322719 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.322644 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 20 09:56:50.323274 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.323257 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientMemory" Jul 20 09:56:50.323351 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.323290 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasNoDiskPressure" Jul 20 09:56:50.323351 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.323304 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeHasSufficientPID" Jul 20 09:56:50.337617 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.337598 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-245.ec2.internal\" not found" node="ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.341441 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.341428 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-245.ec2.internal\" not found" node="ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.375532 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.375507 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.386849 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.386828 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb07a9dee20779d907d0b13f8c442c6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal\" (UID: \"fb07a9dee20779d907d0b13f8c442c6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.386920 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.386853 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb07a9dee20779d907d0b13f8c442c6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal\" (UID: \"fb07a9dee20779d907d0b13f8c442c6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.386920 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.386871 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e47ce7bafc72d12721b39c97021dfe2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-245.ec2.internal\" (UID: \"9e47ce7bafc72d12721b39c97021dfe2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.476483 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.476452 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.487866 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.487836 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb07a9dee20779d907d0b13f8c442c6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal\" (UID: \"fb07a9dee20779d907d0b13f8c442c6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.487936 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.487869 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb07a9dee20779d907d0b13f8c442c6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal\" (UID: \"fb07a9dee20779d907d0b13f8c442c6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.487936 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.487887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e47ce7bafc72d12721b39c97021dfe2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-245.ec2.internal\" (UID: \"9e47ce7bafc72d12721b39c97021dfe2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.488002 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.487939 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb07a9dee20779d907d0b13f8c442c6c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal\" (UID: \"fb07a9dee20779d907d0b13f8c442c6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.488002 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.487941 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb07a9dee20779d907d0b13f8c442c6c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal\" (UID: \"fb07a9dee20779d907d0b13f8c442c6c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.488093 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.488011 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e47ce7bafc72d12721b39c97021dfe2-config\") pod \"kube-apiserver-proxy-ip-10-0-133-245.ec2.internal\" (UID: \"9e47ce7bafc72d12721b39c97021dfe2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.577357 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.577293 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.639785 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.639755 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.643369 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:50.643345 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" Jul 20 09:56:50.677814 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.677776 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.778274 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.778239 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.878823 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.878795 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:50.979301 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:50.979267 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:51.012806 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:51.012767 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 20 09:56:51.013254 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:51.012918 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 20 09:56:52.153722 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:52.153694 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-245.ec2.internal\" not found" Jul 20 09:56:52.157623 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.157600 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:56:52.184423 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.184383 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 09:51:51 +0000 UTC" deadline="2028-02-28 03:48:34.622424346 +0000 UTC" Jul 20 09:56:52.184423 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.184416 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14105h51m42.438011761s" Jul 20 09:56:52.225613 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.225540 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:56:52.258588 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.258553 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" Jul 20 09:56:52.269390 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.269371 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 09:56:52.270472 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.270454 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" Jul 20 09:56:52.291636 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.291615 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 20 09:56:52.324763 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.324722 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:56:52.357616 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:52.357585 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb07a9dee20779d907d0b13f8c442c6c.slice/crio-beeb86a38e2433560a9d00de551d04102ca75e3e5d792d6a77c99ed3c2c4e42e WatchSource:0}: Error finding container beeb86a38e2433560a9d00de551d04102ca75e3e5d792d6a77c99ed3c2c4e42e: Status 404 returned error can't find the container with id beeb86a38e2433560a9d00de551d04102ca75e3e5d792d6a77c99ed3c2c4e42e Jul 20 09:56:52.357869 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:52.357850 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e47ce7bafc72d12721b39c97021dfe2.slice/crio-46ff6ecdd04f49648552e00c84ae3700c63290806ec183bb543ddfac064ed721 WatchSource:0}: Error finding container 46ff6ecdd04f49648552e00c84ae3700c63290806ec183bb543ddfac064ed721: Status 404 returned error can't find the container with id 46ff6ecdd04f49648552e00c84ae3700c63290806ec183bb543ddfac064ed721 Jul 20 09:56:52.362217 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:52.362203 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 09:56:53.131204 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.131173 2583 apiserver.go:52] "Watching apiserver" Jul 20 09:56:53.138125 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.138092 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 20 09:56:53.138764 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.138721 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-c49bf","openshift-multus/multus-additional-cni-plugins-pjvd4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal","openshift-multus/multus-qzzkj","openshift-multus/network-metrics-daemon-fsjbf","openshift-network-diagnostics/network-check-target-hpfbq","openshift-network-operator/iptables-alerter-t4jpb","openshift-ovn-kubernetes/ovnkube-node-jfh4h","kube-system/global-pull-secret-syncer-tlh45","kube-system/konnectivity-agent-dr4dk","kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2","openshift-cluster-node-tuning-operator/tuned-s8fh9","openshift-dns/node-resolver-p5hzh"] Jul 20 09:56:53.141769 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.141345 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.144043 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.144026 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.146077 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.146053 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 20 09:56:53.146077 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.146069 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 20 09:56:53.146233 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.146064 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:56:53.146233 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.146201 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xd8hj\"" Jul 20 09:56:53.146359 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.146336 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.147115 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.147090 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 20 09:56:53.147235 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.147213 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 20 09:56:53.147356 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.147341 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ls47k\"" Jul 20 09:56:53.148467 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.148448 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 20 09:56:53.148793 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.148776 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.148890 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.148840 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jc2l2\"" Jul 20 09:56:53.148993 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.148976 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 20 09:56:53.150875 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.150855 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:53.150982 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.150957 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:56:53.152007 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.151989 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-99d92\"" Jul 20 09:56:53.152085 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.152056 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 20 09:56:53.152707 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.152690 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 20 09:56:53.152814 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.152737 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 20 09:56:53.152885 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.152691 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 20 09:56:53.153286 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.153270 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:53.153355 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.153329 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:56:53.155763 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.155664 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.155763 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.155722 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:56:53.158314 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.157803 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 20 09:56:53.158417 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.158383 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.160357 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.160337 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 20 09:56:53.160454 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.160386 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 20 09:56:53.160723 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.160706 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.160820 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.160796 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z7hcn\"" Jul 20 09:56:53.161259 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.161241 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 20 09:56:53.163024 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.163011 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:56:53.163458 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.163440 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 20 09:56:53.164667 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.164651 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 20 09:56:53.165117 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.165064 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6xb22\"" Jul 20 09:56:53.165496 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.165479 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.166063 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.166041 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 20 09:56:53.166154 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.166113 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rzlrp\"" Jul 20 09:56:53.166209 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.166041 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 20 09:56:53.168110 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.168092 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.170835 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.170812 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:53.170950 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.170848 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-systemd\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.170950 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.170872 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a1560cc-d37e-4613-8ee3-4184a0015d7d-tmp\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.170950 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.170895 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21c89f69-fad7-4709-b4b7-346c3d74251e-iptables-alerter-script\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.170950 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.170920 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-kubernetes\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.170950 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.170942 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-sys\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.171183 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.170963 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-lib-modules\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.171183 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.170987 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ff41604-ddf8-4c25-9e42-95ba51b45e42-cni-binary-copy\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.171183 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171023 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-etc-kubernetes\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.171183 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171046 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqdqh\" (UniqueName: \"kubernetes.io/projected/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-kube-api-access-vqdqh\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:53.171183 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171106 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-var-lib-kubelet\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.171183 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171131 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-host\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.171183 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.171183 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171178 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb6v9\" (UniqueName: \"kubernetes.io/projected/676ddd76-0499-4ca3-9b33-9285a97ba3a9-kube-api-access-zb6v9\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171195 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171221 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-cnibin\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysctl-conf\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171282 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-system-cni-dir\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171305 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs4h7\" (UniqueName: \"kubernetes.io/projected/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-kube-api-access-qs4h7\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171366 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-tuned\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-cni-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171428 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171453 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b3bd91d-eb78-4521-b05e-cd5c42193512-host\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171475 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-modprobe-d\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171493 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-conf-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171506 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7g48\" (UniqueName: \"kubernetes.io/projected/2b3bd91d-eb78-4521-b05e-cd5c42193512-kube-api-access-x7g48\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.171545 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171530 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcntx\" (UniqueName: \"kubernetes.io/projected/6a1560cc-d37e-4613-8ee3-4184a0015d7d-kube-api-access-jcntx\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171558 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-multus-certs\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171580 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5979e66-95ad-4e37-b7da-e77682a8d434-kubelet-config\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171609 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171651 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-tmp-dir\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171700 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-daemon-config\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171725 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cnibin\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171805 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-os-release\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171874 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysconfig\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171896 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-system-cni-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-netns\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171954 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-cni-bin\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171977 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysctl-d\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.171999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-k8s-cni-cncf-io\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-kubelet\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172057 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svtwf\" (UniqueName: \"kubernetes.io/projected/4ff41604-ddf8-4c25-9e42-95ba51b45e42-kube-api-access-svtwf\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172093 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21c89f69-fad7-4709-b4b7-346c3d74251e-host-slash\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.172173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172116 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-run\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172139 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-socket-dir-parent\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172239 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-hosts-file\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172295 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-os-release\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172326 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5979e66-95ad-4e37-b7da-e77682a8d434-dbus\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172372 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b3bd91d-eb78-4521-b05e-cd5c42193512-serviceca\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpsds\" (UniqueName: \"kubernetes.io/projected/21c89f69-fad7-4709-b4b7-346c3d74251e-kube-api-access-qpsds\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172432 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-cni-multus\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172490 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-hostroot\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172534 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172616 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.173058 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.172667 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wjjfp\"" Jul 20 09:56:53.173458 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.173111 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 20 09:56:53.173458 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.173246 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 20 09:56:53.173458 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.173381 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 20 09:56:53.173458 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.173451 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 20 09:56:53.173742 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.173721 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 20 09:56:53.177517 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.174409 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 20 09:56:53.177517 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.174593 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h84g7\"" Jul 20 09:56:53.177517 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.175002 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 20 09:56:53.177517 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.175505 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 20 09:56:53.177517 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.175522 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 20 09:56:53.183633 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.183609 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 20 09:56:53.197681 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.197655 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f49pn" Jul 20 09:56:53.207383 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.207039 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f49pn" Jul 20 09:56:53.259999 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.259960 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 20 09:56:53.273127 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273103 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-kubernetes\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.273127 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-sys\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273150 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-lib-modules\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ff41604-ddf8-4c25-9e42-95ba51b45e42-cni-binary-copy\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273196 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-etc-kubernetes\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273221 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdqh\" (UniqueName: \"kubernetes.io/projected/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-kube-api-access-vqdqh\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273222 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-kubernetes\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273239 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-sys\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273246 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-var-lib-kubelet\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273280 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-etc-kubernetes\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273284 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-host\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273294 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-var-lib-kubelet\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273311 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.273329 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273327 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-lib-modules\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273340 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-host\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb6v9\" (UniqueName: \"kubernetes.io/projected/676ddd76-0499-4ca3-9b33-9285a97ba3a9-kube-api-access-zb6v9\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273381 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273473 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c9d723a-d16e-4302-9c79-2eca4774268f-agent-certs\") pod \"konnectivity-agent-dr4dk\" (UID: \"9c9d723a-d16e-4302-9c79-2eca4774268f\") " pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273501 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-env-overrides\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.273480 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273550 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-cnibin\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273577 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-slash\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.273594 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs podName:d86aebe1-4eb3-43fc-a1a4-9e49a8970747 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:53.773571876 +0000 UTC m=+3.041561683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs") pod "network-metrics-daemon-fsjbf" (UID: "d86aebe1-4eb3-43fc-a1a4-9e49a8970747") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273646 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-ovnkube-script-lib\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273650 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-cnibin\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273675 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysctl-conf\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273703 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-system-cni-dir\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273728 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs4h7\" (UniqueName: \"kubernetes.io/projected/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-kube-api-access-qs4h7\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273775 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-tuned\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273790 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-system-cni-dir\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.274047 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273799 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-cni-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273812 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysctl-conf\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273840 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273866 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-kubelet\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-node-log\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b3bd91d-eb78-4521-b05e-cd5c42193512-host\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f62rv\" (UniqueName: \"kubernetes.io/projected/b93e7a01-9261-47d4-af6e-33db84fa3f39-kube-api-access-f62rv\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273958 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-modprobe-d\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273985 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-conf-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274028 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.273840 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ff41604-ddf8-4c25-9e42-95ba51b45e42-cni-binary-copy\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274052 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7g48\" (UniqueName: \"kubernetes.io/projected/2b3bd91d-eb78-4521-b05e-cd5c42193512-kube-api-access-x7g48\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274114 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274102 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcntx\" (UniqueName: \"kubernetes.io/projected/6a1560cc-d37e-4613-8ee3-4184a0015d7d-kube-api-access-jcntx\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274152 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-modprobe-d\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274156 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-multus-certs\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274152 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 20 09:56:53.274860 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274180 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-conf-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274187 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5979e66-95ad-4e37-b7da-e77682a8d434-kubelet-config\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274210 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b3bd91d-eb78-4521-b05e-cd5c42193512-host\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274225 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5979e66-95ad-4e37-b7da-e77682a8d434-kubelet-config\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274227 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274262 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-tmp-dir\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274286 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-systemd-units\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274308 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274333 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-daemon-config\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274360 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cni-binary-copy\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274356 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cnibin\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274029 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-cni-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274400 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-os-release\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-sys-fs\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274459 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-os-release\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274471 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysconfig\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-system-cni-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.275577 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274506 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-netns\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274520 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-cni-bin\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274535 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274549 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274550 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-tmp-dir\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274583 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-cni-bin\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274590 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274605 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysctl-d\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274595 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/676ddd76-0499-4ca3-9b33-9285a97ba3a9-cnibin\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274620 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-system-cni-dir\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274621 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-k8s-cni-cncf-io\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274641 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-netns\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274645 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-k8s-cni-cncf-io\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274686 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-cni-bin\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274693 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-run-multus-certs\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274701 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-kubelet\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274706 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysconfig\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.276432 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274742 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svtwf\" (UniqueName: \"kubernetes.io/projected/4ff41604-ddf8-4c25-9e42-95ba51b45e42-kube-api-access-svtwf\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274787 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-cni-netd\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274777 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-kubelet\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274813 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-ovnkube-config\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274815 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-sysctl-d\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274838 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa274a27-90e6-409c-bba8-89fc85955020-ovn-node-metrics-cert\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274863 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21c89f69-fad7-4709-b4b7-346c3d74251e-host-slash\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274887 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-run\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-socket-dir-parent\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274911 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-daemon-config\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274920 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/21c89f69-fad7-4709-b4b7-346c3d74251e-host-slash\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274935 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-hosts-file\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274944 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-run\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274961 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-etc-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274980 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-hosts-file\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274986 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-ovn\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.274984 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-multus-socket-dir-parent\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275014 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-log-socket\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.277227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275043 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-os-release\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275064 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5979e66-95ad-4e37-b7da-e77682a8d434-dbus\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275087 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-socket-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275102 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-os-release\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275109 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-registration-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275135 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-device-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275151 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5979e66-95ad-4e37-b7da-e77682a8d434-dbus\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275164 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b3bd91d-eb78-4521-b05e-cd5c42193512-serviceca\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpsds\" (UniqueName: \"kubernetes.io/projected/21c89f69-fad7-4709-b4b7-346c3d74251e-kube-api-access-qpsds\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275215 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-cni-multus\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275237 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-hostroot\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275262 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275302 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-host-var-lib-cni-multus\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275304 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4ff41604-ddf8-4c25-9e42-95ba51b45e42-hostroot\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.275339 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275389 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c9d723a-d16e-4302-9c79-2eca4774268f-konnectivity-ca\") pod \"konnectivity-agent-dr4dk\" (UID: \"9c9d723a-d16e-4302-9c79-2eca4774268f\") " pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:56:53.278126 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.275456 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret podName:d5979e66-95ad-4e37-b7da-e77682a8d434 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:53.775430803 +0000 UTC m=+3.043420611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret") pod "global-pull-secret-syncer-tlh45" (UID: "d5979e66-95ad-4e37-b7da-e77682a8d434") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275490 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-systemd\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275522 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a1560cc-d37e-4613-8ee3-4184a0015d7d-tmp\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275549 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-run-netns\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275557 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2b3bd91d-eb78-4521-b05e-cd5c42193512-serviceca\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275575 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-var-lib-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275672 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-systemd\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275694 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5882z\" (UniqueName: \"kubernetes.io/projected/aa274a27-90e6-409c-bba8-89fc85955020-kube-api-access-5882z\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21c89f69-fad7-4709-b4b7-346c3d74251e-iptables-alerter-script\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275860 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-systemd\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.275885 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/676ddd76-0499-4ca3-9b33-9285a97ba3a9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.276378 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/21c89f69-fad7-4709-b4b7-346c3d74251e-iptables-alerter-script\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.278152 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a1560cc-d37e-4613-8ee3-4184a0015d7d-etc-tuned\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.278939 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.278229 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a1560cc-d37e-4613-8ee3-4184a0015d7d-tmp\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.293885 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.293784 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" event={"ID":"9e47ce7bafc72d12721b39c97021dfe2","Type":"ContainerStarted","Data":"46ff6ecdd04f49648552e00c84ae3700c63290806ec183bb543ddfac064ed721"} Jul 20 09:56:53.295052 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.295026 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" event={"ID":"fb07a9dee20779d907d0b13f8c442c6c","Type":"ContainerStarted","Data":"beeb86a38e2433560a9d00de551d04102ca75e3e5d792d6a77c99ed3c2c4e42e"} Jul 20 09:56:53.296271 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.296245 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqdqh\" (UniqueName: \"kubernetes.io/projected/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-kube-api-access-vqdqh\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:53.297591 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.297572 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs4h7\" (UniqueName: \"kubernetes.io/projected/f582d91e-5b7e-4f8f-b849-5f3929c3c4be-kube-api-access-qs4h7\") pod \"node-resolver-p5hzh\" (UID: \"f582d91e-5b7e-4f8f-b849-5f3929c3c4be\") " pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.298140 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.298118 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb6v9\" (UniqueName: \"kubernetes.io/projected/676ddd76-0499-4ca3-9b33-9285a97ba3a9-kube-api-access-zb6v9\") pod \"multus-additional-cni-plugins-pjvd4\" (UID: \"676ddd76-0499-4ca3-9b33-9285a97ba3a9\") " pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.313831 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.313363 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcntx\" (UniqueName: \"kubernetes.io/projected/6a1560cc-d37e-4613-8ee3-4184a0015d7d-kube-api-access-jcntx\") pod \"tuned-s8fh9\" (UID: \"6a1560cc-d37e-4613-8ee3-4184a0015d7d\") " pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.314211 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.314187 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svtwf\" (UniqueName: \"kubernetes.io/projected/4ff41604-ddf8-4c25-9e42-95ba51b45e42-kube-api-access-svtwf\") pod \"multus-qzzkj\" (UID: \"4ff41604-ddf8-4c25-9e42-95ba51b45e42\") " pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.314454 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.314437 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:56:53.314521 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.314460 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:56:53.314521 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.314474 2583 projected.go:196] Error preparing data for projected volume kube-api-access-r47xh for pod openshift-network-diagnostics/network-check-target-hpfbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:56:53.314622 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.314549 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh podName:dd00f0c0-3934-4bf0-b87a-62b6d3821cb2 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:53.814530061 +0000 UTC m=+3.082519867 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r47xh" (UniqueName: "kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh") pod "network-check-target-hpfbq" (UID: "dd00f0c0-3934-4bf0-b87a-62b6d3821cb2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:56:53.316109 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.316081 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7g48\" (UniqueName: \"kubernetes.io/projected/2b3bd91d-eb78-4521-b05e-cd5c42193512-kube-api-access-x7g48\") pod \"node-ca-c49bf\" (UID: \"2b3bd91d-eb78-4521-b05e-cd5c42193512\") " pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.319660 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.319613 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpsds\" (UniqueName: \"kubernetes.io/projected/21c89f69-fad7-4709-b4b7-346c3d74251e-kube-api-access-qpsds\") pod \"iptables-alerter-t4jpb\" (UID: \"21c89f69-fad7-4709-b4b7-346c3d74251e\") " pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.376318 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376282 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-systemd-units\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376486 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376329 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.376486 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376353 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-sys-fs\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.376486 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376375 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376486 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376424 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376486 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376446 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-cni-bin\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376486 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-cni-netd\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376770 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-ovnkube-config\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376770 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376514 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa274a27-90e6-409c-bba8-89fc85955020-ovn-node-metrics-cert\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376770 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376541 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-etc-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376770 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376561 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-ovn\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.376770 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376585 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-log-socket\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377003 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376741 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-socket-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.377003 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-registration-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.377003 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.376987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-device-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.377232 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377188 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c9d723a-d16e-4302-9c79-2eca4774268f-konnectivity-ca\") pod \"konnectivity-agent-dr4dk\" (UID: \"9c9d723a-d16e-4302-9c79-2eca4774268f\") " pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:56:53.377353 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377267 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-run-netns\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377353 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377267 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-etc-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377353 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377299 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-var-lib-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377353 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377333 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377369 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5882z\" (UniqueName: \"kubernetes.io/projected/aa274a27-90e6-409c-bba8-89fc85955020-kube-api-access-5882z\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377417 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-systemd\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377462 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377501 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c9d723a-d16e-4302-9c79-2eca4774268f-agent-certs\") pod \"konnectivity-agent-dr4dk\" (UID: \"9c9d723a-d16e-4302-9c79-2eca4774268f\") " pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:56:53.377536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377514 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-log-socket\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377526 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-env-overrides\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377847 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377559 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-slash\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377847 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377571 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-cni-netd\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377847 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377692 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-slash\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377847 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377788 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-run-netns\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377847 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377333 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-ovn\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.377847 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377421 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.378097 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.377939 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-run-systemd\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378097 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378033 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-registration-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.378188 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378107 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-device-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.378233 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378171 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-cni-bin\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378285 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378244 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-sys-fs\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.378285 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378265 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-env-overrides\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378376 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378288 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-systemd-units\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378425 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378409 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-ovnkube-script-lib\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378473 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378444 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378473 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378418 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-var-lib-openvswitch\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378473 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378463 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-kubelet\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378670 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378519 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-kubelet\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.378670 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378579 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-socket-dir\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.378992 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.378968 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-ovnkube-script-lib\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.379082 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.379041 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-host-run-ovn-kubernetes\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.379137 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.379098 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-node-log\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.379184 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.379138 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f62rv\" (UniqueName: \"kubernetes.io/projected/b93e7a01-9261-47d4-af6e-33db84fa3f39-kube-api-access-f62rv\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.379184 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.379175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.379278 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.379245 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa274a27-90e6-409c-bba8-89fc85955020-ovnkube-config\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.379278 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.379249 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9c9d723a-d16e-4302-9c79-2eca4774268f-konnectivity-ca\") pod \"konnectivity-agent-dr4dk\" (UID: \"9c9d723a-d16e-4302-9c79-2eca4774268f\") " pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:56:53.379359 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.379290 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa274a27-90e6-409c-bba8-89fc85955020-node-log\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.379359 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.379317 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b93e7a01-9261-47d4-af6e-33db84fa3f39-etc-selinux\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.381391 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.380670 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa274a27-90e6-409c-bba8-89fc85955020-ovn-node-metrics-cert\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.381391 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.380806 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9c9d723a-d16e-4302-9c79-2eca4774268f-agent-certs\") pod \"konnectivity-agent-dr4dk\" (UID: \"9c9d723a-d16e-4302-9c79-2eca4774268f\") " pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:56:53.388864 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.388742 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5882z\" (UniqueName: \"kubernetes.io/projected/aa274a27-90e6-409c-bba8-89fc85955020-kube-api-access-5882z\") pod \"ovnkube-node-jfh4h\" (UID: \"aa274a27-90e6-409c-bba8-89fc85955020\") " pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.392847 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.392823 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f62rv\" (UniqueName: \"kubernetes.io/projected/b93e7a01-9261-47d4-af6e-33db84fa3f39-kube-api-access-f62rv\") pod \"aws-ebs-csi-driver-node-7rbs2\" (UID: \"b93e7a01-9261-47d4-af6e-33db84fa3f39\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.454350 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.454315 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-t4jpb" Jul 20 09:56:53.461307 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.461269 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" Jul 20 09:56:53.469864 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.469834 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p5hzh" Jul 20 09:56:53.477221 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.477197 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qzzkj" Jul 20 09:56:53.483905 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.483807 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-c49bf" Jul 20 09:56:53.491400 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.491371 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" Jul 20 09:56:53.499970 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.499948 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:56:53.507489 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.507468 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:56:53.514068 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.514050 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" Jul 20 09:56:53.619296 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.619268 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 20 09:56:53.781201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.781165 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:53.781371 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.781221 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:53.781371 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.781315 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:56:53.781371 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.781326 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:56:53.781503 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.781389 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret podName:d5979e66-95ad-4e37-b7da-e77682a8d434 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:54.781366811 +0000 UTC m=+4.049356622 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret") pod "global-pull-secret-syncer-tlh45" (UID: "d5979e66-95ad-4e37-b7da-e77682a8d434") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:56:53.781503 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.781410 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs podName:d86aebe1-4eb3-43fc-a1a4-9e49a8970747 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:54.78139985 +0000 UTC m=+4.049389658 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs") pod "network-metrics-daemon-fsjbf" (UID: "d86aebe1-4eb3-43fc-a1a4-9e49a8970747") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:56:53.882089 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:53.882057 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:53.882243 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.882204 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:56:53.882243 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.882219 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:56:53.882243 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.882229 2583 projected.go:196] Error preparing data for projected volume kube-api-access-r47xh for pod openshift-network-diagnostics/network-check-target-hpfbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:56:53.882390 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:53.882281 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh podName:dd00f0c0-3934-4bf0-b87a-62b6d3821cb2 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:54.882263244 +0000 UTC m=+4.150253050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r47xh" (UniqueName: "kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh") pod "network-check-target-hpfbq" (UID: "dd00f0c0-3934-4bf0-b87a-62b6d3821cb2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:56:54.210424 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:54.210376 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:51:53 +0000 UTC" deadline="2028-02-11 01:18:02.321375604 +0000 UTC" Jul 20 09:56:54.210424 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:54.210417 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13695h21m8.110963346s" Jul 20 09:56:54.289922 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:54.289888 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:54.290063 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.289982 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:56:54.290127 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:54.290076 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:54.290200 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.290180 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:56:54.351621 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.351589 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676ddd76_0499_4ca3_9b33_9285a97ba3a9.slice/crio-0ce79ad9b4191409ae39dd25f4176919be3026ca424f6b1a5957c6919ebddf26 WatchSource:0}: Error finding container 0ce79ad9b4191409ae39dd25f4176919be3026ca424f6b1a5957c6919ebddf26: Status 404 returned error can't find the container with id 0ce79ad9b4191409ae39dd25f4176919be3026ca424f6b1a5957c6919ebddf26 Jul 20 09:56:54.352910 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.352875 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf582d91e_5b7e_4f8f_b849_5f3929c3c4be.slice/crio-2d5bf31f5782ddb26c9ad13c6b6b706252ec3cf9bc8a74064e81233a27c49961 WatchSource:0}: Error finding container 2d5bf31f5782ddb26c9ad13c6b6b706252ec3cf9bc8a74064e81233a27c49961: Status 404 returned error can't find the container with id 2d5bf31f5782ddb26c9ad13c6b6b706252ec3cf9bc8a74064e81233a27c49961 Jul 20 09:56:54.355449 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.355428 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff41604_ddf8_4c25_9e42_95ba51b45e42.slice/crio-b84923991afabab628f65d3fa6e1f0d02be8aac71179c4fd16b155a72bf814f5 WatchSource:0}: Error finding container b84923991afabab628f65d3fa6e1f0d02be8aac71179c4fd16b155a72bf814f5: Status 404 returned error can't find the container with id b84923991afabab628f65d3fa6e1f0d02be8aac71179c4fd16b155a72bf814f5 Jul 20 09:56:54.358295 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.358228 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb93e7a01_9261_47d4_af6e_33db84fa3f39.slice/crio-2588744534d3e4eb3268dbcd835e4b7ea023f8360937cc3fa3e6ed03852e2a9e WatchSource:0}: Error finding container 2588744534d3e4eb3268dbcd835e4b7ea023f8360937cc3fa3e6ed03852e2a9e: Status 404 returned error can't find the container with id 2588744534d3e4eb3268dbcd835e4b7ea023f8360937cc3fa3e6ed03852e2a9e Jul 20 09:56:54.358843 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.358809 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21c89f69_fad7_4709_b4b7_346c3d74251e.slice/crio-a798df9b39681f5253aab8ddbc06d01da0d2d123f8837986e07b24246f3410ec WatchSource:0}: Error finding container a798df9b39681f5253aab8ddbc06d01da0d2d123f8837986e07b24246f3410ec: Status 404 returned error can't find the container with id a798df9b39681f5253aab8ddbc06d01da0d2d123f8837986e07b24246f3410ec Jul 20 09:56:54.359529 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.359387 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa274a27_90e6_409c_bba8_89fc85955020.slice/crio-f0349ba2f35a6a3e5c7d8e140da14944ace580ed0706eb9925773c71ff174c52 WatchSource:0}: Error finding container f0349ba2f35a6a3e5c7d8e140da14944ace580ed0706eb9925773c71ff174c52: Status 404 returned error can't find the container with id f0349ba2f35a6a3e5c7d8e140da14944ace580ed0706eb9925773c71ff174c52 Jul 20 09:56:54.361254 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.360831 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3bd91d_eb78_4521_b05e_cd5c42193512.slice/crio-b2353d14f47b4aedeb7e5e07749282bb06a1658afe019bbbb93463f51af1f284 WatchSource:0}: Error finding container b2353d14f47b4aedeb7e5e07749282bb06a1658afe019bbbb93463f51af1f284: Status 404 returned error can't find the container with id b2353d14f47b4aedeb7e5e07749282bb06a1658afe019bbbb93463f51af1f284 Jul 20 09:56:54.361570 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.361254 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a1560cc_d37e_4613_8ee3_4184a0015d7d.slice/crio-8025f2c3fce7e0e909e1efaf74e6b7f8c923f99f6d1e6a1d053f3ce18384fdf6 WatchSource:0}: Error finding container 8025f2c3fce7e0e909e1efaf74e6b7f8c923f99f6d1e6a1d053f3ce18384fdf6: Status 404 returned error can't find the container with id 8025f2c3fce7e0e909e1efaf74e6b7f8c923f99f6d1e6a1d053f3ce18384fdf6 Jul 20 09:56:54.364967 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:56:54.364942 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9d723a_d16e_4302_9c79_2eca4774268f.slice/crio-079cd1a0fe09ced2453a9f83082f8b211d43533e98781316557a73604892465b WatchSource:0}: Error finding container 079cd1a0fe09ced2453a9f83082f8b211d43533e98781316557a73604892465b: Status 404 returned error can't find the container with id 079cd1a0fe09ced2453a9f83082f8b211d43533e98781316557a73604892465b Jul 20 09:56:54.787132 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:54.786917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:54.787310 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.787058 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:56:54.787310 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.787242 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs podName:d86aebe1-4eb3-43fc-a1a4-9e49a8970747 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:56.787225228 +0000 UTC m=+6.055215035 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs") pod "network-metrics-daemon-fsjbf" (UID: "d86aebe1-4eb3-43fc-a1a4-9e49a8970747") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:56:54.787310 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.787246 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:56:54.787310 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:54.787175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:54.787310 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.787293 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret podName:d5979e66-95ad-4e37-b7da-e77682a8d434 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:56.787278251 +0000 UTC m=+6.055268057 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret") pod "global-pull-secret-syncer-tlh45" (UID: "d5979e66-95ad-4e37-b7da-e77682a8d434") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:56:54.888499 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:54.888413 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:54.888672 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.888605 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:56:54.888672 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.888628 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:56:54.888672 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.888640 2583 projected.go:196] Error preparing data for projected volume kube-api-access-r47xh for pod openshift-network-diagnostics/network-check-target-hpfbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:56:54.888848 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:54.888712 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh podName:dd00f0c0-3934-4bf0-b87a-62b6d3821cb2 nodeName:}" failed. No retries permitted until 2026-07-20 09:56:56.888693971 +0000 UTC m=+6.156683791 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r47xh" (UniqueName: "kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh") pod "network-check-target-hpfbq" (UID: "dd00f0c0-3934-4bf0-b87a-62b6d3821cb2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:56:55.210769 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.210677 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 09:51:53 +0000 UTC" deadline="2028-03-10 20:00:42.084508488 +0000 UTC" Jul 20 09:56:55.210769 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.210722 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14386h3m46.873791256s" Jul 20 09:56:55.294923 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.294891 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:55.295136 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:55.295106 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:56:55.314376 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.313692 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" event={"ID":"9e47ce7bafc72d12721b39c97021dfe2","Type":"ContainerStarted","Data":"ce4df4880b349d1a0c5a4ce05704d224a6574a3713e64eff497391326ec7f527"} Jul 20 09:56:55.323778 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.323522 2583 generic.go:356] "Generic (PLEG): container finished" podID="fb07a9dee20779d907d0b13f8c442c6c" containerID="c3599bd1fc85d806fd7eff2a2e8e35ef9312d1abe7fe88cecaafbaed4e96a4df" exitCode=0 Jul 20 09:56:55.323950 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.323799 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" event={"ID":"fb07a9dee20779d907d0b13f8c442c6c","Type":"ContainerDied","Data":"c3599bd1fc85d806fd7eff2a2e8e35ef9312d1abe7fe88cecaafbaed4e96a4df"} Jul 20 09:56:55.344936 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.344878 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-245.ec2.internal" podStartSLOduration=3.344858933 podStartE2EDuration="3.344858933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:56:55.33039672 +0000 UTC m=+4.598386547" watchObservedRunningTime="2026-07-20 09:56:55.344858933 +0000 UTC m=+4.612848759" Jul 20 09:56:55.347321 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.347290 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" event={"ID":"6a1560cc-d37e-4613-8ee3-4184a0015d7d","Type":"ContainerStarted","Data":"8025f2c3fce7e0e909e1efaf74e6b7f8c923f99f6d1e6a1d053f3ce18384fdf6"} Jul 20 09:56:55.358842 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.358411 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c49bf" event={"ID":"2b3bd91d-eb78-4521-b05e-cd5c42193512","Type":"ContainerStarted","Data":"b2353d14f47b4aedeb7e5e07749282bb06a1658afe019bbbb93463f51af1f284"} Jul 20 09:56:55.367692 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.367663 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"f0349ba2f35a6a3e5c7d8e140da14944ace580ed0706eb9925773c71ff174c52"} Jul 20 09:56:55.383673 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.383634 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" event={"ID":"b93e7a01-9261-47d4-af6e-33db84fa3f39","Type":"ContainerStarted","Data":"2588744534d3e4eb3268dbcd835e4b7ea023f8360937cc3fa3e6ed03852e2a9e"} Jul 20 09:56:55.403619 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.403546 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzzkj" event={"ID":"4ff41604-ddf8-4c25-9e42-95ba51b45e42","Type":"ContainerStarted","Data":"b84923991afabab628f65d3fa6e1f0d02be8aac71179c4fd16b155a72bf814f5"} Jul 20 09:56:55.406768 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.406726 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dr4dk" event={"ID":"9c9d723a-d16e-4302-9c79-2eca4774268f","Type":"ContainerStarted","Data":"079cd1a0fe09ced2453a9f83082f8b211d43533e98781316557a73604892465b"} Jul 20 09:56:55.420531 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.420498 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t4jpb" event={"ID":"21c89f69-fad7-4709-b4b7-346c3d74251e","Type":"ContainerStarted","Data":"a798df9b39681f5253aab8ddbc06d01da0d2d123f8837986e07b24246f3410ec"} Jul 20 09:56:55.444541 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.444498 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p5hzh" event={"ID":"f582d91e-5b7e-4f8f-b849-5f3929c3c4be","Type":"ContainerStarted","Data":"2d5bf31f5782ddb26c9ad13c6b6b706252ec3cf9bc8a74064e81233a27c49961"} Jul 20 09:56:55.454367 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:55.454331 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" event={"ID":"676ddd76-0499-4ca3-9b33-9285a97ba3a9","Type":"ContainerStarted","Data":"0ce79ad9b4191409ae39dd25f4176919be3026ca424f6b1a5957c6919ebddf26"} Jul 20 09:56:56.289781 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:56.289737 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:56.290222 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.289881 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:56:56.290300 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:56.290277 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:56.290391 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.290367 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:56:56.479365 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:56.479331 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" event={"ID":"fb07a9dee20779d907d0b13f8c442c6c","Type":"ContainerStarted","Data":"17eba45e036f9aa5e079c649bb5dabb5f715033431c3a1aea170896cac1b155a"} Jul 20 09:56:56.813454 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:56.812991 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:56.813454 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:56.813068 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:56.813454 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.813120 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:56:56.813454 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.813159 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:56:56.813454 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.813186 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs podName:d86aebe1-4eb3-43fc-a1a4-9e49a8970747 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:00.813168301 +0000 UTC m=+10.081158125 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs") pod "network-metrics-daemon-fsjbf" (UID: "d86aebe1-4eb3-43fc-a1a4-9e49a8970747") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:56:56.813454 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.813203 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret podName:d5979e66-95ad-4e37-b7da-e77682a8d434 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:00.813193783 +0000 UTC m=+10.081183591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret") pod "global-pull-secret-syncer-tlh45" (UID: "d5979e66-95ad-4e37-b7da-e77682a8d434") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:56:56.915056 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:56.914284 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:56.915056 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.914551 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:56:56.915056 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.914573 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:56:56.915056 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.914586 2583 projected.go:196] Error preparing data for projected volume kube-api-access-r47xh for pod openshift-network-diagnostics/network-check-target-hpfbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:56:56.915056 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:56.914641 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh podName:dd00f0c0-3934-4bf0-b87a-62b6d3821cb2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:00.914624436 +0000 UTC m=+10.182614264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r47xh" (UniqueName: "kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh") pod "network-check-target-hpfbq" (UID: "dd00f0c0-3934-4bf0-b87a-62b6d3821cb2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:56:57.289905 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:57.289873 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:57.290359 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:57.290021 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:56:58.290675 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:58.290637 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:56:58.291156 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:58.290742 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:56:58.291156 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:58.291119 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:56:58.291267 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:58.291212 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:56:59.290697 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:56:59.290666 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:56:59.291098 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:56:59.290816 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:00.289891 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:00.289240 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:00.289891 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.289358 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:00.289891 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:00.289766 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:00.289891 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.289860 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:00.846837 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:00.846796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:00.847214 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:00.846875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:00.847214 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.847007 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:00.847214 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.847078 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs podName:d86aebe1-4eb3-43fc-a1a4-9e49a8970747 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:08.847061431 +0000 UTC m=+18.115051238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs") pod "network-metrics-daemon-fsjbf" (UID: "d86aebe1-4eb3-43fc-a1a4-9e49a8970747") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:00.847440 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.847421 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:00.847564 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.847462 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret podName:d5979e66-95ad-4e37-b7da-e77682a8d434 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:08.847451958 +0000 UTC m=+18.115441762 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret") pod "global-pull-secret-syncer-tlh45" (UID: "d5979e66-95ad-4e37-b7da-e77682a8d434") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:00.948208 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:00.948175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:00.948366 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.948298 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:00.948366 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.948316 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:00.948366 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.948328 2583 projected.go:196] Error preparing data for projected volume kube-api-access-r47xh for pod openshift-network-diagnostics/network-check-target-hpfbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:00.948527 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:00.948373 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh podName:dd00f0c0-3934-4bf0-b87a-62b6d3821cb2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:08.94836085 +0000 UTC m=+18.216350654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r47xh" (UniqueName: "kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh") pod "network-check-target-hpfbq" (UID: "dd00f0c0-3934-4bf0-b87a-62b6d3821cb2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:01.290473 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:01.290437 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:01.290647 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:01.290587 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:02.289819 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:02.289779 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:02.290292 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:02.289925 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:02.290292 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:02.290017 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:02.290292 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:02.289921 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:03.291558 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:03.291507 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:03.292086 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:03.291665 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:04.289267 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:04.289230 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:04.289453 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:04.289230 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:04.289453 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:04.289352 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:04.289453 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:04.289404 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:05.289281 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:05.289239 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:05.289874 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:05.289356 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:06.289065 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:06.289027 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:06.289248 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:06.289037 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:06.289248 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:06.289143 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:06.289248 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:06.289225 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:07.289401 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:07.289366 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:07.289887 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:07.289545 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:08.289487 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:08.288991 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:08.289487 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:08.289036 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:08.289487 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:08.289111 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:08.289487 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:08.289247 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:08.909354 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:08.909316 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:08.909550 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:08.909378 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:08.909550 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:08.909486 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:08.909550 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:08.909547 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret podName:d5979e66-95ad-4e37-b7da-e77682a8d434 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.909531871 +0000 UTC m=+34.177521678 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret") pod "global-pull-secret-syncer-tlh45" (UID: "d5979e66-95ad-4e37-b7da-e77682a8d434") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:08.909724 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:08.909490 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:08.909724 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:08.909616 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs podName:d86aebe1-4eb3-43fc-a1a4-9e49a8970747 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:24.909602595 +0000 UTC m=+34.177592399 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs") pod "network-metrics-daemon-fsjbf" (UID: "d86aebe1-4eb3-43fc-a1a4-9e49a8970747") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:09.010662 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:09.010620 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:09.011245 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:09.010844 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:09.011245 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:09.010874 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:09.011245 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:09.010889 2583 projected.go:196] Error preparing data for projected volume kube-api-access-r47xh for pod openshift-network-diagnostics/network-check-target-hpfbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:09.011245 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:09.010945 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh podName:dd00f0c0-3934-4bf0-b87a-62b6d3821cb2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:25.01093046 +0000 UTC m=+34.278920263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r47xh" (UniqueName: "kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh") pod "network-check-target-hpfbq" (UID: "dd00f0c0-3934-4bf0-b87a-62b6d3821cb2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:09.288976 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:09.288939 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:09.289155 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:09.289057 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:10.289351 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:10.289316 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:10.289351 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:10.289340 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:10.289910 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:10.289433 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:10.289910 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:10.289559 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:11.289786 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:11.289667 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:11.290263 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:11.290222 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:12.289072 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:12.289032 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:12.289264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:12.289086 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:12.289264 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:12.289171 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:12.289380 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:12.289295 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:13.289718 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:13.289679 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:13.290287 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:13.289861 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:14.289454 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.289148 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:14.289624 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.289167 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:14.289624 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:14.289550 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:14.289624 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:14.289592 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:14.518461 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.518426 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" event={"ID":"6a1560cc-d37e-4613-8ee3-4184a0015d7d","Type":"ContainerStarted","Data":"74736e8c09d598180b8c94958187fc815d38aa248dbe93c968be58053d261ae2"} Jul 20 09:57:14.519803 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.519782 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-c49bf" event={"ID":"2b3bd91d-eb78-4521-b05e-cd5c42193512","Type":"ContainerStarted","Data":"7e73e14bbe574fab439a4ec040795d5ba2369f48f99d4459215a8c94ffd89475"} Jul 20 09:57:14.522279 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.522250 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"c054f7ceb98a2bc4d44585aa3c8e584c3042cf9076ca2a0e46da154d085b86cd"} Jul 20 09:57:14.522384 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.522324 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"cd333d5105e084af37c26a86ea363176c2d9a9402a3187098c5b7ebd90b7aea6"} Jul 20 09:57:14.522384 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.522376 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"c67b108b360b1b0d9f0b11c696667e5d796283052ba2b91f9d4a08c1fd6dc9b6"} Jul 20 09:57:14.522497 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.522425 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"aa6b015d3fd8c257ef13ccc98da16702485782900eee54e00e688dcd816058d5"} Jul 20 09:57:14.522497 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.522473 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"8f51514f75aaad3162cd40fe1d17d24d8a05e3a4ef983b7d1cd38659c566a4db"} Jul 20 09:57:14.522590 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.522523 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"ea326fd18620d8c8a7ca49591a3c32192f058ce4774141b1ad318e7f93d18867"} Jul 20 09:57:14.523535 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.523516 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" event={"ID":"b93e7a01-9261-47d4-af6e-33db84fa3f39","Type":"ContainerStarted","Data":"09af25862873b3888e7eff103d92d424cc667bc713aacd4ef2a96ee5b3484c3b"} Jul 20 09:57:14.524875 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.524858 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qzzkj" event={"ID":"4ff41604-ddf8-4c25-9e42-95ba51b45e42","Type":"ContainerStarted","Data":"29f832b9e71ad4c07f3569f362f2d0ae7a3179c54d5a1140ffa9d662415ec15e"} Jul 20 09:57:14.526092 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.526071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dr4dk" event={"ID":"9c9d723a-d16e-4302-9c79-2eca4774268f","Type":"ContainerStarted","Data":"b9f44ba952162e14bb74abbd3ffdc49e6fc83f8c795d4739c75dc2f7bea95f11"} Jul 20 09:57:14.527305 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.527278 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p5hzh" event={"ID":"f582d91e-5b7e-4f8f-b849-5f3929c3c4be","Type":"ContainerStarted","Data":"2702fae762aed5027e4d731299661ba15677c64e8effe2171def580e83d18304"} Jul 20 09:57:14.528480 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.528459 2583 generic.go:356] "Generic (PLEG): container finished" podID="676ddd76-0499-4ca3-9b33-9285a97ba3a9" containerID="52270d03faeb9bb4f7cc512815ecb1b1c93e83b48c14d18bf378751d75edf007" exitCode=0 Jul 20 09:57:14.528569 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.528489 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" event={"ID":"676ddd76-0499-4ca3-9b33-9285a97ba3a9","Type":"ContainerDied","Data":"52270d03faeb9bb4f7cc512815ecb1b1c93e83b48c14d18bf378751d75edf007"} Jul 20 09:57:14.536172 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.536135 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-245.ec2.internal" podStartSLOduration=22.536122687 podStartE2EDuration="22.536122687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:56:56.497258585 +0000 UTC m=+5.765248407" watchObservedRunningTime="2026-07-20 09:57:14.536122687 +0000 UTC m=+23.804112513" Jul 20 09:57:14.554802 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.554733 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s8fh9" podStartSLOduration=4.405594207 podStartE2EDuration="23.554715652s" totalImagesPullingTime="19.149121445s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:14.536022611 +0000 UTC m=+23.804012437" watchObservedRunningTime="2026-07-20 09:57:14.554715652 +0000 UTC m=+23.822705484" Jul 20 09:57:14.555077 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.555050 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qzzkj" podStartSLOduration=4.357425457 podStartE2EDuration="23.555042051s" totalImagesPullingTime="19.197616594s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:14.554501424 +0000 UTC m=+23.822491250" watchObservedRunningTime="2026-07-20 09:57:14.555042051 +0000 UTC m=+23.823031877" Jul 20 09:57:14.573420 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.573369 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-c49bf" podStartSLOduration=8.818123418 podStartE2EDuration="23.573353195s" totalImagesPullingTime="14.755229777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:14.572809257 +0000 UTC m=+23.840799083" watchObservedRunningTime="2026-07-20 09:57:14.573353195 +0000 UTC m=+23.841343021" Jul 20 09:57:14.632235 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.632184 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dr4dk" podStartSLOduration=4.515867937 podStartE2EDuration="23.632170513s" totalImagesPullingTime="19.116302576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:14.613323939 +0000 UTC m=+23.881313766" watchObservedRunningTime="2026-07-20 09:57:14.632170513 +0000 UTC m=+23.900160340" Jul 20 09:57:14.632429 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.632406 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p5hzh" podStartSLOduration=4.506424302 podStartE2EDuration="23.632400014s" totalImagesPullingTime="19.125975712s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:14.632003387 +0000 UTC m=+23.899993213" watchObservedRunningTime="2026-07-20 09:57:14.632400014 +0000 UTC m=+23.900389839" Jul 20 09:57:14.945075 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:14.945047 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 20 09:57:15.237056 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:15.236938 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T09:57:14.945067344Z","UUID":"373608db-02a2-41f4-b0a3-29ce17b5fba4","Handler":null,"Name":"","Endpoint":""} Jul 20 09:57:15.238685 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:15.238665 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 20 09:57:15.238841 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:15.238705 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 20 09:57:15.289518 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:15.289480 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:15.289693 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:15.289633 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:15.533742 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:15.533331 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-t4jpb" event={"ID":"21c89f69-fad7-4709-b4b7-346c3d74251e","Type":"ContainerStarted","Data":"5253edbcf62272b4fb919617c5ab90f0bad950ada6271f20a1d74b8e67c2a0c9"} Jul 20 09:57:15.535499 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:15.535462 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" event={"ID":"b93e7a01-9261-47d4-af6e-33db84fa3f39","Type":"ContainerStarted","Data":"09898c28bdd03ea1f15e51b6f52f6a791ba068c04c4e5501d62df4ee4413ffb6"} Jul 20 09:57:16.289033 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:16.288958 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:16.289033 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:16.288992 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:16.289277 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:16.289093 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:16.289277 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:16.289220 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:16.540695 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:16.540616 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" event={"ID":"b93e7a01-9261-47d4-af6e-33db84fa3f39","Type":"ContainerStarted","Data":"d68f6f9c48e4a6a7b806ca5388ef60d37c7e67d4cf706138e0f95dd8ebafd9ee"} Jul 20 09:57:16.544877 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:16.544852 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"404db775fb00a0eaa3e69bb464bfc9f2fc3d68dd179a02ba526aa522c7bacc02"} Jul 20 09:57:16.557697 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:16.557655 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7rbs2" podStartSLOduration=4.225496648 podStartE2EDuration="25.55764156s" totalImagesPullingTime="21.332144912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:16.557516357 +0000 UTC m=+25.825506370" watchObservedRunningTime="2026-07-20 09:57:16.55764156 +0000 UTC m=+25.825631385" Jul 20 09:57:16.558091 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:16.558067 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-t4jpb" podStartSLOduration=6.432133395 podStartE2EDuration="25.558060592s" totalImagesPullingTime="19.125927197s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:15.554584998 +0000 UTC m=+24.822574824" watchObservedRunningTime="2026-07-20 09:57:16.558060592 +0000 UTC m=+25.826050419" Jul 20 09:57:17.251902 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:17.251861 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:57:17.252530 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:17.252505 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:57:17.288975 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:17.288939 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:17.289127 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:17.289070 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:17.547505 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:17.547415 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:57:17.547914 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:17.547819 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dr4dk" Jul 20 09:57:18.289306 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:18.289254 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:18.289485 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:18.289285 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:18.289485 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:18.289379 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:18.289485 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:18.289428 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:19.289366 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:19.289184 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:19.290033 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:19.289459 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:19.555975 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:19.555892 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" event={"ID":"aa274a27-90e6-409c-bba8-89fc85955020","Type":"ContainerStarted","Data":"b666c9bab573d9ef377d8775d00f528014e729478900cdeaeaf9acccc0b99c2d"} Jul 20 09:57:19.556366 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:19.556105 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:57:19.556366 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:19.556178 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:57:19.557700 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:19.557669 2583 generic.go:356] "Generic (PLEG): container finished" podID="676ddd76-0499-4ca3-9b33-9285a97ba3a9" containerID="ccc74812e33554ea160b5d39fd2a351c3d10c1dc23f6931d4fe8777af1bfb5a4" exitCode=0 Jul 20 09:57:19.557830 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:19.557724 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" event={"ID":"676ddd76-0499-4ca3-9b33-9285a97ba3a9","Type":"ContainerDied","Data":"ccc74812e33554ea160b5d39fd2a351c3d10c1dc23f6931d4fe8777af1bfb5a4"} Jul 20 09:57:19.571944 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:19.571923 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:57:19.584797 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:19.584741 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" podStartSLOduration=9.380011862 podStartE2EDuration="28.584727781s" totalImagesPullingTime="19.204715919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:19.584506854 +0000 UTC m=+28.852496679" watchObservedRunningTime="2026-07-20 09:57:19.584727781 +0000 UTC m=+28.852717607" Jul 20 09:57:20.289168 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.288982 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:20.289415 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.289047 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:20.289415 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:20.289259 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:20.289415 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:20.289362 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:20.560228 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.560122 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:57:20.577465 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.577434 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:57:20.583540 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.583516 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tlh45"] Jul 20 09:57:20.583700 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.583610 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:20.583788 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:20.583696 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:20.589763 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.589729 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hpfbq"] Jul 20 09:57:20.589858 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.589820 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:20.589908 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:20.589893 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:20.593050 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.593026 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fsjbf"] Jul 20 09:57:20.593155 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:20.593143 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:20.593340 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:20.593244 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:21.563989 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:21.563950 2583 generic.go:356] "Generic (PLEG): container finished" podID="676ddd76-0499-4ca3-9b33-9285a97ba3a9" containerID="591fe56cdc80781ed475e09149af31c8c9ff9421746a3a06d2c5a83fe7bb43bf" exitCode=0 Jul 20 09:57:21.564489 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:21.564032 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" event={"ID":"676ddd76-0499-4ca3-9b33-9285a97ba3a9","Type":"ContainerDied","Data":"591fe56cdc80781ed475e09149af31c8c9ff9421746a3a06d2c5a83fe7bb43bf"} Jul 20 09:57:22.289643 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:22.289600 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:22.289835 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:22.289719 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:22.289835 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:22.289730 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:22.289835 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:22.289770 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:22.289941 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:22.289861 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:22.289941 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:22.289923 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:23.570859 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:23.570828 2583 generic.go:356] "Generic (PLEG): container finished" podID="676ddd76-0499-4ca3-9b33-9285a97ba3a9" containerID="5c7aaf97e9fe9838d1897a1ef2c4439af846d767d9fd0336ee8215a3513c0bb1" exitCode=0 Jul 20 09:57:23.571293 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:23.570885 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" event={"ID":"676ddd76-0499-4ca3-9b33-9285a97ba3a9","Type":"ContainerDied","Data":"5c7aaf97e9fe9838d1897a1ef2c4439af846d767d9fd0336ee8215a3513c0bb1"} Jul 20 09:57:24.289187 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:24.289144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:24.289187 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:24.289175 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:24.289380 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:24.289254 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:24.289380 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:24.289267 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:24.289380 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:24.289352 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:24.289477 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:24.289390 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:24.924659 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:24.924611 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:24.925500 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:24.924697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:24.925500 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:24.924790 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:24.925500 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:24.924836 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:24.925500 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:24.924858 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs podName:d86aebe1-4eb3-43fc-a1a4-9e49a8970747 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:56.924843745 +0000 UTC m=+66.192833553 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs") pod "network-metrics-daemon-fsjbf" (UID: "d86aebe1-4eb3-43fc-a1a4-9e49a8970747") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 20 09:57:24.925500 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:24.924887 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret podName:d5979e66-95ad-4e37-b7da-e77682a8d434 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:56.924870446 +0000 UTC m=+66.192860257 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret") pod "global-pull-secret-syncer-tlh45" (UID: "d5979e66-95ad-4e37-b7da-e77682a8d434") : object "kube-system"/"original-pull-secret" not registered Jul 20 09:57:25.025852 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:25.025824 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:25.026027 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:25.025960 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 20 09:57:25.026027 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:25.025983 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 20 09:57:25.026027 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:25.025995 2583 projected.go:196] Error preparing data for projected volume kube-api-access-r47xh for pod openshift-network-diagnostics/network-check-target-hpfbq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:25.026167 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:25.026060 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh podName:dd00f0c0-3934-4bf0-b87a-62b6d3821cb2 nodeName:}" failed. No retries permitted until 2026-07-20 09:57:57.026041209 +0000 UTC m=+66.294031029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r47xh" (UniqueName: "kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh") pod "network-check-target-hpfbq" (UID: "dd00f0c0-3934-4bf0-b87a-62b6d3821cb2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 20 09:57:26.289829 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.289420 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:26.289829 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.289470 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:26.289829 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.289535 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:26.289829 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:26.289546 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tlh45" podUID="d5979e66-95ad-4e37-b7da-e77682a8d434" Jul 20 09:57:26.289829 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:26.289642 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fsjbf" podUID="d86aebe1-4eb3-43fc-a1a4-9e49a8970747" Jul 20 09:57:26.289829 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:26.289734 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hpfbq" podUID="dd00f0c0-3934-4bf0-b87a-62b6d3821cb2" Jul 20 09:57:26.539148 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.539103 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-245.ec2.internal" event="NodeReady" Jul 20 09:57:26.539311 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.539245 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 20 09:57:26.574205 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.574109 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-798ff6649c-sgjgn"] Jul 20 09:57:26.576401 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.576374 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.578783 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.578607 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 20 09:57:26.578783 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.578615 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 20 09:57:26.578783 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.578616 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 20 09:57:26.578783 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.578676 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9q88t\"" Jul 20 09:57:26.585621 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.585418 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 20 09:57:26.591711 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.590804 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8l5d4"] Jul 20 09:57:26.592857 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.592838 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-798ff6649c-sgjgn"] Jul 20 09:57:26.592857 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.592875 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9sp8h"] Jul 20 09:57:26.593048 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.592958 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.594284 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.594266 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9sp8h" Jul 20 09:57:26.595091 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.594847 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 20 09:57:26.595091 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.594862 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 20 09:57:26.595091 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.594888 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-txv2k\"" Jul 20 09:57:26.596389 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.596370 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 20 09:57:26.596481 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.596417 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 20 09:57:26.596481 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.596475 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bk72q\"" Jul 20 09:57:26.596992 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.596974 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 20 09:57:26.607714 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.607671 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8l5d4"] Jul 20 09:57:26.610265 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.610245 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9sp8h"] Jul 20 09:57:26.737811 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.737779 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/055af240-f2f1-4a20-8738-7d12bdeaa67a-ca-trust-extracted\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.737811 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.737816 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-tmp-dir\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.738037 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.737877 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-bound-sa-token\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.738037 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.737904 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.738037 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.737932 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thq7p\" (UniqueName: \"kubernetes.io/projected/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-kube-api-access-thq7p\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.738037 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.737983 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zch5\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-kube-api-access-7zch5\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.738037 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.737999 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtkqf\" (UniqueName: \"kubernetes.io/projected/5315f21c-e91b-4a5f-bae3-a010314c33b8-kube-api-access-dtkqf\") pod \"ingress-canary-9sp8h\" (UID: \"5315f21c-e91b-4a5f-bae3-a010314c33b8\") " pod="openshift-ingress-canary/ingress-canary-9sp8h" Jul 20 09:57:26.738037 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.738027 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.738303 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.738046 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-certificates\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.738303 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.738061 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-config-volume\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.738303 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.738088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-image-registry-private-configuration\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.738303 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.738136 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-trusted-ca\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.738303 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.738162 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-installation-pull-secrets\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.738303 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.738256 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5315f21c-e91b-4a5f-bae3-a010314c33b8-cert\") pod \"ingress-canary-9sp8h\" (UID: \"5315f21c-e91b-4a5f-bae3-a010314c33b8\") " pod="openshift-ingress-canary/ingress-canary-9sp8h" Jul 20 09:57:26.839111 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839027 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5315f21c-e91b-4a5f-bae3-a010314c33b8-cert\") pod \"ingress-canary-9sp8h\" (UID: \"5315f21c-e91b-4a5f-bae3-a010314c33b8\") " pod="openshift-ingress-canary/ingress-canary-9sp8h" Jul 20 09:57:26.839111 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839084 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/055af240-f2f1-4a20-8738-7d12bdeaa67a-ca-trust-extracted\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.839111 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839103 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-tmp-dir\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839154 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-bound-sa-token\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839175 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839197 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thq7p\" (UniqueName: \"kubernetes.io/projected/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-kube-api-access-thq7p\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zch5\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-kube-api-access-7zch5\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtkqf\" (UniqueName: \"kubernetes.io/projected/5315f21c-e91b-4a5f-bae3-a010314c33b8-kube-api-access-dtkqf\") pod \"ingress-canary-9sp8h\" (UID: \"5315f21c-e91b-4a5f-bae3-a010314c33b8\") " pod="openshift-ingress-canary/ingress-canary-9sp8h" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839289 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-certificates\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839332 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-config-volume\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839357 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-image-registry-private-configuration\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.839378 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839381 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-trusted-ca\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839408 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-installation-pull-secrets\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.839771 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/055af240-f2f1-4a20-8738-7d12bdeaa67a-ca-trust-extracted\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:26.839866 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:26.839881 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798ff6649c-sgjgn: secret "image-registry-tls" not found Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:26.839932 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls podName:055af240-f2f1-4a20-8738-7d12bdeaa67a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:27.339913279 +0000 UTC m=+36.607903102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls") pod "image-registry-798ff6649c-sgjgn" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a") : secret "image-registry-tls" not found Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.840295 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-tmp-dir\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.840325 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-config-volume\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.840332 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-certificates\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:26.840413 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:26.840810 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:26.840468 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls podName:73c92407-c8f7-4de1-9b2e-ab6c050b9bde nodeName:}" failed. No retries permitted until 2026-07-20 09:57:27.340452235 +0000 UTC m=+36.608442039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls") pod "dns-default-8l5d4" (UID: "73c92407-c8f7-4de1-9b2e-ab6c050b9bde") : secret "dns-default-metrics-tls" not found Jul 20 09:57:26.841136 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.841113 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-trusted-ca\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.843964 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.843945 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-image-registry-private-configuration\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.844065 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.843972 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-installation-pull-secrets\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.844065 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.844015 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5315f21c-e91b-4a5f-bae3-a010314c33b8-cert\") pod \"ingress-canary-9sp8h\" (UID: \"5315f21c-e91b-4a5f-bae3-a010314c33b8\") " pod="openshift-ingress-canary/ingress-canary-9sp8h" Jul 20 09:57:26.854086 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.854065 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zch5\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-kube-api-access-7zch5\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.854251 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.854233 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thq7p\" (UniqueName: \"kubernetes.io/projected/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-kube-api-access-thq7p\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:26.854925 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.854727 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-bound-sa-token\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:26.854925 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.854895 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtkqf\" (UniqueName: \"kubernetes.io/projected/5315f21c-e91b-4a5f-bae3-a010314c33b8-kube-api-access-dtkqf\") pod \"ingress-canary-9sp8h\" (UID: \"5315f21c-e91b-4a5f-bae3-a010314c33b8\") " pod="openshift-ingress-canary/ingress-canary-9sp8h" Jul 20 09:57:26.910048 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:26.910012 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9sp8h" Jul 20 09:57:27.346928 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:27.346885 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:27.347382 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:27.346942 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:27.347382 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:27.347052 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:57:27.347382 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:27.347054 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:27.347382 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:27.347067 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798ff6649c-sgjgn: secret "image-registry-tls" not found Jul 20 09:57:27.347382 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:27.347142 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls podName:73c92407-c8f7-4de1-9b2e-ab6c050b9bde nodeName:}" failed. No retries permitted until 2026-07-20 09:57:28.347119908 +0000 UTC m=+37.615109726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls") pod "dns-default-8l5d4" (UID: "73c92407-c8f7-4de1-9b2e-ab6c050b9bde") : secret "dns-default-metrics-tls" not found Jul 20 09:57:27.347382 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:27.347164 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls podName:055af240-f2f1-4a20-8738-7d12bdeaa67a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:28.347154529 +0000 UTC m=+37.615144335 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls") pod "image-registry-798ff6649c-sgjgn" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a") : secret "image-registry-tls" not found Jul 20 09:57:28.083682 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.083583 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9sp8h"] Jul 20 09:57:28.088334 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:57:28.088302 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5315f21c_e91b_4a5f_bae3_a010314c33b8.slice/crio-16c257f85b2a3eaab7f0ef9113024dfbd811f48d2f006b1f289dfb340f788604 WatchSource:0}: Error finding container 16c257f85b2a3eaab7f0ef9113024dfbd811f48d2f006b1f289dfb340f788604: Status 404 returned error can't find the container with id 16c257f85b2a3eaab7f0ef9113024dfbd811f48d2f006b1f289dfb340f788604 Jul 20 09:57:28.289178 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.289076 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:28.289325 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.289190 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:28.289325 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.289281 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:28.291038 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.291015 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:57:28.291542 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.291499 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 09:57:28.291645 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.291551 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:57:28.291645 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.291565 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7v24\"" Jul 20 09:57:28.291645 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.291567 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4r9z\"" Jul 20 09:57:28.291645 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.291601 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 09:57:28.354431 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.354404 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:28.355081 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.354450 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:28.355081 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:28.354545 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:57:28.355081 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:28.354548 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:28.355081 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:28.354555 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798ff6649c-sgjgn: secret "image-registry-tls" not found Jul 20 09:57:28.355081 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:28.354608 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls podName:73c92407-c8f7-4de1-9b2e-ab6c050b9bde nodeName:}" failed. No retries permitted until 2026-07-20 09:57:30.354594346 +0000 UTC m=+39.622584149 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls") pod "dns-default-8l5d4" (UID: "73c92407-c8f7-4de1-9b2e-ab6c050b9bde") : secret "dns-default-metrics-tls" not found Jul 20 09:57:28.355081 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:28.354622 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls podName:055af240-f2f1-4a20-8738-7d12bdeaa67a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:30.354615915 +0000 UTC m=+39.622605719 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls") pod "image-registry-798ff6649c-sgjgn" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a") : secret "image-registry-tls" not found Jul 20 09:57:28.585227 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.585122 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9sp8h" event={"ID":"5315f21c-e91b-4a5f-bae3-a010314c33b8","Type":"ContainerStarted","Data":"16c257f85b2a3eaab7f0ef9113024dfbd811f48d2f006b1f289dfb340f788604"} Jul 20 09:57:28.588325 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.588237 2583 generic.go:356] "Generic (PLEG): container finished" podID="676ddd76-0499-4ca3-9b33-9285a97ba3a9" containerID="6f2094628c3be511c3d10b092227db9d2c888d07a7845101e363871126799d4a" exitCode=0 Jul 20 09:57:28.588325 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:28.588280 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" event={"ID":"676ddd76-0499-4ca3-9b33-9285a97ba3a9","Type":"ContainerDied","Data":"6f2094628c3be511c3d10b092227db9d2c888d07a7845101e363871126799d4a"} Jul 20 09:57:29.594000 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:29.593963 2583 generic.go:356] "Generic (PLEG): container finished" podID="676ddd76-0499-4ca3-9b33-9285a97ba3a9" containerID="9b5075c1f3566182e5154e024ed7931384b93b68c590996298b72b3763da114e" exitCode=0 Jul 20 09:57:29.594433 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:29.594050 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" event={"ID":"676ddd76-0499-4ca3-9b33-9285a97ba3a9","Type":"ContainerDied","Data":"9b5075c1f3566182e5154e024ed7931384b93b68c590996298b72b3763da114e"} Jul 20 09:57:30.372173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:30.372135 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:30.372300 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:30.372196 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:30.372367 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:30.372320 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:30.372367 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:30.372335 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:57:30.372367 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:30.372351 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798ff6649c-sgjgn: secret "image-registry-tls" not found Jul 20 09:57:30.372502 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:30.372402 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls podName:73c92407-c8f7-4de1-9b2e-ab6c050b9bde nodeName:}" failed. No retries permitted until 2026-07-20 09:57:34.372380175 +0000 UTC m=+43.640369980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls") pod "dns-default-8l5d4" (UID: "73c92407-c8f7-4de1-9b2e-ab6c050b9bde") : secret "dns-default-metrics-tls" not found Jul 20 09:57:30.372502 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:30.372423 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls podName:055af240-f2f1-4a20-8738-7d12bdeaa67a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:34.372412998 +0000 UTC m=+43.640402804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls") pod "image-registry-798ff6649c-sgjgn" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a") : secret "image-registry-tls" not found Jul 20 09:57:30.599453 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:30.599374 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" event={"ID":"676ddd76-0499-4ca3-9b33-9285a97ba3a9","Type":"ContainerStarted","Data":"a674b1713a37fe9414e7a2a0831b93ae047c702ad0ea14d6805b7f7eb1874eb0"} Jul 20 09:57:30.623017 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:30.622972 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pjvd4" podStartSLOduration=9.705007175 podStartE2EDuration="39.622958143s" totalImagesPullingTime="29.917950968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:30.622275251 +0000 UTC m=+39.890265077" watchObservedRunningTime="2026-07-20 09:57:30.622958143 +0000 UTC m=+39.890947989" Jul 20 09:57:31.603690 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:31.603649 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9sp8h" event={"ID":"5315f21c-e91b-4a5f-bae3-a010314c33b8","Type":"ContainerStarted","Data":"e9b06e5fdbebce6741de8e44341b8a6168062f9cc6fd3384c88506eb920b2bb3"} Jul 20 09:57:31.621204 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:31.621153 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9sp8h" podStartSLOduration=2.999349902 podStartE2EDuration="5.621120003s" totalImagesPullingTime="2.621770101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:57:31.620781672 +0000 UTC m=+40.888771499" watchObservedRunningTime="2026-07-20 09:57:31.621120003 +0000 UTC m=+40.889109827" Jul 20 09:57:34.403884 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:34.403845 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:34.404243 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:34.403916 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:34.404359 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:34.404149 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:34.404448 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:34.404346 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:57:34.404448 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:34.404437 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls podName:73c92407-c8f7-4de1-9b2e-ab6c050b9bde nodeName:}" failed. No retries permitted until 2026-07-20 09:57:42.404394022 +0000 UTC m=+51.672383825 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls") pod "dns-default-8l5d4" (UID: "73c92407-c8f7-4de1-9b2e-ab6c050b9bde") : secret "dns-default-metrics-tls" not found Jul 20 09:57:34.404448 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:34.404445 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798ff6649c-sgjgn: secret "image-registry-tls" not found Jul 20 09:57:34.404645 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:34.404493 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls podName:055af240-f2f1-4a20-8738-7d12bdeaa67a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:42.404481015 +0000 UTC m=+51.672470824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls") pod "image-registry-798ff6649c-sgjgn" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a") : secret "image-registry-tls" not found Jul 20 09:57:42.463639 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:42.463595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:42.463639 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:42.463649 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:42.464191 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:42.463745 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:57:42.464191 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:42.463777 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798ff6649c-sgjgn: secret "image-registry-tls" not found Jul 20 09:57:42.464191 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:42.463776 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:42.464191 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:42.463827 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls podName:055af240-f2f1-4a20-8738-7d12bdeaa67a nodeName:}" failed. No retries permitted until 2026-07-20 09:57:58.463814631 +0000 UTC m=+67.731804434 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls") pod "image-registry-798ff6649c-sgjgn" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a") : secret "image-registry-tls" not found Jul 20 09:57:42.464191 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:42.463854 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls podName:73c92407-c8f7-4de1-9b2e-ab6c050b9bde nodeName:}" failed. No retries permitted until 2026-07-20 09:57:58.463835364 +0000 UTC m=+67.731825184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls") pod "dns-default-8l5d4" (UID: "73c92407-c8f7-4de1-9b2e-ab6c050b9bde") : secret "dns-default-metrics-tls" not found Jul 20 09:57:52.581998 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:52.581967 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jfh4h" Jul 20 09:57:56.969713 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:56.969672 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:56.970175 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:56.969735 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:57:56.972266 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:56.972246 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 20 09:57:56.972466 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:56.972453 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 20 09:57:56.979921 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:56.979901 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 20 09:57:56.980021 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:56.979979 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs podName:d86aebe1-4eb3-43fc-a1a4-9e49a8970747 nodeName:}" failed. No retries permitted until 2026-07-20 09:59:00.979958052 +0000 UTC m=+130.247947858 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs") pod "network-metrics-daemon-fsjbf" (UID: "d86aebe1-4eb3-43fc-a1a4-9e49a8970747") : secret "metrics-daemon-secret" not found Jul 20 09:57:56.983549 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:56.983526 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5979e66-95ad-4e37-b7da-e77682a8d434-original-pull-secret\") pod \"global-pull-secret-syncer-tlh45\" (UID: \"d5979e66-95ad-4e37-b7da-e77682a8d434\") " pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:57.070990 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.070949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:57.073063 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.073040 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 20 09:57:57.082988 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.082970 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 20 09:57:57.094014 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.093991 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r47xh\" (UniqueName: \"kubernetes.io/projected/dd00f0c0-3934-4bf0-b87a-62b6d3821cb2-kube-api-access-r47xh\") pod \"network-check-target-hpfbq\" (UID: \"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2\") " pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:57.100592 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.100574 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-f4r9z\"" Jul 20 09:57:57.104990 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.104975 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tlh45" Jul 20 09:57:57.109373 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.109352 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:57:57.238072 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.237987 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hpfbq"] Jul 20 09:57:57.242023 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:57:57.241999 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd00f0c0_3934_4bf0_b87a_62b6d3821cb2.slice/crio-e27a6c93c43ac2a8234497c0fbdf776aa8f9b830f70fc16ecd09e1a6f9b468b1 WatchSource:0}: Error finding container e27a6c93c43ac2a8234497c0fbdf776aa8f9b830f70fc16ecd09e1a6f9b468b1: Status 404 returned error can't find the container with id e27a6c93c43ac2a8234497c0fbdf776aa8f9b830f70fc16ecd09e1a6f9b468b1 Jul 20 09:57:57.250561 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.250507 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tlh45"] Jul 20 09:57:57.253575 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:57:57.253554 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5979e66_95ad_4e37_b7da_e77682a8d434.slice/crio-65b453e165377a57d9620be94dddc086ad25f9933664f66e0e86a7ab503b89bb WatchSource:0}: Error finding container 65b453e165377a57d9620be94dddc086ad25f9933664f66e0e86a7ab503b89bb: Status 404 returned error can't find the container with id 65b453e165377a57d9620be94dddc086ad25f9933664f66e0e86a7ab503b89bb Jul 20 09:57:57.660431 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.660333 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hpfbq" event={"ID":"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2","Type":"ContainerStarted","Data":"e27a6c93c43ac2a8234497c0fbdf776aa8f9b830f70fc16ecd09e1a6f9b468b1"} Jul 20 09:57:57.661332 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:57.661310 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tlh45" event={"ID":"d5979e66-95ad-4e37-b7da-e77682a8d434","Type":"ContainerStarted","Data":"65b453e165377a57d9620be94dddc086ad25f9933664f66e0e86a7ab503b89bb"} Jul 20 09:57:58.481217 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:58.481106 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:57:58.481217 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:57:58.481177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:57:58.481736 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:58.481326 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:57:58.481736 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:58.481343 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798ff6649c-sgjgn: secret "image-registry-tls" not found Jul 20 09:57:58.481736 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:58.481402 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls podName:055af240-f2f1-4a20-8738-7d12bdeaa67a nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.481384238 +0000 UTC m=+99.749374058 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls") pod "image-registry-798ff6649c-sgjgn" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a") : secret "image-registry-tls" not found Jul 20 09:57:58.481953 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:58.481833 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:57:58.481953 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:57:58.481884 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls podName:73c92407-c8f7-4de1-9b2e-ab6c050b9bde nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.481868842 +0000 UTC m=+99.749858651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls") pod "dns-default-8l5d4" (UID: "73c92407-c8f7-4de1-9b2e-ab6c050b9bde") : secret "dns-default-metrics-tls" not found Jul 20 09:58:02.676188 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:02.676141 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hpfbq" event={"ID":"dd00f0c0-3934-4bf0-b87a-62b6d3821cb2","Type":"ContainerStarted","Data":"b9394f6470092fc890266842088904d6f1bf042550fc5740522e7b69c0f97c74"} Jul 20 09:58:02.676624 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:02.676275 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:58:02.677663 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:02.677639 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tlh45" event={"ID":"d5979e66-95ad-4e37-b7da-e77682a8d434","Type":"ContainerStarted","Data":"1fb0c617f081650b3c422fe715674bfbebff08eb7effe320aa9acf2cfd9ff871"} Jul 20 09:58:02.693115 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:02.693062 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hpfbq" podStartSLOduration=66.999814882 podStartE2EDuration="1m11.693042016s" totalImagesPullingTime="4.693227134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:02.692907841 +0000 UTC m=+71.960897667" watchObservedRunningTime="2026-07-20 09:58:02.693042016 +0000 UTC m=+71.961031839" Jul 20 09:58:02.709098 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:02.709043 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tlh45" podStartSLOduration=67.024410705 podStartE2EDuration="1m11.709024835s" totalImagesPullingTime="4.68461413s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:02.708727952 +0000 UTC m=+71.976717780" watchObservedRunningTime="2026-07-20 09:58:02.709024835 +0000 UTC m=+71.977014660" Jul 20 09:58:26.576669 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.576555 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbjmc"] Jul 20 09:58:26.580892 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.580869 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.583467 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.583450 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 20 09:58:26.583833 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.583814 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 20 09:58:26.583930 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.583914 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 20 09:58:26.583983 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.583960 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 20 09:58:26.584051 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.584035 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wds68\"" Jul 20 09:58:26.594611 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.594585 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbjmc"] Jul 20 09:58:26.694253 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.694216 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7g52\" (UniqueName: \"kubernetes.io/projected/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-api-access-q7g52\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.694431 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.694263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-data-volume\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.694431 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.694285 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.694431 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.694340 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-crio-socket\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.694431 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.694398 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.795018 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.794981 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-data-volume\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.795018 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.795017 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.795248 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.795042 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-crio-socket\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.795248 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.795079 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.795248 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.795119 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7g52\" (UniqueName: \"kubernetes.io/projected/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-api-access-q7g52\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.795248 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:26.795143 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:26.795248 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:26.795214 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:26.795248 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:26.795229 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.295208799 +0000 UTC m=+96.563198605 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:26.795476 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:26.795259 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:27.295247087 +0000 UTC m=+96.563236923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : configmap "kube-rbac-proxy" not found Jul 20 09:58:26.795476 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.795210 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-crio-socket\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.795476 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.795331 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-data-volume\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:26.803904 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:26.803882 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7g52\" (UniqueName: \"kubernetes.io/projected/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-api-access-q7g52\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:27.300076 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:27.300045 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:27.300230 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:27.300113 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:27.300230 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:27.300176 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:27.300230 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:27.300203 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:27.300322 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:27.300252 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:28.300233919 +0000 UTC m=+97.568223723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : configmap "kube-rbac-proxy" not found Jul 20 09:58:27.300322 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:27.300266 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:28.300260012 +0000 UTC m=+97.568249815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:28.307242 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:28.307167 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:28.307633 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:28.307269 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:28.307633 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:28.307324 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:28.307633 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:28.307345 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:28.307633 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:28.307396 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.307379598 +0000 UTC m=+99.575369402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:28.307633 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:28.307410 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:30.307403433 +0000 UTC m=+99.575393236 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : configmap "kube-rbac-proxy" not found Jul 20 09:58:28.759264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:28.759240 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p5hzh_f582d91e-5b7e-4f8f-b849-5f3929c3c4be/dns-node-resolver/0.log" Jul 20 09:58:29.359994 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:29.359967 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c49bf_2b3bd91d-eb78-4521-b05e-cd5c42193512/node-ca/0.log" Jul 20 09:58:30.160522 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:30.160497 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9sp8h_5315f21c-e91b-4a5f-bae3-a010314c33b8/serve-healthcheck-canary/0.log" Jul 20 09:58:30.322842 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:30.322804 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:30.323003 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:30.322883 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:30.323003 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.322965 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:30.323110 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.323022 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:34.323007291 +0000 UTC m=+103.590997095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:30.323110 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.322967 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:30.323198 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.323113 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:34.323096806 +0000 UTC m=+103.591086624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : configmap "kube-rbac-proxy" not found Jul 20 09:58:30.524236 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:30.524203 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:58:30.524562 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:30.524260 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") pod \"image-registry-798ff6649c-sgjgn\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:58:30.524562 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.524357 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 20 09:58:30.524562 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.524418 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls podName:73c92407-c8f7-4de1-9b2e-ab6c050b9bde nodeName:}" failed. No retries permitted until 2026-07-20 09:59:34.524404836 +0000 UTC m=+163.792394641 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls") pod "dns-default-8l5d4" (UID: "73c92407-c8f7-4de1-9b2e-ab6c050b9bde") : secret "dns-default-metrics-tls" not found Jul 20 09:58:30.524562 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.524361 2583 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 20 09:58:30.524562 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.524439 2583 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-798ff6649c-sgjgn: secret "image-registry-tls" not found Jul 20 09:58:30.524562 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:30.524466 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls podName:055af240-f2f1-4a20-8738-7d12bdeaa67a nodeName:}" failed. No retries permitted until 2026-07-20 09:59:34.524455796 +0000 UTC m=+163.792445603 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls") pod "image-registry-798ff6649c-sgjgn" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a") : secret "image-registry-tls" not found Jul 20 09:58:33.683460 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:33.683428 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hpfbq" Jul 20 09:58:34.351221 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:34.351187 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:34.351387 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:34.351249 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:34.351387 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:34.351319 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 20 09:58:34.351387 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:34.351340 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:34.351485 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:34.351398 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:42.351379649 +0000 UTC m=+111.619369459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : configmap "kube-rbac-proxy" not found Jul 20 09:58:34.351485 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:34.351415 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:42.351409075 +0000 UTC m=+111.619398879 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:36.141013 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.140978 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr"] Jul 20 09:58:36.163953 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.163933 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" Jul 20 09:58:36.176276 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.176255 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 20 09:58:36.176392 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.176255 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nfz6j\"" Jul 20 09:58:36.180436 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.180423 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 20 09:58:36.186820 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.186799 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr"] Jul 20 09:58:36.265732 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.265700 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxbsl\" (UniqueName: \"kubernetes.io/projected/ed866833-2881-4b96-9de1-2d017834d981-kube-api-access-xxbsl\") pod \"migrator-7cc9c7ffd7-72lwr\" (UID: \"ed866833-2881-4b96-9de1-2d017834d981\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" Jul 20 09:58:36.366449 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.366411 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxbsl\" (UniqueName: \"kubernetes.io/projected/ed866833-2881-4b96-9de1-2d017834d981-kube-api-access-xxbsl\") pod \"migrator-7cc9c7ffd7-72lwr\" (UID: \"ed866833-2881-4b96-9de1-2d017834d981\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" Jul 20 09:58:36.377396 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.377370 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxbsl\" (UniqueName: \"kubernetes.io/projected/ed866833-2881-4b96-9de1-2d017834d981-kube-api-access-xxbsl\") pod \"migrator-7cc9c7ffd7-72lwr\" (UID: \"ed866833-2881-4b96-9de1-2d017834d981\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" Jul 20 09:58:36.472290 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.472253 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" Jul 20 09:58:36.601013 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.600973 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr"] Jul 20 09:58:36.604471 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:58:36.604447 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded866833_2881_4b96_9de1_2d017834d981.slice/crio-d75202437059f10c030a7b0393e813f5d8de91a7cfa2a8b12a8f5443400abfe2 WatchSource:0}: Error finding container d75202437059f10c030a7b0393e813f5d8de91a7cfa2a8b12a8f5443400abfe2: Status 404 returned error can't find the container with id d75202437059f10c030a7b0393e813f5d8de91a7cfa2a8b12a8f5443400abfe2 Jul 20 09:58:36.767388 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:36.767299 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" event={"ID":"ed866833-2881-4b96-9de1-2d017834d981","Type":"ContainerStarted","Data":"d75202437059f10c030a7b0393e813f5d8de91a7cfa2a8b12a8f5443400abfe2"} Jul 20 09:58:37.770433 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:37.770400 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" event={"ID":"ed866833-2881-4b96-9de1-2d017834d981","Type":"ContainerStarted","Data":"9809984e91755f3d311f72236efef8dce4df9787a5c55ca314bde571a38f65b5"} Jul 20 09:58:38.774093 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:38.774057 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" event={"ID":"ed866833-2881-4b96-9de1-2d017834d981","Type":"ContainerStarted","Data":"8ab8c9cf7cc22433b53f2eab3fd263d28779af2ad3ad3948855a54500e9857f2"} Jul 20 09:58:38.802947 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:38.802898 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-72lwr" podStartSLOduration=1.747070444 podStartE2EDuration="2.802882554s" totalImagesPullingTime="1.05581211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:58:38.802536161 +0000 UTC m=+108.070525988" watchObservedRunningTime="2026-07-20 09:58:38.802882554 +0000 UTC m=+108.070872421" Jul 20 09:58:42.411576 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:42.411532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:42.412097 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:42.411596 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:42.412097 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:42.411716 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 20 09:58:42.412097 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:58:42.411839 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls podName:3908aa74-e4c5-4b9d-b6f8-5c03dd95139b nodeName:}" failed. No retries permitted until 2026-07-20 09:58:58.411817069 +0000 UTC m=+127.679806890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-fbjmc" (UID: "3908aa74-e4c5-4b9d-b6f8-5c03dd95139b") : secret "insights-runtime-extractor-tls" not found Jul 20 09:58:42.412266 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:42.412216 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:58.431000 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:58.430942 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:58.433464 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:58.433439 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3908aa74-e4c5-4b9d-b6f8-5c03dd95139b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbjmc\" (UID: \"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b\") " pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:58.691961 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:58.691877 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wds68\"" Jul 20 09:58:58.700503 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:58.700484 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbjmc" Jul 20 09:58:58.865741 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:58.865712 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbjmc"] Jul 20 09:58:58.868716 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:58:58.868688 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3908aa74_e4c5_4b9d_b6f8_5c03dd95139b.slice/crio-8c0dec0ba0cd518429042fce73a5bddc79be7a8873e0e1af3ad69102a41a6d85 WatchSource:0}: Error finding container 8c0dec0ba0cd518429042fce73a5bddc79be7a8873e0e1af3ad69102a41a6d85: Status 404 returned error can't find the container with id 8c0dec0ba0cd518429042fce73a5bddc79be7a8873e0e1af3ad69102a41a6d85 Jul 20 09:58:59.827466 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:58:59.827422 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbjmc" event={"ID":"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b","Type":"ContainerStarted","Data":"8c0dec0ba0cd518429042fce73a5bddc79be7a8873e0e1af3ad69102a41a6d85"} Jul 20 09:59:01.050461 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:01.050425 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:59:01.053146 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:01.053114 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d86aebe1-4eb3-43fc-a1a4-9e49a8970747-metrics-certs\") pod \"network-metrics-daemon-fsjbf\" (UID: \"d86aebe1-4eb3-43fc-a1a4-9e49a8970747\") " pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:59:01.311786 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:01.311692 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7v24\"" Jul 20 09:59:01.320332 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:01.320297 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fsjbf" Jul 20 09:59:02.827927 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.827888 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t"] Jul 20 09:59:02.851343 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.851317 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.853385 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.853355 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t"] Jul 20 09:59:02.853541 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.853409 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 20 09:59:02.853541 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.853424 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 20 09:59:02.853541 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.853409 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 20 09:59:02.854175 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.853974 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 20 09:59:02.854175 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.854021 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 20 09:59:02.854175 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.854129 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 20 09:59:02.854175 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.854147 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 20 09:59:02.869078 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.869039 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.869222 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.869098 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-ca\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.869222 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.869156 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkglx\" (UniqueName: \"kubernetes.io/projected/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-kube-api-access-kkglx\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.869222 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.869205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-hub\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.869355 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.869230 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.869355 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.869256 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.970180 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.970140 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.970367 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.970216 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-ca\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.970367 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.970268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkglx\" (UniqueName: \"kubernetes.io/projected/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-kube-api-access-kkglx\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.970367 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.970306 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-hub\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.970367 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.970333 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.970572 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.970378 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.971321 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.971262 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.973098 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.973065 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-ca\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.973425 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.973406 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-hub\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.973592 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.973572 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:02.973707 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:02.973620 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:03.001355 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:03.001322 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkglx\" (UniqueName: \"kubernetes.io/projected/d6d3e11c-a7ee-4453-979c-ba72bd02d9f6-kube-api-access-kkglx\") pod \"cluster-proxy-proxy-agent-84bbf76577-ggs9t\" (UID: \"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:03.170599 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:03.170520 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" Jul 20 09:59:03.741029 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:03.741001 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fsjbf"] Jul 20 09:59:03.743391 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:59:03.743362 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd86aebe1_4eb3_43fc_a1a4_9e49a8970747.slice/crio-d337be79e46cdb7ad26684011d3a49cae77b115e21f98112f735f215c5368d1f WatchSource:0}: Error finding container d337be79e46cdb7ad26684011d3a49cae77b115e21f98112f735f215c5368d1f: Status 404 returned error can't find the container with id d337be79e46cdb7ad26684011d3a49cae77b115e21f98112f735f215c5368d1f Jul 20 09:59:03.758189 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:03.758167 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t"] Jul 20 09:59:03.761393 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:59:03.761367 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6d3e11c_a7ee_4453_979c_ba72bd02d9f6.slice/crio-8e465a65c5248bcda94f602367e98070baa04acbc34383e43584713119ad557c WatchSource:0}: Error finding container 8e465a65c5248bcda94f602367e98070baa04acbc34383e43584713119ad557c: Status 404 returned error can't find the container with id 8e465a65c5248bcda94f602367e98070baa04acbc34383e43584713119ad557c Jul 20 09:59:03.842384 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:03.842347 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbjmc" event={"ID":"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b","Type":"ContainerStarted","Data":"04bf40ef8494ff69f29e548a79f3aeca7c3ae2d336ca0e5b519786c8047c5cb8"} Jul 20 09:59:03.843348 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:03.843324 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" event={"ID":"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6","Type":"ContainerStarted","Data":"8e465a65c5248bcda94f602367e98070baa04acbc34383e43584713119ad557c"} Jul 20 09:59:03.844271 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:03.844248 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsjbf" event={"ID":"d86aebe1-4eb3-43fc-a1a4-9e49a8970747","Type":"ContainerStarted","Data":"d337be79e46cdb7ad26684011d3a49cae77b115e21f98112f735f215c5368d1f"} Jul 20 09:59:09.869105 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:09.869068 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbjmc" event={"ID":"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b","Type":"ContainerStarted","Data":"bf51e98db89f26e6710e215fe8047a62be2e04254817c6a50be3ed70e64d3a24"} Jul 20 09:59:09.870906 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:09.870880 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" event={"ID":"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6","Type":"ContainerStarted","Data":"5c3df860cd6c46a060acf11f2e7594856c8b0644c5d38db6309d78a740c79c8f"} Jul 20 09:59:09.871037 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:09.870916 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" event={"ID":"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6","Type":"ContainerStarted","Data":"0d997195793bef8082dddbc73f21e3d273b0e81dd03c808388f9e5b3c73fd84c"} Jul 20 09:59:09.871037 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:09.870933 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" event={"ID":"d6d3e11c-a7ee-4453-979c-ba72bd02d9f6","Type":"ContainerStarted","Data":"52322e1790a1dc21d293edccb4e9fbf6a6c50da9815c2d242595e571e18c1b8a"} Jul 20 09:59:09.872468 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:09.872434 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsjbf" event={"ID":"d86aebe1-4eb3-43fc-a1a4-9e49a8970747","Type":"ContainerStarted","Data":"8e3a70644ea06bb441772924ead0eb53b70ce768a76be8b6e1dd8c8ab9f3101f"} Jul 20 09:59:09.872556 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:09.872485 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fsjbf" event={"ID":"d86aebe1-4eb3-43fc-a1a4-9e49a8970747","Type":"ContainerStarted","Data":"10e06191b835b8a24056c720c5b239aec5b8f851c1876ceadcda29e7f783ee06"} Jul 20 09:59:09.893025 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:09.892966 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-84bbf76577-ggs9t" podStartSLOduration=2.446040328 podStartE2EDuration="7.892949956s" totalImagesPullingTime="5.446909628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:09.891832043 +0000 UTC m=+139.159821868" watchObservedRunningTime="2026-07-20 09:59:09.892949956 +0000 UTC m=+139.160939781" Jul 20 09:59:09.906810 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:09.906737 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fsjbf" podStartSLOduration=133.485585724 podStartE2EDuration="2m18.906716938s" totalImagesPullingTime="5.421131214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:09.90666178 +0000 UTC m=+139.174651625" watchObservedRunningTime="2026-07-20 09:59:09.906716938 +0000 UTC m=+139.174706791" Jul 20 09:59:13.886966 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:13.886932 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbjmc" event={"ID":"3908aa74-e4c5-4b9d-b6f8-5c03dd95139b","Type":"ContainerStarted","Data":"c1bc82ad120341639ebdb84dfcf1c662c3892f65221ddb6ff545c31d955e4af8"} Jul 20 09:59:13.908313 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:13.908258 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbjmc" podStartSLOduration=33.958490684 podStartE2EDuration="47.908240124s" totalImagesPullingTime="13.94974944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 09:58:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:13.907443329 +0000 UTC m=+143.175433157" watchObservedRunningTime="2026-07-20 09:59:13.908240124 +0000 UTC m=+143.176229948" Jul 20 09:59:17.734044 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.734011 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-sl9tc"] Jul 20 09:59:17.737362 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.737328 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.749626 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.749607 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 20 09:59:17.749911 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.749896 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 20 09:59:17.749996 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.749932 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 20 09:59:17.750062 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.750041 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sw4tj\"" Jul 20 09:59:17.750147 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.750131 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 20 09:59:17.750461 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.750415 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 20 09:59:17.750539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.750522 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 20 09:59:17.782783 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.782737 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-hc42j"] Jul 20 09:59:17.785842 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.785824 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.791915 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.791894 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-root\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.792005 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.791925 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-sys\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.792054 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.792009 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-wtmp\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.792100 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.792052 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.792144 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.792109 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-tls\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.792182 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.792152 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-metrics-client-ca\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.792182 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.792170 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5sfn\" (UniqueName: \"kubernetes.io/projected/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-kube-api-access-l5sfn\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.792245 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.792206 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-accelerators-collector-config\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.792279 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.792260 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-textfile\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.793881 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.793862 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 20 09:59:17.793949 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.793867 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 20 09:59:17.793949 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.793930 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-6zgdj\"" Jul 20 09:59:17.794556 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.794538 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 20 09:59:17.817982 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.817959 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-hc42j"] Jul 20 09:59:17.893029 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.892993 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-accelerators-collector-config\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893192 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893037 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v5jv\" (UniqueName: \"kubernetes.io/projected/46522bbc-0221-4afc-82e4-258c8916916d-kube-api-access-7v5jv\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.893192 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893060 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-textfile\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893192 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893082 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46522bbc-0221-4afc-82e4-258c8916916d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.893192 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893114 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-root\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893192 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893134 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-sys\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893192 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893149 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-wtmp\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893192 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893170 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893194 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893218 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-root\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893223 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/46522bbc-0221-4afc-82e4-258c8916916d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893224 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-sys\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893312 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-wtmp\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-tls\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893381 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893412 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-metrics-client-ca\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5sfn\" (UniqueName: \"kubernetes.io/projected/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-kube-api-access-l5sfn\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893450 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-textfile\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893483 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.893539 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:59:17.893507 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 20 09:59:17.893984 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:59:17.893577 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-tls podName:1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd nodeName:}" failed. No retries permitted until 2026-07-20 09:59:18.393559482 +0000 UTC m=+147.661549286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-tls") pod "node-exporter-sl9tc" (UID: "1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd") : secret "node-exporter-tls" not found Jul 20 09:59:17.893984 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.893829 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-accelerators-collector-config\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.894226 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.894205 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-metrics-client-ca\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.895832 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.895810 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.915914 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.915885 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5sfn\" (UniqueName: \"kubernetes.io/projected/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-kube-api-access-l5sfn\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:17.994072 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.993974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.994072 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.994030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.994072 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.994071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v5jv\" (UniqueName: \"kubernetes.io/projected/46522bbc-0221-4afc-82e4-258c8916916d-kube-api-access-7v5jv\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.994350 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.994098 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46522bbc-0221-4afc-82e4-258c8916916d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.994350 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.994142 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.994350 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.994164 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/46522bbc-0221-4afc-82e4-258c8916916d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.994678 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.994644 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/46522bbc-0221-4afc-82e4-258c8916916d-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.994892 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.994863 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.994974 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.994912 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46522bbc-0221-4afc-82e4-258c8916916d-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.996614 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.996593 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:17.996821 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:17.996790 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/46522bbc-0221-4afc-82e4-258c8916916d-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:18.003487 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:18.003462 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v5jv\" (UniqueName: \"kubernetes.io/projected/46522bbc-0221-4afc-82e4-258c8916916d-kube-api-access-7v5jv\") pod \"kube-state-metrics-56c5594674-hc42j\" (UID: \"46522bbc-0221-4afc-82e4-258c8916916d\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:18.094177 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:18.094141 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" Jul 20 09:59:18.265829 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:18.265733 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-hc42j"] Jul 20 09:59:18.268666 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:59:18.268636 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46522bbc_0221_4afc_82e4_258c8916916d.slice/crio-cbbdc65757fdd09c6e61c83555fab265a83c4fbafc09a189543e6af01acf0288 WatchSource:0}: Error finding container cbbdc65757fdd09c6e61c83555fab265a83c4fbafc09a189543e6af01acf0288: Status 404 returned error can't find the container with id cbbdc65757fdd09c6e61c83555fab265a83c4fbafc09a189543e6af01acf0288 Jul 20 09:59:18.398436 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:18.398401 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-tls\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:18.400810 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:18.400791 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd-node-exporter-tls\") pod \"node-exporter-sl9tc\" (UID: \"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd\") " pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:18.646054 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:18.645953 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-sl9tc" Jul 20 09:59:18.657140 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:59:18.657103 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1762638f_6b0e_4b60_9ed3_9f7b3b9b5ddd.slice/crio-ae087c584fb775fb43a166b8cc12a80a41568538d7a4cf378373c627c6caccc8 WatchSource:0}: Error finding container ae087c584fb775fb43a166b8cc12a80a41568538d7a4cf378373c627c6caccc8: Status 404 returned error can't find the container with id ae087c584fb775fb43a166b8cc12a80a41568538d7a4cf378373c627c6caccc8 Jul 20 09:59:18.903318 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:18.903195 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sl9tc" event={"ID":"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd","Type":"ContainerStarted","Data":"ae087c584fb775fb43a166b8cc12a80a41568538d7a4cf378373c627c6caccc8"} Jul 20 09:59:18.904551 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:18.904526 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" event={"ID":"46522bbc-0221-4afc-82e4-258c8916916d","Type":"ContainerStarted","Data":"cbbdc65757fdd09c6e61c83555fab265a83c4fbafc09a189543e6af01acf0288"} Jul 20 09:59:19.909717 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:19.909673 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" event={"ID":"46522bbc-0221-4afc-82e4-258c8916916d","Type":"ContainerStarted","Data":"4583b224775bda9fa79097c167770b2b4e37a41047ce0290e07d0e8c0d3c6064"} Jul 20 09:59:19.910100 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:19.909769 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" event={"ID":"46522bbc-0221-4afc-82e4-258c8916916d","Type":"ContainerStarted","Data":"f4ebd1f025930ba752ae3f504771ec4e65f333ef524af9d326e615cf45b2129b"} Jul 20 09:59:19.910100 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:19.909808 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" event={"ID":"46522bbc-0221-4afc-82e4-258c8916916d","Type":"ContainerStarted","Data":"115147d6b12cca584f5576b70c514b72ca7a9708f80796361427e7d879258c77"} Jul 20 09:59:19.932821 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:19.932765 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-hc42j" podStartSLOduration=1.898957098 podStartE2EDuration="2.932728638s" totalImagesPullingTime="1.03377154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:19.931010305 +0000 UTC m=+149.199000132" watchObservedRunningTime="2026-07-20 09:59:19.932728638 +0000 UTC m=+149.200718496" Jul 20 09:59:20.914689 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:20.914653 2583 generic.go:356] "Generic (PLEG): container finished" podID="1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd" containerID="60120952fb4495c5791f883f4300e589de6eee7142f8353ecd75fa31899fd94b" exitCode=0 Jul 20 09:59:20.915109 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:20.914762 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sl9tc" event={"ID":"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd","Type":"ContainerDied","Data":"60120952fb4495c5791f883f4300e589de6eee7142f8353ecd75fa31899fd94b"} Jul 20 09:59:21.920235 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:21.920198 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sl9tc" event={"ID":"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd","Type":"ContainerStarted","Data":"90c2b7c2f9e430e969f248a647873decdd045d9001d0fa00e6bfcfacc5b920a0"} Jul 20 09:59:21.920614 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:21.920250 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-sl9tc" event={"ID":"1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd","Type":"ContainerStarted","Data":"ecb7cf10440881ea26feb4386599d76414e2d8cd7f0daf563ac11e1adc14da0e"} Jul 20 09:59:21.941592 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:21.941543 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-sl9tc" podStartSLOduration=3.666924833 podStartE2EDuration="4.941528654s" totalImagesPullingTime="1.200881795s" totalInitContainerRuntime="73.722026ms" isStatefulPod=true podCreationTimestamp="2026-07-20 09:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:21.939883324 +0000 UTC m=+151.207873161" watchObservedRunningTime="2026-07-20 09:59:21.941528654 +0000 UTC m=+151.209518479" Jul 20 09:59:22.414647 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.414615 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd"] Jul 20 09:59:22.417691 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.417668 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:22.423908 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.423874 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2l9t4\"" Jul 20 09:59:22.424198 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.424177 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 20 09:59:22.436333 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.436308 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd"] Jul 20 09:59:22.530456 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.530416 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnnj\" (UniqueName: \"kubernetes.io/projected/b62188b1-103d-48f6-b816-1a6e39f149a3-kube-api-access-ghnnj\") pod \"monitoring-plugin-7b7b7bc8bf-82jsd\" (UID: \"b62188b1-103d-48f6-b816-1a6e39f149a3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:22.530456 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.530461 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b62188b1-103d-48f6-b816-1a6e39f149a3-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-82jsd\" (UID: \"b62188b1-103d-48f6-b816-1a6e39f149a3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:22.631844 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.631809 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnnj\" (UniqueName: \"kubernetes.io/projected/b62188b1-103d-48f6-b816-1a6e39f149a3-kube-api-access-ghnnj\") pod \"monitoring-plugin-7b7b7bc8bf-82jsd\" (UID: \"b62188b1-103d-48f6-b816-1a6e39f149a3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:22.632032 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.631849 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b62188b1-103d-48f6-b816-1a6e39f149a3-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-82jsd\" (UID: \"b62188b1-103d-48f6-b816-1a6e39f149a3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:22.634305 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.634278 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b62188b1-103d-48f6-b816-1a6e39f149a3-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-82jsd\" (UID: \"b62188b1-103d-48f6-b816-1a6e39f149a3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:22.656233 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.656207 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnnj\" (UniqueName: \"kubernetes.io/projected/b62188b1-103d-48f6-b816-1a6e39f149a3-kube-api-access-ghnnj\") pod \"monitoring-plugin-7b7b7bc8bf-82jsd\" (UID: \"b62188b1-103d-48f6-b816-1a6e39f149a3\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:22.726442 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.726413 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:22.858079 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.856498 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd"] Jul 20 09:59:22.861667 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:59:22.861635 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62188b1_103d_48f6_b816_1a6e39f149a3.slice/crio-1f1ea4a86c53df45a092a7c0a106be621bd908c7b89fad2a4c641a6277bfbff5 WatchSource:0}: Error finding container 1f1ea4a86c53df45a092a7c0a106be621bd908c7b89fad2a4c641a6277bfbff5: Status 404 returned error can't find the container with id 1f1ea4a86c53df45a092a7c0a106be621bd908c7b89fad2a4c641a6277bfbff5 Jul 20 09:59:22.925173 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:22.925137 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" event={"ID":"b62188b1-103d-48f6-b816-1a6e39f149a3","Type":"ContainerStarted","Data":"1f1ea4a86c53df45a092a7c0a106be621bd908c7b89fad2a4c641a6277bfbff5"} Jul 20 09:59:24.180626 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.180588 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:24.184196 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.184175 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.188900 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.188880 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 09:59:24.189356 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.189335 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 09:59:24.189738 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.189721 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 09:59:24.191346 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191331 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 09:59:24.191638 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191610 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 09:59:24.191732 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191663 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 09:59:24.191732 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191699 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 09:59:24.191877 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191859 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 09:59:24.191997 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191949 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 09:59:24.191997 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191959 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2vtktqclc787t\"" Jul 20 09:59:24.191997 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191965 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 09:59:24.192210 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.192001 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 09:59:24.192210 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191964 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 09:59:24.192210 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.191970 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 09:59:24.192210 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.192095 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 09:59:24.192508 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.192492 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h8944\"" Jul 20 09:59:24.198366 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.198350 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 09:59:24.222645 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.222611 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:24.246007 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.245983 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246097 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246024 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246097 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246042 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246169 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246090 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246200 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246170 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxsnb\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-kube-api-access-sxsnb\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246236 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246211 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246266 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246251 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246307 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246291 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246346 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246332 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-config\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246388 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246422 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246397 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246451 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246426 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246482 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246482 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246471 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246538 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246500 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246538 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246529 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246596 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246549 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246596 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246578 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246654 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246598 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.246654 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.246623 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.347940 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.347904 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-config\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.347940 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.347944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.347964 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.347988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348011 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348036 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348064 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348101 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348131 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348201 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348180 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348216 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348242 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348287 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348338 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348367 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxsnb\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-kube-api-access-sxsnb\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348395 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.348630 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348472 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.349116 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348695 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.349116 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.348921 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.349116 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.349102 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.349294 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.349190 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.352605 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.350007 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.352605 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.350654 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.352605 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.351425 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.352605 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.351437 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.352605 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.351840 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-config-out\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.352605 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.352104 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.353009 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.352812 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-web-config\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.353292 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.353242 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.353572 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.353540 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.353667 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.353606 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.354202 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.354181 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.354362 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.354341 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.354898 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.354873 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.354990 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.354953 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.355177 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.355156 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-config\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.374090 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.374057 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxsnb\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-kube-api-access-sxsnb\") pod \"prometheus-k8s-0\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.493090 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.492966 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:24.697010 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.696978 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 09:59:24.701877 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:59:24.701850 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddadf003e_984a_4886_9547_f8512331a6f2.slice/crio-74dce6f45a2a70a0aba08d231c3f532d66c0f51bf3a853b28ca8fde0de5b288e WatchSource:0}: Error finding container 74dce6f45a2a70a0aba08d231c3f532d66c0f51bf3a853b28ca8fde0de5b288e: Status 404 returned error can't find the container with id 74dce6f45a2a70a0aba08d231c3f532d66c0f51bf3a853b28ca8fde0de5b288e Jul 20 09:59:24.935859 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.935817 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" event={"ID":"b62188b1-103d-48f6-b816-1a6e39f149a3","Type":"ContainerStarted","Data":"0e562adca4665c52e144d9c844f8c3a65d391ac71499df8977db2892e9b208ef"} Jul 20 09:59:24.936073 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.936025 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:24.937138 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.937114 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerStarted","Data":"74dce6f45a2a70a0aba08d231c3f532d66c0f51bf3a853b28ca8fde0de5b288e"} Jul 20 09:59:24.944634 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.942103 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" Jul 20 09:59:24.952264 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:24.952134 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-82jsd" podStartSLOduration=1.874182714 podStartE2EDuration="2.952114138s" totalImagesPullingTime="1.077931424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:24.95147682 +0000 UTC m=+154.219466646" watchObservedRunningTime="2026-07-20 09:59:24.952114138 +0000 UTC m=+154.220103966" Jul 20 09:59:25.941480 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:25.941446 2583 generic.go:356] "Generic (PLEG): container finished" podID="dadf003e-984a-4886-9547-f8512331a6f2" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" exitCode=0 Jul 20 09:59:25.941925 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:25.941527 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerDied","Data":"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae"} Jul 20 09:59:26.294246 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:26.294170 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-798ff6649c-sgjgn"] Jul 20 09:59:26.294383 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:59:26.294371 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" podUID="055af240-f2f1-4a20-8738-7d12bdeaa67a" Jul 20 09:59:26.945084 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:26.945056 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:59:26.952794 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:26.952770 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:59:27.073364 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.073330 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-bound-sa-token\") pod \"055af240-f2f1-4a20-8738-7d12bdeaa67a\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " Jul 20 09:59:27.073536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.073382 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-image-registry-private-configuration\") pod \"055af240-f2f1-4a20-8738-7d12bdeaa67a\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " Jul 20 09:59:27.073536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.073404 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-trusted-ca\") pod \"055af240-f2f1-4a20-8738-7d12bdeaa67a\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " Jul 20 09:59:27.073536 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.073453 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zch5\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-kube-api-access-7zch5\") pod \"055af240-f2f1-4a20-8738-7d12bdeaa67a\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " Jul 20 09:59:27.073706 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.073539 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-installation-pull-secrets\") pod \"055af240-f2f1-4a20-8738-7d12bdeaa67a\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " Jul 20 09:59:27.073706 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.073579 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/055af240-f2f1-4a20-8738-7d12bdeaa67a-ca-trust-extracted\") pod \"055af240-f2f1-4a20-8738-7d12bdeaa67a\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " Jul 20 09:59:27.073706 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.073609 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-certificates\") pod \"055af240-f2f1-4a20-8738-7d12bdeaa67a\" (UID: \"055af240-f2f1-4a20-8738-7d12bdeaa67a\") " Jul 20 09:59:27.074156 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.074112 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "055af240-f2f1-4a20-8738-7d12bdeaa67a" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:59:27.074347 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.074316 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "055af240-f2f1-4a20-8738-7d12bdeaa67a" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 09:59:27.074347 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.074316 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/055af240-f2f1-4a20-8738-7d12bdeaa67a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "055af240-f2f1-4a20-8738-7d12bdeaa67a" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 09:59:27.076528 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.076477 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-kube-api-access-7zch5" (OuterVolumeSpecName: "kube-api-access-7zch5") pod "055af240-f2f1-4a20-8738-7d12bdeaa67a" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a"). InnerVolumeSpecName "kube-api-access-7zch5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:59:27.076528 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.076505 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "055af240-f2f1-4a20-8738-7d12bdeaa67a" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:59:27.076676 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.076578 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "055af240-f2f1-4a20-8738-7d12bdeaa67a" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 09:59:27.076676 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.076541 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "055af240-f2f1-4a20-8738-7d12bdeaa67a" (UID: "055af240-f2f1-4a20-8738-7d12bdeaa67a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 09:59:27.175448 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.175409 2583 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-bound-sa-token\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 09:59:27.175448 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.175448 2583 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-image-registry-private-configuration\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 09:59:27.175644 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.175464 2583 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-trusted-ca\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 09:59:27.175644 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.175479 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zch5\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-kube-api-access-7zch5\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 09:59:27.175644 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.175494 2583 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/055af240-f2f1-4a20-8738-7d12bdeaa67a-installation-pull-secrets\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 09:59:27.175644 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.175508 2583 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/055af240-f2f1-4a20-8738-7d12bdeaa67a-ca-trust-extracted\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 09:59:27.175644 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.175522 2583 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-certificates\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 09:59:27.948896 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.948858 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798ff6649c-sgjgn" Jul 20 09:59:27.988601 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.988568 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-798ff6649c-sgjgn"] Jul 20 09:59:27.995772 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:27.995729 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-798ff6649c-sgjgn"] Jul 20 09:59:28.084443 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:28.084407 2583 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/055af240-f2f1-4a20-8738-7d12bdeaa67a-registry-tls\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 09:59:28.954346 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:28.954318 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerStarted","Data":"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f"} Jul 20 09:59:28.954624 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:28.954432 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerStarted","Data":"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca"} Jul 20 09:59:29.294429 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:29.294396 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="055af240-f2f1-4a20-8738-7d12bdeaa67a" path="/var/lib/kubelet/pods/055af240-f2f1-4a20-8738-7d12bdeaa67a/volumes" Jul 20 09:59:29.603671 ip-10-0-133-245 kubenswrapper[2583]: E0720 09:59:29.603591 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8l5d4" podUID="73c92407-c8f7-4de1-9b2e-ab6c050b9bde" Jul 20 09:59:29.958205 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:29.958175 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8l5d4" Jul 20 09:59:30.965079 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:30.965046 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerStarted","Data":"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b"} Jul 20 09:59:30.965436 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:30.965108 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerStarted","Data":"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826"} Jul 20 09:59:30.965436 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:30.965134 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerStarted","Data":"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c"} Jul 20 09:59:30.965436 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:30.965160 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerStarted","Data":"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2"} Jul 20 09:59:30.997323 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:30.997220 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.713977283 podStartE2EDuration="6.997202552s" totalImagesPullingTime="5.26688547s" totalInitContainerRuntime="16.339799ms" isStatefulPod=false podCreationTimestamp="2026-07-20 09:59:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:30.995774105 +0000 UTC m=+160.263763922" watchObservedRunningTime="2026-07-20 09:59:30.997202552 +0000 UTC m=+160.265192379" Jul 20 09:59:34.493419 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:34.493381 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 09:59:34.544369 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:34.544329 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:59:34.546922 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:34.546894 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/73c92407-c8f7-4de1-9b2e-ab6c050b9bde-metrics-tls\") pod \"dns-default-8l5d4\" (UID: \"73c92407-c8f7-4de1-9b2e-ab6c050b9bde\") " pod="openshift-dns/dns-default-8l5d4" Jul 20 09:59:34.761635 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:34.761550 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-txv2k\"" Jul 20 09:59:34.770171 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:34.770142 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8l5d4" Jul 20 09:59:34.986983 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:34.986955 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8l5d4"] Jul 20 09:59:34.990771 ip-10-0-133-245 kubenswrapper[2583]: W0720 09:59:34.990718 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c92407_c8f7_4de1_9b2e_ab6c050b9bde.slice/crio-7f303956345c86f7cdcc9e516b99d0fef0cf71dc8b8fbfdabc1ae79a68fa9520 WatchSource:0}: Error finding container 7f303956345c86f7cdcc9e516b99d0fef0cf71dc8b8fbfdabc1ae79a68fa9520: Status 404 returned error can't find the container with id 7f303956345c86f7cdcc9e516b99d0fef0cf71dc8b8fbfdabc1ae79a68fa9520 Jul 20 09:59:35.984937 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:35.984896 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8l5d4" event={"ID":"73c92407-c8f7-4de1-9b2e-ab6c050b9bde","Type":"ContainerStarted","Data":"7f303956345c86f7cdcc9e516b99d0fef0cf71dc8b8fbfdabc1ae79a68fa9520"} Jul 20 09:59:36.992575 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:36.992541 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8l5d4" event={"ID":"73c92407-c8f7-4de1-9b2e-ab6c050b9bde","Type":"ContainerStarted","Data":"8f52c1ed451b204e0001ec12c2e2584dce1ce00bf459243be0a44d0f8c212ca1"} Jul 20 09:59:37.997532 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:37.997488 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8l5d4" event={"ID":"73c92407-c8f7-4de1-9b2e-ab6c050b9bde","Type":"ContainerStarted","Data":"7db431b029422e57cd65a5ee7594585e6a1687b88ec6a8ba85f874162a79b64b"} Jul 20 09:59:37.997967 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:37.997611 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8l5d4" Jul 20 09:59:38.036702 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:38.036642 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8l5d4" podStartSLOduration=130.20606909 podStartE2EDuration="2m12.036621343s" totalImagesPullingTime="1.830552253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 09:57:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 09:59:38.036177279 +0000 UTC m=+167.304167109" watchObservedRunningTime="2026-07-20 09:59:38.036621343 +0000 UTC m=+167.304611170" Jul 20 09:59:48.002809 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:48.002698 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8l5d4" Jul 20 09:59:52.772539 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:52.772509 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8l5d4_73c92407-c8f7-4de1-9b2e-ab6c050b9bde/dns/0.log" Jul 20 09:59:52.801159 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:52.801135 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8l5d4_73c92407-c8f7-4de1-9b2e-ab6c050b9bde/kube-rbac-proxy/0.log" Jul 20 09:59:53.314081 ip-10-0-133-245 kubenswrapper[2583]: I0720 09:59:53.314053 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p5hzh_f582d91e-5b7e-4f8f-b849-5f3929c3c4be/dns-node-resolver/0.log" Jul 20 10:00:24.493325 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:24.493288 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:24.512668 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:24.512638 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:25.175446 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:25.175418 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:47.847828 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:47.847793 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:47.848451 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:47.848356 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy" containerID="cri-o://d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" gracePeriod=600 Jul 20 10:00:47.848541 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:47.848421 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="thanos-sidecar" containerID="cri-o://60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" gracePeriod=600 Jul 20 10:00:47.848541 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:47.848358 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="prometheus" containerID="cri-o://ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" gracePeriod=600 Jul 20 10:00:47.848541 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:47.848421 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" gracePeriod=600 Jul 20 10:00:47.848541 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:47.848408 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="config-reloader" containerID="cri-o://bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" gracePeriod=600 Jul 20 10:00:47.848731 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:47.848430 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy-web" containerID="cri-o://850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" gracePeriod=600 Jul 20 10:00:48.102363 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.102301 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.226833 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.226783 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-grpc-tls\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.226833 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.226826 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-1\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.226845 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-tls-assets\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.226867 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-2\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.226891 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-config\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.226908 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-kubelet-serving-ca-bundle\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.226929 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-tls\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.226960 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227025 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-trusted-ca-bundle\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227074 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-thanos-prometheus-http-client-file\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227101 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227103 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-kube-rbac-proxy\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227505 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227129 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-db\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227505 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227156 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227505 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227175 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-web-config\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227505 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227205 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-metrics-client-ca\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227505 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227270 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:48.227505 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227381 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:48.227505 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227444 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:48.227505 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227472 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-serving-certs-ca-bundle\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227899 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227505 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-config-out\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227899 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227729 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-metrics-client-certs\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227899 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227785 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-0\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.227899 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.227819 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxsnb\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-kube-api-access-sxsnb\") pod \"dadf003e-984a-4886-9547-f8512331a6f2\" (UID: \"dadf003e-984a-4886-9547-f8512331a6f2\") " Jul 20 10:00:48.228105 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.228069 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.228228 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.228129 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.228318 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.228244 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.228318 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.228174 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:48.228622 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.228592 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:48.229023 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.228995 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:48.230443 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.230389 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.230638 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.230572 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-config" (OuterVolumeSpecName: "config") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.230638 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.230608 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:48.230904 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.230864 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:48.231287 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.231213 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:00:48.231527 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.231497 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-config-out" (OuterVolumeSpecName: "config-out") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:00:48.231608 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.231520 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.231608 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.231480 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.231686 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.231636 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.231686 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.231648 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.232331 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.232315 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.232623 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.232597 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.232708 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.232659 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-kube-api-access-sxsnb" (OuterVolumeSpecName: "kube-api-access-sxsnb") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "kube-api-access-sxsnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:00:48.240185 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240157 2583 generic.go:356] "Generic (PLEG): container finished" podID="dadf003e-984a-4886-9547-f8512331a6f2" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" exitCode=0 Jul 20 10:00:48.240185 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240183 2583 generic.go:356] "Generic (PLEG): container finished" podID="dadf003e-984a-4886-9547-f8512331a6f2" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" exitCode=0 Jul 20 10:00:48.240185 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240194 2583 generic.go:356] "Generic (PLEG): container finished" podID="dadf003e-984a-4886-9547-f8512331a6f2" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" exitCode=0 Jul 20 10:00:48.240366 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240203 2583 generic.go:356] "Generic (PLEG): container finished" podID="dadf003e-984a-4886-9547-f8512331a6f2" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" exitCode=0 Jul 20 10:00:48.240366 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240212 2583 generic.go:356] "Generic (PLEG): container finished" podID="dadf003e-984a-4886-9547-f8512331a6f2" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" exitCode=0 Jul 20 10:00:48.240366 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240219 2583 generic.go:356] "Generic (PLEG): container finished" podID="dadf003e-984a-4886-9547-f8512331a6f2" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" exitCode=0 Jul 20 10:00:48.240366 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240230 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerDied","Data":"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b"} Jul 20 10:00:48.240366 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240251 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.240366 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240307 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerDied","Data":"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826"} Jul 20 10:00:48.240366 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240335 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerDied","Data":"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c"} Jul 20 10:00:48.240366 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240359 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerDied","Data":"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2"} Jul 20 10:00:48.240656 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240385 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerDied","Data":"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f"} Jul 20 10:00:48.240656 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240395 2583 scope.go:117] "RemoveContainer" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" Jul 20 10:00:48.240656 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240409 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerDied","Data":"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca"} Jul 20 10:00:48.240656 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.240433 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dadf003e-984a-4886-9547-f8512331a6f2","Type":"ContainerDied","Data":"74dce6f45a2a70a0aba08d231c3f532d66c0f51bf3a853b28ca8fde0de5b288e"} Jul 20 10:00:48.243904 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.243866 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-web-config" (OuterVolumeSpecName: "web-config") pod "dadf003e-984a-4886-9547-f8512331a6f2" (UID: "dadf003e-984a-4886-9547-f8512331a6f2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:00:48.247978 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.247962 2583 scope.go:117] "RemoveContainer" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" Jul 20 10:00:48.255197 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.255172 2583 scope.go:117] "RemoveContainer" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" Jul 20 10:00:48.262705 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.262686 2583 scope.go:117] "RemoveContainer" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" Jul 20 10:00:48.269307 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.269282 2583 scope.go:117] "RemoveContainer" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" Jul 20 10:00:48.275675 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.275657 2583 scope.go:117] "RemoveContainer" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" Jul 20 10:00:48.284400 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.284383 2583 scope.go:117] "RemoveContainer" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" Jul 20 10:00:48.290964 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.290943 2583 scope.go:117] "RemoveContainer" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" Jul 20 10:00:48.291239 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:00:48.291217 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": container with ID starting with 6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b not found: ID does not exist" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" Jul 20 10:00:48.291305 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.291251 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b"} err="failed to get container status \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": rpc error: code = NotFound desc = could not find container \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": container with ID starting with 6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b not found: ID does not exist" Jul 20 10:00:48.291305 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.291284 2583 scope.go:117] "RemoveContainer" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" Jul 20 10:00:48.291522 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:00:48.291508 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": container with ID starting with d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826 not found: ID does not exist" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" Jul 20 10:00:48.291577 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.291527 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826"} err="failed to get container status \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": rpc error: code = NotFound desc = could not find container \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": container with ID starting with d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826 not found: ID does not exist" Jul 20 10:00:48.291577 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.291543 2583 scope.go:117] "RemoveContainer" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" Jul 20 10:00:48.291774 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:00:48.291735 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": container with ID starting with 850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c not found: ID does not exist" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" Jul 20 10:00:48.291832 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.291782 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c"} err="failed to get container status \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": rpc error: code = NotFound desc = could not find container \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": container with ID starting with 850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c not found: ID does not exist" Jul 20 10:00:48.291832 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.291806 2583 scope.go:117] "RemoveContainer" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" Jul 20 10:00:48.292042 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:00:48.292023 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": container with ID starting with 60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2 not found: ID does not exist" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" Jul 20 10:00:48.292083 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292046 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2"} err="failed to get container status \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": rpc error: code = NotFound desc = could not find container \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": container with ID starting with 60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2 not found: ID does not exist" Jul 20 10:00:48.292083 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292060 2583 scope.go:117] "RemoveContainer" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" Jul 20 10:00:48.292306 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:00:48.292289 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": container with ID starting with bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f not found: ID does not exist" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" Jul 20 10:00:48.292347 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292310 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f"} err="failed to get container status \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": rpc error: code = NotFound desc = could not find container \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": container with ID starting with bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f not found: ID does not exist" Jul 20 10:00:48.292347 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292324 2583 scope.go:117] "RemoveContainer" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" Jul 20 10:00:48.292558 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:00:48.292540 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": container with ID starting with ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca not found: ID does not exist" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" Jul 20 10:00:48.292600 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292561 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca"} err="failed to get container status \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": rpc error: code = NotFound desc = could not find container \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": container with ID starting with ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca not found: ID does not exist" Jul 20 10:00:48.292600 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292573 2583 scope.go:117] "RemoveContainer" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" Jul 20 10:00:48.292803 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:00:48.292787 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": container with ID starting with c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae not found: ID does not exist" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" Jul 20 10:00:48.292849 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292810 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae"} err="failed to get container status \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": rpc error: code = NotFound desc = could not find container \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": container with ID starting with c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae not found: ID does not exist" Jul 20 10:00:48.292849 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292825 2583 scope.go:117] "RemoveContainer" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" Jul 20 10:00:48.293015 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.292997 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b"} err="failed to get container status \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": rpc error: code = NotFound desc = could not find container \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": container with ID starting with 6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b not found: ID does not exist" Jul 20 10:00:48.293054 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293017 2583 scope.go:117] "RemoveContainer" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" Jul 20 10:00:48.293206 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293186 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826"} err="failed to get container status \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": rpc error: code = NotFound desc = could not find container \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": container with ID starting with d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826 not found: ID does not exist" Jul 20 10:00:48.293246 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293207 2583 scope.go:117] "RemoveContainer" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" Jul 20 10:00:48.293400 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293384 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c"} err="failed to get container status \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": rpc error: code = NotFound desc = could not find container \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": container with ID starting with 850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c not found: ID does not exist" Jul 20 10:00:48.293444 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293398 2583 scope.go:117] "RemoveContainer" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" Jul 20 10:00:48.293596 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293577 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2"} err="failed to get container status \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": rpc error: code = NotFound desc = could not find container \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": container with ID starting with 60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2 not found: ID does not exist" Jul 20 10:00:48.293632 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293597 2583 scope.go:117] "RemoveContainer" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" Jul 20 10:00:48.293901 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293884 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f"} err="failed to get container status \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": rpc error: code = NotFound desc = could not find container \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": container with ID starting with bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f not found: ID does not exist" Jul 20 10:00:48.293956 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.293900 2583 scope.go:117] "RemoveContainer" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" Jul 20 10:00:48.294099 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294081 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca"} err="failed to get container status \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": rpc error: code = NotFound desc = could not find container \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": container with ID starting with ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca not found: ID does not exist" Jul 20 10:00:48.294146 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294100 2583 scope.go:117] "RemoveContainer" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" Jul 20 10:00:48.294286 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294271 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae"} err="failed to get container status \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": rpc error: code = NotFound desc = could not find container \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": container with ID starting with c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae not found: ID does not exist" Jul 20 10:00:48.294324 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294286 2583 scope.go:117] "RemoveContainer" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" Jul 20 10:00:48.294462 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294447 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b"} err="failed to get container status \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": rpc error: code = NotFound desc = could not find container \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": container with ID starting with 6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b not found: ID does not exist" Jul 20 10:00:48.294507 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294462 2583 scope.go:117] "RemoveContainer" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" Jul 20 10:00:48.294650 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294635 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826"} err="failed to get container status \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": rpc error: code = NotFound desc = could not find container \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": container with ID starting with d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826 not found: ID does not exist" Jul 20 10:00:48.294690 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294650 2583 scope.go:117] "RemoveContainer" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" Jul 20 10:00:48.294848 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294833 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c"} err="failed to get container status \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": rpc error: code = NotFound desc = could not find container \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": container with ID starting with 850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c not found: ID does not exist" Jul 20 10:00:48.294893 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.294848 2583 scope.go:117] "RemoveContainer" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" Jul 20 10:00:48.295043 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295026 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2"} err="failed to get container status \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": rpc error: code = NotFound desc = could not find container \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": container with ID starting with 60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2 not found: ID does not exist" Jul 20 10:00:48.295091 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295046 2583 scope.go:117] "RemoveContainer" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" Jul 20 10:00:48.295225 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295210 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f"} err="failed to get container status \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": rpc error: code = NotFound desc = could not find container \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": container with ID starting with bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f not found: ID does not exist" Jul 20 10:00:48.295275 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295225 2583 scope.go:117] "RemoveContainer" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" Jul 20 10:00:48.295405 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295391 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca"} err="failed to get container status \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": rpc error: code = NotFound desc = could not find container \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": container with ID starting with ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca not found: ID does not exist" Jul 20 10:00:48.295451 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295412 2583 scope.go:117] "RemoveContainer" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" Jul 20 10:00:48.295587 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295572 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae"} err="failed to get container status \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": rpc error: code = NotFound desc = could not find container \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": container with ID starting with c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae not found: ID does not exist" Jul 20 10:00:48.295587 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295587 2583 scope.go:117] "RemoveContainer" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" Jul 20 10:00:48.295777 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295737 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b"} err="failed to get container status \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": rpc error: code = NotFound desc = could not find container \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": container with ID starting with 6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b not found: ID does not exist" Jul 20 10:00:48.295852 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295780 2583 scope.go:117] "RemoveContainer" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" Jul 20 10:00:48.295992 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295968 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826"} err="failed to get container status \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": rpc error: code = NotFound desc = could not find container \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": container with ID starting with d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826 not found: ID does not exist" Jul 20 10:00:48.296038 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.295993 2583 scope.go:117] "RemoveContainer" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" Jul 20 10:00:48.296182 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.296163 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c"} err="failed to get container status \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": rpc error: code = NotFound desc = could not find container \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": container with ID starting with 850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c not found: ID does not exist" Jul 20 10:00:48.296224 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.296182 2583 scope.go:117] "RemoveContainer" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" Jul 20 10:00:48.296407 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.296390 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2"} err="failed to get container status \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": rpc error: code = NotFound desc = could not find container \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": container with ID starting with 60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2 not found: ID does not exist" Jul 20 10:00:48.296471 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.296409 2583 scope.go:117] "RemoveContainer" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" Jul 20 10:00:48.296641 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.296624 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f"} err="failed to get container status \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": rpc error: code = NotFound desc = could not find container \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": container with ID starting with bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f not found: ID does not exist" Jul 20 10:00:48.296691 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.296642 2583 scope.go:117] "RemoveContainer" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" Jul 20 10:00:48.296860 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.296843 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca"} err="failed to get container status \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": rpc error: code = NotFound desc = could not find container \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": container with ID starting with ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca not found: ID does not exist" Jul 20 10:00:48.296916 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.296861 2583 scope.go:117] "RemoveContainer" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" Jul 20 10:00:48.297026 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297012 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae"} err="failed to get container status \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": rpc error: code = NotFound desc = could not find container \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": container with ID starting with c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae not found: ID does not exist" Jul 20 10:00:48.297071 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297027 2583 scope.go:117] "RemoveContainer" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" Jul 20 10:00:48.297238 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297219 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b"} err="failed to get container status \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": rpc error: code = NotFound desc = could not find container \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": container with ID starting with 6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b not found: ID does not exist" Jul 20 10:00:48.297309 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297239 2583 scope.go:117] "RemoveContainer" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" Jul 20 10:00:48.297431 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297415 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826"} err="failed to get container status \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": rpc error: code = NotFound desc = could not find container \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": container with ID starting with d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826 not found: ID does not exist" Jul 20 10:00:48.297491 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297432 2583 scope.go:117] "RemoveContainer" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" Jul 20 10:00:48.297651 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297631 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c"} err="failed to get container status \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": rpc error: code = NotFound desc = could not find container \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": container with ID starting with 850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c not found: ID does not exist" Jul 20 10:00:48.297694 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297652 2583 scope.go:117] "RemoveContainer" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" Jul 20 10:00:48.297894 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297878 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2"} err="failed to get container status \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": rpc error: code = NotFound desc = could not find container \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": container with ID starting with 60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2 not found: ID does not exist" Jul 20 10:00:48.297968 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.297895 2583 scope.go:117] "RemoveContainer" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" Jul 20 10:00:48.298106 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298090 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f"} err="failed to get container status \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": rpc error: code = NotFound desc = could not find container \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": container with ID starting with bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f not found: ID does not exist" Jul 20 10:00:48.298150 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298107 2583 scope.go:117] "RemoveContainer" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" Jul 20 10:00:48.298298 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298281 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca"} err="failed to get container status \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": rpc error: code = NotFound desc = could not find container \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": container with ID starting with ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca not found: ID does not exist" Jul 20 10:00:48.298372 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298299 2583 scope.go:117] "RemoveContainer" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" Jul 20 10:00:48.298498 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298478 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae"} err="failed to get container status \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": rpc error: code = NotFound desc = could not find container \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": container with ID starting with c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae not found: ID does not exist" Jul 20 10:00:48.298543 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298500 2583 scope.go:117] "RemoveContainer" containerID="6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b" Jul 20 10:00:48.298692 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298673 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b"} err="failed to get container status \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": rpc error: code = NotFound desc = could not find container \"6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b\": container with ID starting with 6bd456aef2995abd8a5a3c244b8622fafaf575499853890a3c88fbc4f4d3f62b not found: ID does not exist" Jul 20 10:00:48.298784 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298694 2583 scope.go:117] "RemoveContainer" containerID="d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826" Jul 20 10:00:48.298902 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298885 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826"} err="failed to get container status \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": rpc error: code = NotFound desc = could not find container \"d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826\": container with ID starting with d65e802f2e88d9e6adf5eb2c98a0c04399f952030b131776e46f56a89f2ac826 not found: ID does not exist" Jul 20 10:00:48.298970 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.298903 2583 scope.go:117] "RemoveContainer" containerID="850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c" Jul 20 10:00:48.299110 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299093 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c"} err="failed to get container status \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": rpc error: code = NotFound desc = could not find container \"850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c\": container with ID starting with 850d3f9e36a1b875d372d9b1dc0c9a818a3474b81e7e43fe7536dc7d945e8a5c not found: ID does not exist" Jul 20 10:00:48.299157 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299112 2583 scope.go:117] "RemoveContainer" containerID="60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2" Jul 20 10:00:48.299337 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299321 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2"} err="failed to get container status \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": rpc error: code = NotFound desc = could not find container \"60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2\": container with ID starting with 60ff4632aff7c1dba14be928d6c643ee0a88e557265b208c56fd2c87516335f2 not found: ID does not exist" Jul 20 10:00:48.299378 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299338 2583 scope.go:117] "RemoveContainer" containerID="bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f" Jul 20 10:00:48.299558 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299542 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f"} err="failed to get container status \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": rpc error: code = NotFound desc = could not find container \"bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f\": container with ID starting with bacbbaff751fdd8c6caa422b3af120986b6dbb9a6e85223e0dd43e9f47981d7f not found: ID does not exist" Jul 20 10:00:48.299627 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299559 2583 scope.go:117] "RemoveContainer" containerID="ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca" Jul 20 10:00:48.299810 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299784 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca"} err="failed to get container status \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": rpc error: code = NotFound desc = could not find container \"ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca\": container with ID starting with ce054cf150a576aa969e7e192c2694b10bf4f9d028b1d5dfc7f0cd5dfea8e8ca not found: ID does not exist" Jul 20 10:00:48.299854 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299812 2583 scope.go:117] "RemoveContainer" containerID="c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae" Jul 20 10:00:48.300011 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.299994 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae"} err="failed to get container status \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": rpc error: code = NotFound desc = could not find container \"c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae\": container with ID starting with c0c76fcee83d9e48f1d615c4bb23f0911453ba18852d8b32974ad2760e8371ae not found: ID does not exist" Jul 20 10:00:48.329421 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329385 2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-config\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329421 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329417 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329433 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329447 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329458 2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329469 2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-kube-rbac-proxy\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329481 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-db\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329492 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329528 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-web-config\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329544 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-metrics-client-ca\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329556 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329569 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dadf003e-984a-4886-9547-f8512331a6f2-config-out\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329584 2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-metrics-client-certs\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329597 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dadf003e-984a-4886-9547-f8512331a6f2-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329610 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxsnb\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-kube-api-access-sxsnb\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329624 2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dadf003e-984a-4886-9547-f8512331a6f2-secret-grpc-tls\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.329629 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.329636 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dadf003e-984a-4886-9547-f8512331a6f2-tls-assets\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:00:48.564721 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.564683 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:48.568796 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.568771 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:48.594083 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594057 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:48.594323 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594309 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="init-config-reloader" Jul 20 10:00:48.594362 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594325 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="init-config-reloader" Jul 20 10:00:48.594362 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594334 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="config-reloader" Jul 20 10:00:48.594362 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594339 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="config-reloader" Jul 20 10:00:48.594362 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594345 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy" Jul 20 10:00:48.594362 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594350 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy" Jul 20 10:00:48.594362 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594356 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:48.594362 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594361 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594368 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="thanos-sidecar" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594373 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="thanos-sidecar" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594379 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy-web" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594384 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy-web" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594400 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="prometheus" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594405 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="prometheus" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594442 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594450 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="thanos-sidecar" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594456 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="config-reloader" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594461 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="prometheus" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594466 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy-web" Jul 20 10:00:48.594557 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.594471 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="dadf003e-984a-4886-9547-f8512331a6f2" containerName="kube-rbac-proxy-thanos" Jul 20 10:00:48.599116 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.599099 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.600931 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.600912 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 20 10:00:48.601473 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601451 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-h8944\"" Jul 20 10:00:48.601473 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601458 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 20 10:00:48.601638 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601512 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 20 10:00:48.601638 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601512 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2vtktqclc787t\"" Jul 20 10:00:48.601638 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601542 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 20 10:00:48.602036 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601905 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 20 10:00:48.602036 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601910 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 20 10:00:48.602036 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601962 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 20 10:00:48.602036 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.601975 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 20 10:00:48.602307 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.602294 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 20 10:00:48.602365 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.602336 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 20 10:00:48.602423 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.602337 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 20 10:00:48.602615 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.602599 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 20 10:00:48.602888 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.602876 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 20 10:00:48.605547 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.605504 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 20 10:00:48.608193 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.608174 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 20 10:00:48.617972 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.617954 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:48.731769 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.731720 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.731944 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.731776 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.731944 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.731819 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.731944 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.731863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.731944 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.731888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llnrm\" (UniqueName: \"kubernetes.io/projected/2a669f9b-4942-407e-a5db-2b4a74849170-kube-api-access-llnrm\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.731944 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.731917 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-config\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732120 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.731967 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a669f9b-4942-407e-a5db-2b4a74849170-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732120 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732001 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732120 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732024 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732120 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732048 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732120 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732074 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732271 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732117 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732271 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732143 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732271 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732163 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732271 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732187 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a669f9b-4942-407e-a5db-2b4a74849170-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732271 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732211 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732271 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732238 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732271 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732255 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732271 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732269 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.732526 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.732284 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833140 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833050 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833140 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833089 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833140 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833152 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833169 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llnrm\" (UniqueName: \"kubernetes.io/projected/2a669f9b-4942-407e-a5db-2b4a74849170-kube-api-access-llnrm\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-config\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833234 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a669f9b-4942-407e-a5db-2b4a74849170-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833263 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833287 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833347 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833404 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833402 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833932 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833932 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833461 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a669f9b-4942-407e-a5db-2b4a74849170-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833932 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833496 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833932 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833527 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833932 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833554 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833932 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833579 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.833932 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.833606 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.834503 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.834316 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.836613 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.834768 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.836613 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.834834 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.836613 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.835372 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.836613 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.835932 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.836613 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.836520 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.836613 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.836539 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.836993 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.836953 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2a669f9b-4942-407e-a5db-2b4a74849170-config-out\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.836993 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.836958 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-config\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.837565 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.837537 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.837727 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.837701 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/2a669f9b-4942-407e-a5db-2b4a74849170-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.838296 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.838268 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.838371 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.838354 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-web-config\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.838418 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.838386 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.839111 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.839055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2a669f9b-4942-407e-a5db-2b4a74849170-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.839197 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.839142 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.839459 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.839427 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.839459 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.839442 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.839808 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.839789 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/2a669f9b-4942-407e-a5db-2b4a74849170-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.841156 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.841136 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llnrm\" (UniqueName: \"kubernetes.io/projected/2a669f9b-4942-407e-a5db-2b4a74849170-kube-api-access-llnrm\") pod \"prometheus-k8s-0\" (UID: \"2a669f9b-4942-407e-a5db-2b4a74849170\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:48.909648 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:48.909609 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:00:49.082529 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:49.082501 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 20 10:00:49.086321 ip-10-0-133-245 kubenswrapper[2583]: W0720 10:00:49.086294 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a669f9b_4942_407e_a5db_2b4a74849170.slice/crio-b8472a565e54759e4a07c3c99587203ee7c194c4b4ca327b07a8e19227502613 WatchSource:0}: Error finding container b8472a565e54759e4a07c3c99587203ee7c194c4b4ca327b07a8e19227502613: Status 404 returned error can't find the container with id b8472a565e54759e4a07c3c99587203ee7c194c4b4ca327b07a8e19227502613 Jul 20 10:00:49.245496 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:49.245454 2583 generic.go:356] "Generic (PLEG): container finished" podID="2a669f9b-4942-407e-a5db-2b4a74849170" containerID="b09602728001e2ec0bccd927fb465e6cc5e7ef0d8b3bc8967069c934f37c9b94" exitCode=0 Jul 20 10:00:49.245693 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:49.245512 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a669f9b-4942-407e-a5db-2b4a74849170","Type":"ContainerDied","Data":"b09602728001e2ec0bccd927fb465e6cc5e7ef0d8b3bc8967069c934f37c9b94"} Jul 20 10:00:49.245693 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:49.245563 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a669f9b-4942-407e-a5db-2b4a74849170","Type":"ContainerStarted","Data":"b8472a565e54759e4a07c3c99587203ee7c194c4b4ca327b07a8e19227502613"} Jul 20 10:00:49.294734 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:49.294660 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dadf003e-984a-4886-9547-f8512331a6f2" path="/var/lib/kubelet/pods/dadf003e-984a-4886-9547-f8512331a6f2/volumes" Jul 20 10:00:50.252879 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:50.252838 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a669f9b-4942-407e-a5db-2b4a74849170","Type":"ContainerStarted","Data":"ab09559edeb20a62b742266f3d315f1146605fe4c670e13f9944578eade856bc"} Jul 20 10:00:50.253301 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:50.252960 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a669f9b-4942-407e-a5db-2b4a74849170","Type":"ContainerStarted","Data":"495205b7d3298fff96146223d0fb66e9c5c29ad24835d4d9d8ba0e96d8e9076f"} Jul 20 10:00:50.253301 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:50.253002 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a669f9b-4942-407e-a5db-2b4a74849170","Type":"ContainerStarted","Data":"0066ac38fe2eec759c4877d63567ac8b544871ee5f08bd45c8ef695355dbcf16"} Jul 20 10:00:50.253301 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:50.253038 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a669f9b-4942-407e-a5db-2b4a74849170","Type":"ContainerStarted","Data":"d44304ae8ee6f3787bf9dbd67c444182c5e9c350364a89bd47765a94bef733d2"} Jul 20 10:00:50.253301 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:50.253071 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a669f9b-4942-407e-a5db-2b4a74849170","Type":"ContainerStarted","Data":"9c27e94026a1566409bd8344b370f685982fe7427255731367acd2a0b37511b5"} Jul 20 10:00:50.253301 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:50.253106 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"2a669f9b-4942-407e-a5db-2b4a74849170","Type":"ContainerStarted","Data":"374db96487921cb2e4f22433f96f1b0c5c39dbf024189e893127e58dabbfc99d"} Jul 20 10:00:50.286168 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:50.286106 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.262901193 podStartE2EDuration="2.286088426s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.187233ms" isStatefulPod=false podCreationTimestamp="2026-07-20 10:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:00:50.284505636 +0000 UTC m=+239.552495461" watchObservedRunningTime="2026-07-20 10:00:50.286088426 +0000 UTC m=+239.554078254" Jul 20 10:00:53.910338 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:00:53.910284 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:48.910730 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:01:48.910693 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:48.926619 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:01:48.926595 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:49.470564 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:01:49.470537 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 20 10:01:51.169893 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:01:51.169853 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 20 10:07:29.638019 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.637987 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-sl9sl"] Jul 20 10:07:29.640983 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.640967 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sl9sl" Jul 20 10:07:29.643220 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.643199 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-89b4t\"" Jul 20 10:07:29.643592 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.643576 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 20 10:07:29.644071 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.644047 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 20 10:07:29.644167 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.644155 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 20 10:07:29.650158 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.650138 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-sl9sl"] Jul 20 10:07:29.775151 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.775111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-model-cache\") pod \"s3-init-sl9sl\" (UID: \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\") " pod="kserve/s3-init-sl9sl" Jul 20 10:07:29.775319 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.775201 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6kgj\" (UniqueName: \"kubernetes.io/projected/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-kube-api-access-b6kgj\") pod \"s3-init-sl9sl\" (UID: \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\") " pod="kserve/s3-init-sl9sl" Jul 20 10:07:29.875968 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.875935 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6kgj\" (UniqueName: \"kubernetes.io/projected/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-kube-api-access-b6kgj\") pod \"s3-init-sl9sl\" (UID: \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\") " pod="kserve/s3-init-sl9sl" Jul 20 10:07:29.876128 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.876010 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-model-cache\") pod \"s3-init-sl9sl\" (UID: \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\") " pod="kserve/s3-init-sl9sl" Jul 20 10:07:29.876379 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.876361 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-model-cache\") pod \"s3-init-sl9sl\" (UID: \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\") " pod="kserve/s3-init-sl9sl" Jul 20 10:07:29.884646 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.884616 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6kgj\" (UniqueName: \"kubernetes.io/projected/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-kube-api-access-b6kgj\") pod \"s3-init-sl9sl\" (UID: \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\") " pod="kserve/s3-init-sl9sl" Jul 20 10:07:29.949900 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:29.949867 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sl9sl" Jul 20 10:07:30.079256 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:30.079183 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-sl9sl"] Jul 20 10:07:30.082067 ip-10-0-133-245 kubenswrapper[2583]: W0720 10:07:30.082036 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d8f686c_8e6e_4b22_9eed_1e441c4b3d48.slice/crio-fa737334fae3d58e344831046f7404471b5cfca7391a1a7f8d115ad889ddddf8 WatchSource:0}: Error finding container fa737334fae3d58e344831046f7404471b5cfca7391a1a7f8d115ad889ddddf8: Status 404 returned error can't find the container with id fa737334fae3d58e344831046f7404471b5cfca7391a1a7f8d115ad889ddddf8 Jul 20 10:07:30.083836 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:30.083821 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 10:07:30.617977 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:30.617930 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sl9sl" event={"ID":"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48","Type":"ContainerStarted","Data":"fa737334fae3d58e344831046f7404471b5cfca7391a1a7f8d115ad889ddddf8"} Jul 20 10:07:33.630027 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:33.629995 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sl9sl" event={"ID":"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48","Type":"ContainerStarted","Data":"1a52a6586fdcedff199f6ecac5277048bb7405cb4674d8ef6b5a2431a737846c"} Jul 20 10:07:35.639035 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:35.638990 2583 generic.go:356] "Generic (PLEG): container finished" podID="1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" containerID="1a52a6586fdcedff199f6ecac5277048bb7405cb4674d8ef6b5a2431a737846c" exitCode=0 Jul 20 10:07:35.639420 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:35.639059 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sl9sl" event={"ID":"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48","Type":"ContainerDied","Data":"1a52a6586fdcedff199f6ecac5277048bb7405cb4674d8ef6b5a2431a737846c"} Jul 20 10:07:40.660742 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:40.660707 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sl9sl" event={"ID":"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48","Type":"ContainerStarted","Data":"8cb9a57c5c7a3fc357686d37cff847951e3b649ee59640f5fb9793714cc9b000"} Jul 20 10:07:40.677955 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:07:40.677902 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-sl9sl" podStartSLOduration=2.597124477 podStartE2EDuration="11.677885374s" totalImagesPullingTime="7.843619098s" totalInitContainerRuntime="1.237141799s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:07:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:07:40.67687889 +0000 UTC m=+649.944868717" watchObservedRunningTime="2026-07-20 10:07:40.677885374 +0000 UTC m=+649.945875201" Jul 20 10:08:45.885198 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:45.885159 2583 generic.go:356] "Generic (PLEG): container finished" podID="1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" containerID="8cb9a57c5c7a3fc357686d37cff847951e3b649ee59640f5fb9793714cc9b000" exitCode=0 Jul 20 10:08:45.885610 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:45.885213 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sl9sl" event={"ID":"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48","Type":"ContainerDied","Data":"8cb9a57c5c7a3fc357686d37cff847951e3b649ee59640f5fb9793714cc9b000"} Jul 20 10:08:47.017569 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.017546 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sl9sl" Jul 20 10:08:47.188615 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.188580 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-model-cache\") pod \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\" (UID: \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\") " Jul 20 10:08:47.188804 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.188628 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6kgj\" (UniqueName: \"kubernetes.io/projected/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-kube-api-access-b6kgj\") pod \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\" (UID: \"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48\") " Jul 20 10:08:47.191019 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.190976 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-kube-api-access-b6kgj" (OuterVolumeSpecName: "kube-api-access-b6kgj") pod "1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" (UID: "1d8f686c-8e6e-4b22-9eed-1e441c4b3d48"). InnerVolumeSpecName "kube-api-access-b6kgj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:08:47.208080 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.208049 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" (UID: "1d8f686c-8e6e-4b22-9eed-1e441c4b3d48"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:08:47.289792 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.289737 2583 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-model-cache\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:08:47.289792 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.289791 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6kgj\" (UniqueName: \"kubernetes.io/projected/1d8f686c-8e6e-4b22-9eed-1e441c4b3d48-kube-api-access-b6kgj\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:08:47.893624 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.893591 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-sl9sl" event={"ID":"1d8f686c-8e6e-4b22-9eed-1e441c4b3d48","Type":"ContainerDied","Data":"fa737334fae3d58e344831046f7404471b5cfca7391a1a7f8d115ad889ddddf8"} Jul 20 10:08:47.893787 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.893633 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa737334fae3d58e344831046f7404471b5cfca7391a1a7f8d115ad889ddddf8" Jul 20 10:08:47.893787 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:08:47.893603 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-sl9sl" Jul 20 10:09:01.510787 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.510734 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2"] Jul 20 10:09:01.511168 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.511016 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" containerName="download-hf-model" Jul 20 10:09:01.511168 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.511028 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" containerName="download-hf-model" Jul 20 10:09:01.511168 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.511049 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" containerName="s3-init" Jul 20 10:09:01.511168 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.511055 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" containerName="s3-init" Jul 20 10:09:01.511168 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.511096 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d8f686c-8e6e-4b22-9eed-1e441c4b3d48" containerName="s3-init" Jul 20 10:09:01.514280 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.514263 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.517206 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.517186 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 20 10:09:01.517327 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.517304 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 20 10:09:01.517327 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.517316 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 20 10:09:01.517690 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.517671 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 20 10:09:01.517812 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.517722 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-npdx9\"" Jul 20 10:09:01.517896 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.517832 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 20 10:09:01.517992 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.517970 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 20 10:09:01.529898 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.529868 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2"] Jul 20 10:09:01.593654 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.593614 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7484\" (UniqueName: \"kubernetes.io/projected/195ca154-8722-4be5-bf3f-faafda88d097-kube-api-access-h7484\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.593863 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.593673 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/195ca154-8722-4be5-bf3f-faafda88d097-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.593863 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.593743 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.593863 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.593800 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.593997 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.593876 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/195ca154-8722-4be5-bf3f-faafda88d097-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.694448 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.694410 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.694448 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.694448 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.694683 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.694489 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/195ca154-8722-4be5-bf3f-faafda88d097-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.694683 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.694512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7484\" (UniqueName: \"kubernetes.io/projected/195ca154-8722-4be5-bf3f-faafda88d097-kube-api-access-h7484\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.694683 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.694551 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/195ca154-8722-4be5-bf3f-faafda88d097-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.694987 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.694962 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/195ca154-8722-4be5-bf3f-faafda88d097-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.695182 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.695160 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.695252 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.695202 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.697082 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.697060 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/195ca154-8722-4be5-bf3f-faafda88d097-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.703131 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.703108 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7484\" (UniqueName: \"kubernetes.io/projected/195ca154-8722-4be5-bf3f-faafda88d097-kube-api-access-h7484\") pod \"isvc-xgboost-graph-predictor-555fc69d56-ldfq2\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.805406 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.805335 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp"] Jul 20 10:09:01.808827 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.808809 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.811486 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.811465 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Jul 20 10:09:01.811656 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.811643 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Jul 20 10:09:01.819630 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.819604 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp"] Jul 20 10:09:01.824347 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.824327 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:01.896201 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.896164 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/878bcff2-8ba5-4aa6-b489-6e28977a959d-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.896201 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.896212 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/878bcff2-8ba5-4aa6-b489-6e28977a959d-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.896498 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.896266 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfdw8\" (UniqueName: \"kubernetes.io/projected/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-api-access-gfdw8\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.896498 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.896289 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.896498 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.896323 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.956285 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.956255 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2"] Jul 20 10:09:01.959495 ip-10-0-133-245 kubenswrapper[2583]: W0720 10:09:01.959469 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod195ca154_8722_4be5_bf3f_faafda88d097.slice/crio-96392853ce414930833554bd597d956401b9ed43869cb0a8bdb2f7db6d318049 WatchSource:0}: Error finding container 96392853ce414930833554bd597d956401b9ed43869cb0a8bdb2f7db6d318049: Status 404 returned error can't find the container with id 96392853ce414930833554bd597d956401b9ed43869cb0a8bdb2f7db6d318049 Jul 20 10:09:01.997054 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.997027 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.997180 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.997083 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/878bcff2-8ba5-4aa6-b489-6e28977a959d-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.997180 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.997105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/878bcff2-8ba5-4aa6-b489-6e28977a959d-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.997180 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.997149 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfdw8\" (UniqueName: \"kubernetes.io/projected/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-api-access-gfdw8\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.997180 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.997177 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.997506 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.997483 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/878bcff2-8ba5-4aa6-b489-6e28977a959d-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.997734 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.997710 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.997853 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.997834 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:01.999763 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:01.999724 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/878bcff2-8ba5-4aa6-b489-6e28977a959d-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:02.004596 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:02.004574 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfdw8\" (UniqueName: \"kubernetes.io/projected/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-api-access-gfdw8\") pod \"isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:02.119539 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:02.119453 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:02.256040 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:02.256004 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp"] Jul 20 10:09:02.259411 ip-10-0-133-245 kubenswrapper[2583]: W0720 10:09:02.259374 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod878bcff2_8ba5_4aa6_b489_6e28977a959d.slice/crio-b0e2759ea40aec2a379b0069cb03995a2566307947b7b73cdcccb906e959d8f7 WatchSource:0}: Error finding container b0e2759ea40aec2a379b0069cb03995a2566307947b7b73cdcccb906e959d8f7: Status 404 returned error can't find the container with id b0e2759ea40aec2a379b0069cb03995a2566307947b7b73cdcccb906e959d8f7 Jul 20 10:09:02.949132 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:02.949091 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" event={"ID":"878bcff2-8ba5-4aa6-b489-6e28977a959d","Type":"ContainerStarted","Data":"a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120"} Jul 20 10:09:02.949622 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:02.949159 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" event={"ID":"878bcff2-8ba5-4aa6-b489-6e28977a959d","Type":"ContainerStarted","Data":"b0e2759ea40aec2a379b0069cb03995a2566307947b7b73cdcccb906e959d8f7"} Jul 20 10:09:02.950462 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:02.950436 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" event={"ID":"195ca154-8722-4be5-bf3f-faafda88d097","Type":"ContainerStarted","Data":"47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24"} Jul 20 10:09:02.950547 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:02.950497 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" event={"ID":"195ca154-8722-4be5-bf3f-faafda88d097","Type":"ContainerStarted","Data":"96392853ce414930833554bd597d956401b9ed43869cb0a8bdb2f7db6d318049"} Jul 20 10:09:05.968073 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:05.968027 2583 generic.go:356] "Generic (PLEG): container finished" podID="195ca154-8722-4be5-bf3f-faafda88d097" containerID="47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24" exitCode=0 Jul 20 10:09:05.968524 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:05.968119 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" event={"ID":"195ca154-8722-4be5-bf3f-faafda88d097","Type":"ContainerDied","Data":"47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24"} Jul 20 10:09:05.969737 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:05.969719 2583 generic.go:356] "Generic (PLEG): container finished" podID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerID="a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120" exitCode=0 Jul 20 10:09:05.969834 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:05.969779 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" event={"ID":"878bcff2-8ba5-4aa6-b489-6e28977a959d","Type":"ContainerDied","Data":"a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120"} Jul 20 10:09:30.091596 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:30.091526 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" event={"ID":"878bcff2-8ba5-4aa6-b489-6e28977a959d","Type":"ContainerStarted","Data":"6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08"} Jul 20 10:09:31.100300 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:31.100262 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" event={"ID":"195ca154-8722-4be5-bf3f-faafda88d097","Type":"ContainerStarted","Data":"a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459"} Jul 20 10:09:34.114213 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:34.114161 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" event={"ID":"878bcff2-8ba5-4aa6-b489-6e28977a959d","Type":"ContainerStarted","Data":"5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc"} Jul 20 10:09:34.114692 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:34.114244 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:34.114692 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:34.114460 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:34.117648 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:34.117587 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:09:34.119123 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:34.119100 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" event={"ID":"195ca154-8722-4be5-bf3f-faafda88d097","Type":"ContainerStarted","Data":"299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e"} Jul 20 10:09:34.119262 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:34.119247 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:34.136600 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:34.136552 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podStartSLOduration=2.642971939 podStartE2EDuration="33.136534174s" totalImagesPullingTime="26.898604525s" totalInitContainerRuntime="3.59495771s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:09:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:09:34.135445133 +0000 UTC m=+763.403434958" watchObservedRunningTime="2026-07-20 10:09:34.136534174 +0000 UTC m=+763.404524011" Jul 20 10:09:34.154199 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:34.154144 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podStartSLOduration=2.4669962979999998 podStartE2EDuration="33.154129336s" totalImagesPullingTime="27.044906924s" totalInitContainerRuntime="3.642226114s" isStatefulPod=false podCreationTimestamp="2026-07-20 10:09:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:09:34.152981537 +0000 UTC m=+763.420971362" watchObservedRunningTime="2026-07-20 10:09:34.154129336 +0000 UTC m=+763.422119162" Jul 20 10:09:35.123378 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:35.123332 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:09:35.123916 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:35.123561 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:35.124673 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:35.124642 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.17:8080: connect: connection refused" Jul 20 10:09:36.127055 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:36.127019 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.17:8080: connect: connection refused" Jul 20 10:09:40.128596 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:40.128568 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:09:40.129098 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:40.129071 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:09:41.132009 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:41.131976 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:09:41.132413 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:41.132386 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.17:8080: connect: connection refused" Jul 20 10:09:50.129918 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:50.129873 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:09:51.132889 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:09:51.132852 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.17:8080: connect: connection refused" Jul 20 10:10:00.129908 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:00.129860 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:10:01.132554 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:01.132512 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.17:8080: connect: connection refused" Jul 20 10:10:10.129367 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:10.129320 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:10:11.132683 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:11.132640 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.17:8080: connect: connection refused" Jul 20 10:10:20.130031 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:20.129950 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:10:21.132487 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:21.132451 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.17:8080: connect: connection refused" Jul 20 10:10:30.129621 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:30.129578 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:10:31.132915 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:31.132888 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:10:40.129845 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:40.129806 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.18:8080: connect: connection refused" Jul 20 10:10:50.129630 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:10:50.129599 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:11:21.465400 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:21.465362 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2"] Jul 20 10:11:21.465961 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:21.465583 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" containerID="cri-o://a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459" gracePeriod=30 Jul 20 10:11:21.465961 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:21.465624 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kube-rbac-proxy" containerID="cri-o://299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e" gracePeriod=30 Jul 20 10:11:21.566297 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:21.566260 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp"] Jul 20 10:11:21.566520 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:21.566483 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" containerID="cri-o://6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08" gracePeriod=30 Jul 20 10:11:21.566610 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:21.566529 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kube-rbac-proxy" containerID="cri-o://5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc" gracePeriod=30 Jul 20 10:11:22.519174 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:22.519134 2583 generic.go:356] "Generic (PLEG): container finished" podID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerID="5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc" exitCode=2 Jul 20 10:11:22.519588 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:22.519214 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" event={"ID":"878bcff2-8ba5-4aa6-b489-6e28977a959d","Type":"ContainerDied","Data":"5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc"} Jul 20 10:11:22.521192 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:22.521172 2583 generic.go:356] "Generic (PLEG): container finished" podID="195ca154-8722-4be5-bf3f-faafda88d097" containerID="299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e" exitCode=2 Jul 20 10:11:22.521281 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:22.521234 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" event={"ID":"195ca154-8722-4be5-bf3f-faafda88d097","Type":"ContainerDied","Data":"299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e"} Jul 20 10:11:25.123997 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.123956 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.18:8643/healthz\": dial tcp 10.132.0.18:8643: connect: connection refused" Jul 20 10:11:25.204095 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.204070 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:11:25.303019 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.302984 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/195ca154-8722-4be5-bf3f-faafda88d097-proxy-tls\") pod \"195ca154-8722-4be5-bf3f-faafda88d097\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " Jul 20 10:11:25.303202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.303033 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-cabundle-cert\") pod \"195ca154-8722-4be5-bf3f-faafda88d097\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " Jul 20 10:11:25.303202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.303057 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7484\" (UniqueName: \"kubernetes.io/projected/195ca154-8722-4be5-bf3f-faafda88d097-kube-api-access-h7484\") pod \"195ca154-8722-4be5-bf3f-faafda88d097\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " Jul 20 10:11:25.303202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.303086 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/195ca154-8722-4be5-bf3f-faafda88d097-kserve-provision-location\") pod \"195ca154-8722-4be5-bf3f-faafda88d097\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " Jul 20 10:11:25.303202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.303116 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-kube-rbac-proxy-sar-config\") pod \"195ca154-8722-4be5-bf3f-faafda88d097\" (UID: \"195ca154-8722-4be5-bf3f-faafda88d097\") " Jul 20 10:11:25.303406 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.303342 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "195ca154-8722-4be5-bf3f-faafda88d097" (UID: "195ca154-8722-4be5-bf3f-faafda88d097"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:11:25.303452 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.303427 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/195ca154-8722-4be5-bf3f-faafda88d097-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "195ca154-8722-4be5-bf3f-faafda88d097" (UID: "195ca154-8722-4be5-bf3f-faafda88d097"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:11:25.303547 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.303524 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "195ca154-8722-4be5-bf3f-faafda88d097" (UID: "195ca154-8722-4be5-bf3f-faafda88d097"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:11:25.305321 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.305300 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/195ca154-8722-4be5-bf3f-faafda88d097-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "195ca154-8722-4be5-bf3f-faafda88d097" (UID: "195ca154-8722-4be5-bf3f-faafda88d097"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:11:25.305452 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.305432 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/195ca154-8722-4be5-bf3f-faafda88d097-kube-api-access-h7484" (OuterVolumeSpecName: "kube-api-access-h7484") pod "195ca154-8722-4be5-bf3f-faafda88d097" (UID: "195ca154-8722-4be5-bf3f-faafda88d097"). InnerVolumeSpecName "kube-api-access-h7484". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:11:25.404702 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.404650 2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/195ca154-8722-4be5-bf3f-faafda88d097-proxy-tls\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:25.404702 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.404694 2583 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-cabundle-cert\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:25.404702 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.404706 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7484\" (UniqueName: \"kubernetes.io/projected/195ca154-8722-4be5-bf3f-faafda88d097-kube-api-access-h7484\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:25.404702 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.404715 2583 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/195ca154-8722-4be5-bf3f-faafda88d097-kserve-provision-location\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:25.404702 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.404724 2583 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/195ca154-8722-4be5-bf3f-faafda88d097-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:25.534023 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.533985 2583 generic.go:356] "Generic (PLEG): container finished" podID="195ca154-8722-4be5-bf3f-faafda88d097" containerID="a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459" exitCode=0 Jul 20 10:11:25.534202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.534048 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" Jul 20 10:11:25.534202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.534063 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" event={"ID":"195ca154-8722-4be5-bf3f-faafda88d097","Type":"ContainerDied","Data":"a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459"} Jul 20 10:11:25.534202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.534123 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2" event={"ID":"195ca154-8722-4be5-bf3f-faafda88d097","Type":"ContainerDied","Data":"96392853ce414930833554bd597d956401b9ed43869cb0a8bdb2f7db6d318049"} Jul 20 10:11:25.534202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.534150 2583 scope.go:117] "RemoveContainer" containerID="299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e" Jul 20 10:11:25.543107 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.543089 2583 scope.go:117] "RemoveContainer" containerID="a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459" Jul 20 10:11:25.550669 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.550642 2583 scope.go:117] "RemoveContainer" containerID="47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24" Jul 20 10:11:25.555596 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.555570 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2"] Jul 20 10:11:25.560211 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.560191 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-ldfq2"] Jul 20 10:11:25.560277 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.560259 2583 scope.go:117] "RemoveContainer" containerID="299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e" Jul 20 10:11:25.560616 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:11:25.560598 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e\": container with ID starting with 299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e not found: ID does not exist" containerID="299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e" Jul 20 10:11:25.560682 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.560628 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e"} err="failed to get container status \"299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e\": rpc error: code = NotFound desc = could not find container \"299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e\": container with ID starting with 299b680bedaaf450d909bfdff441ea1d1e62c6adb04656faca0efd8ecadf896e not found: ID does not exist" Jul 20 10:11:25.560682 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.560655 2583 scope.go:117] "RemoveContainer" containerID="a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459" Jul 20 10:11:25.560991 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:11:25.560973 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459\": container with ID starting with a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459 not found: ID does not exist" containerID="a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459" Jul 20 10:11:25.561066 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.560999 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459"} err="failed to get container status \"a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459\": rpc error: code = NotFound desc = could not find container \"a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459\": container with ID starting with a6885539b54b722796cb2ad32b241736ae33ef4cbe2cb5def57d2210e2490459 not found: ID does not exist" Jul 20 10:11:25.561066 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.561021 2583 scope.go:117] "RemoveContainer" containerID="47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24" Jul 20 10:11:25.561329 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:11:25.561311 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24\": container with ID starting with 47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24 not found: ID does not exist" containerID="47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24" Jul 20 10:11:25.561372 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:25.561336 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24"} err="failed to get container status \"47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24\": rpc error: code = NotFound desc = could not find container \"47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24\": container with ID starting with 47124a994a9287cda2d5a822e5b4ddccaf60745affe06dac53fd904397d92b24 not found: ID does not exist" Jul 20 10:11:26.409205 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.409178 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:11:26.514126 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.514036 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/878bcff2-8ba5-4aa6-b489-6e28977a959d-kserve-provision-location\") pod \"878bcff2-8ba5-4aa6-b489-6e28977a959d\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " Jul 20 10:11:26.514126 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.514087 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfdw8\" (UniqueName: \"kubernetes.io/projected/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-api-access-gfdw8\") pod \"878bcff2-8ba5-4aa6-b489-6e28977a959d\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " Jul 20 10:11:26.514126 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.514106 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-cabundle-cert\") pod \"878bcff2-8ba5-4aa6-b489-6e28977a959d\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " Jul 20 10:11:26.514418 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.514146 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/878bcff2-8ba5-4aa6-b489-6e28977a959d-proxy-tls\") pod \"878bcff2-8ba5-4aa6-b489-6e28977a959d\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " Jul 20 10:11:26.514418 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.514175 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-rbac-proxy-sar-config\") pod \"878bcff2-8ba5-4aa6-b489-6e28977a959d\" (UID: \"878bcff2-8ba5-4aa6-b489-6e28977a959d\") " Jul 20 10:11:26.514418 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.514402 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/878bcff2-8ba5-4aa6-b489-6e28977a959d-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "878bcff2-8ba5-4aa6-b489-6e28977a959d" (UID: "878bcff2-8ba5-4aa6-b489-6e28977a959d"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:11:26.514571 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.514531 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "878bcff2-8ba5-4aa6-b489-6e28977a959d" (UID: "878bcff2-8ba5-4aa6-b489-6e28977a959d"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:11:26.514610 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.514572 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "878bcff2-8ba5-4aa6-b489-6e28977a959d" (UID: "878bcff2-8ba5-4aa6-b489-6e28977a959d"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 20 10:11:26.516414 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.516392 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/878bcff2-8ba5-4aa6-b489-6e28977a959d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "878bcff2-8ba5-4aa6-b489-6e28977a959d" (UID: "878bcff2-8ba5-4aa6-b489-6e28977a959d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 20 10:11:26.516486 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.516427 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-api-access-gfdw8" (OuterVolumeSpecName: "kube-api-access-gfdw8") pod "878bcff2-8ba5-4aa6-b489-6e28977a959d" (UID: "878bcff2-8ba5-4aa6-b489-6e28977a959d"). InnerVolumeSpecName "kube-api-access-gfdw8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:11:26.539709 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.539680 2583 generic.go:356] "Generic (PLEG): container finished" podID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerID="6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08" exitCode=0 Jul 20 10:11:26.539857 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.539739 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" Jul 20 10:11:26.539857 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.539768 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" event={"ID":"878bcff2-8ba5-4aa6-b489-6e28977a959d","Type":"ContainerDied","Data":"6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08"} Jul 20 10:11:26.539857 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.539833 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp" event={"ID":"878bcff2-8ba5-4aa6-b489-6e28977a959d","Type":"ContainerDied","Data":"b0e2759ea40aec2a379b0069cb03995a2566307947b7b73cdcccb906e959d8f7"} Jul 20 10:11:26.540036 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.539863 2583 scope.go:117] "RemoveContainer" containerID="5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc" Jul 20 10:11:26.548250 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.548234 2583 scope.go:117] "RemoveContainer" containerID="6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08" Jul 20 10:11:26.555618 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.555598 2583 scope.go:117] "RemoveContainer" containerID="a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120" Jul 20 10:11:26.560015 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.559989 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp"] Jul 20 10:11:26.563055 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.563041 2583 scope.go:117] "RemoveContainer" containerID="5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc" Jul 20 10:11:26.563330 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:11:26.563311 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc\": container with ID starting with 5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc not found: ID does not exist" containerID="5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc" Jul 20 10:11:26.563393 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.563336 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc"} err="failed to get container status \"5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc\": rpc error: code = NotFound desc = could not find container \"5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc\": container with ID starting with 5baac3f1c444927440a542674021d9caf75638291369d661d4ea535424aa3bfc not found: ID does not exist" Jul 20 10:11:26.563393 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.563355 2583 scope.go:117] "RemoveContainer" containerID="6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08" Jul 20 10:11:26.563613 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:11:26.563596 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08\": container with ID starting with 6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08 not found: ID does not exist" containerID="6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08" Jul 20 10:11:26.563657 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.563619 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08"} err="failed to get container status \"6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08\": rpc error: code = NotFound desc = could not find container \"6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08\": container with ID starting with 6e0a879d9d785f864cd1494399268916e16f67794d6741a4824e484e23f88e08 not found: ID does not exist" Jul 20 10:11:26.563657 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.563634 2583 scope.go:117] "RemoveContainer" containerID="a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120" Jul 20 10:11:26.563916 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:11:26.563899 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120\": container with ID starting with a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120 not found: ID does not exist" containerID="a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120" Jul 20 10:11:26.563981 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.563919 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120"} err="failed to get container status \"a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120\": rpc error: code = NotFound desc = could not find container \"a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120\": container with ID starting with a3692a3be5e3990f0966186e0ef84175e0184489327b9914535f45ad6f736120 not found: ID does not exist" Jul 20 10:11:26.566391 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.566371 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56c9f5f74c-74ttp"] Jul 20 10:11:26.614715 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.614684 2583 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/878bcff2-8ba5-4aa6-b489-6e28977a959d-kserve-provision-location\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:26.614715 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.614711 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfdw8\" (UniqueName: \"kubernetes.io/projected/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-api-access-gfdw8\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:26.614715 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.614723 2583 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-cabundle-cert\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:26.614950 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.614734 2583 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/878bcff2-8ba5-4aa6-b489-6e28977a959d-proxy-tls\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:26.614950 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:26.614742 2583 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/878bcff2-8ba5-4aa6-b489-6e28977a959d-kube-rbac-proxy-sar-config\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:11:27.294321 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:27.294290 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="195ca154-8722-4be5-bf3f-faafda88d097" path="/var/lib/kubelet/pods/195ca154-8722-4be5-bf3f-faafda88d097/volumes" Jul 20 10:11:27.294762 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:11:27.294737 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" path="/var/lib/kubelet/pods/878bcff2-8ba5-4aa6-b489-6e28977a959d/volumes" Jul 20 10:48:32.172511 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172476 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-twzgz/must-gather-jsgfq"] Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172785 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="storage-initializer" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172797 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="storage-initializer" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172809 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kube-rbac-proxy" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172814 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kube-rbac-proxy" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172823 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kube-rbac-proxy" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172830 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kube-rbac-proxy" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172837 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="storage-initializer" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172845 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="storage-initializer" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172859 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172864 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172871 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172876 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172916 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kserve-container" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172927 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="878bcff2-8ba5-4aa6-b489-6e28977a959d" containerName="kube-rbac-proxy" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172936 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kube-rbac-proxy" Jul 20 10:48:32.174604 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.172943 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="195ca154-8722-4be5-bf3f-faafda88d097" containerName="kserve-container" Jul 20 10:48:32.175394 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.175376 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:48:32.177174 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.177151 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-twzgz\"/\"default-dockercfg-bc4c4\"" Jul 20 10:48:32.177274 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.177151 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-twzgz\"/\"openshift-service-ca.crt\"" Jul 20 10:48:32.177658 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.177644 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-twzgz\"/\"kube-root-ca.crt\"" Jul 20 10:48:32.183108 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.183089 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-twzgz/must-gather-jsgfq"] Jul 20 10:48:32.245543 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.245491 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2z29\" (UniqueName: \"kubernetes.io/projected/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-kube-api-access-c2z29\") pod \"must-gather-jsgfq\" (UID: \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\") " pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:48:32.245708 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.245563 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-must-gather-output\") pod \"must-gather-jsgfq\" (UID: \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\") " pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:48:32.346870 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.346831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-must-gather-output\") pod \"must-gather-jsgfq\" (UID: \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\") " pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:48:32.347051 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.346910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2z29\" (UniqueName: \"kubernetes.io/projected/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-kube-api-access-c2z29\") pod \"must-gather-jsgfq\" (UID: \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\") " pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:48:32.347180 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.347162 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-must-gather-output\") pod \"must-gather-jsgfq\" (UID: \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\") " pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:48:32.354824 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.354803 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2z29\" (UniqueName: \"kubernetes.io/projected/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-kube-api-access-c2z29\") pod \"must-gather-jsgfq\" (UID: \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\") " pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:48:32.484839 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.484799 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:48:32.611421 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.611386 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-twzgz/must-gather-jsgfq"] Jul 20 10:48:32.613499 ip-10-0-133-245 kubenswrapper[2583]: W0720 10:48:32.613472 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f8b9088_bc9e_4b42_8a31_19787df0e6a5.slice/crio-4fc2881b5658c3b1856bd485b1c7b07f1e9b69458c7fb7a7d5b9edefd7ee28f9 WatchSource:0}: Error finding container 4fc2881b5658c3b1856bd485b1c7b07f1e9b69458c7fb7a7d5b9edefd7ee28f9: Status 404 returned error can't find the container with id 4fc2881b5658c3b1856bd485b1c7b07f1e9b69458c7fb7a7d5b9edefd7ee28f9 Jul 20 10:48:32.615228 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:32.615213 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 20 10:48:33.305916 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:33.305884 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twzgz/must-gather-jsgfq" event={"ID":"9f8b9088-bc9e-4b42-8a31-19787df0e6a5","Type":"ContainerStarted","Data":"4fc2881b5658c3b1856bd485b1c7b07f1e9b69458c7fb7a7d5b9edefd7ee28f9"} Jul 20 10:48:39.339546 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:39.339460 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twzgz/must-gather-jsgfq" event={"ID":"9f8b9088-bc9e-4b42-8a31-19787df0e6a5","Type":"ContainerStarted","Data":"35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357"} Jul 20 10:48:39.339546 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:48:39.339514 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twzgz/must-gather-jsgfq" event={"ID":"9f8b9088-bc9e-4b42-8a31-19787df0e6a5","Type":"ContainerStarted","Data":"4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9"} Jul 20 10:49:02.433202 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:02.433166 2583 generic.go:356] "Generic (PLEG): container finished" podID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerID="4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9" exitCode=0 Jul 20 10:49:02.433654 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:02.433226 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-twzgz/must-gather-jsgfq" event={"ID":"9f8b9088-bc9e-4b42-8a31-19787df0e6a5","Type":"ContainerDied","Data":"4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9"} Jul 20 10:49:02.433654 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:02.433528 2583 scope.go:117] "RemoveContainer" containerID="4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9" Jul 20 10:49:03.003577 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:03.003539 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-twzgz_must-gather-jsgfq_9f8b9088-bc9e-4b42-8a31-19787df0e6a5/gather/0.log" Jul 20 10:49:06.245575 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:06.245539 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tlh45_d5979e66-95ad-4e37-b7da-e77682a8d434/global-pull-secret-syncer/0.log" Jul 20 10:49:06.361114 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:06.361083 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dr4dk_9c9d723a-d16e-4302-9c79-2eca4774268f/konnectivity-agent/0.log" Jul 20 10:49:06.382633 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:06.382608 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-245.ec2.internal_9e47ce7bafc72d12721b39c97021dfe2/haproxy/0.log" Jul 20 10:49:08.453823 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.453783 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-twzgz/must-gather-jsgfq"] Jul 20 10:49:08.454313 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.453970 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-twzgz/must-gather-jsgfq" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerName="copy" containerID="cri-o://35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357" gracePeriod=2 Jul 20 10:49:08.460002 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.459973 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-twzgz/must-gather-jsgfq"] Jul 20 10:49:08.682642 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.682621 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-twzgz_must-gather-jsgfq_9f8b9088-bc9e-4b42-8a31-19787df0e6a5/copy/0.log" Jul 20 10:49:08.683984 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.683968 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:49:08.685671 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:49:08.685643 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jsgfq\" is forbidden: User \"system:node:ip-10-0-133-245.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-twzgz\": no relationship found between node 'ip-10-0-133-245.ec2.internal' and this object" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:49:08.750386 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.750303 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-must-gather-output\") pod \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\" (UID: \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\") " Jul 20 10:49:08.750531 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.750407 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2z29\" (UniqueName: \"kubernetes.io/projected/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-kube-api-access-c2z29\") pod \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\" (UID: \"9f8b9088-bc9e-4b42-8a31-19787df0e6a5\") " Jul 20 10:49:08.751809 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.751782 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "9f8b9088-bc9e-4b42-8a31-19787df0e6a5" (UID: "9f8b9088-bc9e-4b42-8a31-19787df0e6a5"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 20 10:49:08.752659 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.752635 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-kube-api-access-c2z29" (OuterVolumeSpecName: "kube-api-access-c2z29") pod "9f8b9088-bc9e-4b42-8a31-19787df0e6a5" (UID: "9f8b9088-bc9e-4b42-8a31-19787df0e6a5"). InnerVolumeSpecName "kube-api-access-c2z29". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 20 10:49:08.851457 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.851409 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2z29\" (UniqueName: \"kubernetes.io/projected/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-kube-api-access-c2z29\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:49:08.851457 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:08.851450 2583 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9f8b9088-bc9e-4b42-8a31-19787df0e6a5-must-gather-output\") on node \"ip-10-0-133-245.ec2.internal\" DevicePath \"\"" Jul 20 10:49:09.294256 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.294219 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" path="/var/lib/kubelet/pods/9f8b9088-bc9e-4b42-8a31-19787df0e6a5/volumes" Jul 20 10:49:09.460820 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.460795 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-twzgz_must-gather-jsgfq_9f8b9088-bc9e-4b42-8a31-19787df0e6a5/copy/0.log" Jul 20 10:49:09.461211 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.461188 2583 generic.go:356] "Generic (PLEG): container finished" podID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerID="35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357" exitCode=143 Jul 20 10:49:09.461272 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.461249 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-twzgz/must-gather-jsgfq" Jul 20 10:49:09.461326 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.461279 2583 scope.go:117] "RemoveContainer" containerID="35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357" Jul 20 10:49:09.468896 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.468877 2583 scope.go:117] "RemoveContainer" containerID="4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9" Jul 20 10:49:09.481371 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.481350 2583 scope.go:117] "RemoveContainer" containerID="35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357" Jul 20 10:49:09.481643 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:49:09.481624 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357\": container with ID starting with 35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357 not found: ID does not exist" containerID="35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357" Jul 20 10:49:09.481694 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.481651 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357"} err="failed to get container status \"35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357\": rpc error: code = NotFound desc = could not find container \"35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357\": container with ID starting with 35a04027e2151f62b6971786d7c5bc093233ea8a9aafb42ba1abe053cf231357 not found: ID does not exist" Jul 20 10:49:09.481694 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.481669 2583 scope.go:117] "RemoveContainer" containerID="4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9" Jul 20 10:49:09.481929 ip-10-0-133-245 kubenswrapper[2583]: E0720 10:49:09.481905 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9\": container with ID starting with 4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9 not found: ID does not exist" containerID="4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9" Jul 20 10:49:09.481992 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:09.481941 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9"} err="failed to get container status \"4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9\": rpc error: code = NotFound desc = could not find container \"4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9\": container with ID starting with 4aea2d63d880758afafa412c42e3ab918191058cb2b6673b84086c30b6f6f4a9 not found: ID does not exist" Jul 20 10:49:10.900516 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:10.900491 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-hc42j_46522bbc-0221-4afc-82e4-258c8916916d/kube-state-metrics/0.log" Jul 20 10:49:10.926250 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:10.926226 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-hc42j_46522bbc-0221-4afc-82e4-258c8916916d/kube-rbac-proxy-main/0.log" Jul 20 10:49:10.949423 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:10.949394 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-hc42j_46522bbc-0221-4afc-82e4-258c8916916d/kube-rbac-proxy-self/0.log" Jul 20 10:49:11.007030 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.007001 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-82jsd_b62188b1-103d-48f6-b816-1a6e39f149a3/monitoring-plugin/0.log" Jul 20 10:49:11.191953 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.191929 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sl9tc_1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd/node-exporter/0.log" Jul 20 10:49:11.226127 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.226103 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sl9tc_1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd/kube-rbac-proxy/0.log" Jul 20 10:49:11.257098 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.257073 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-sl9tc_1762638f-6b0e-4b60-9ed3-9f7b3b9b5ddd/init-textfile/0.log" Jul 20 10:49:11.364025 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.363997 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a669f9b-4942-407e-a5db-2b4a74849170/prometheus/0.log" Jul 20 10:49:11.380509 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.380484 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a669f9b-4942-407e-a5db-2b4a74849170/config-reloader/0.log" Jul 20 10:49:11.403896 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.403870 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a669f9b-4942-407e-a5db-2b4a74849170/thanos-sidecar/0.log" Jul 20 10:49:11.425856 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.425834 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a669f9b-4942-407e-a5db-2b4a74849170/kube-rbac-proxy-web/0.log" Jul 20 10:49:11.447232 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.447173 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a669f9b-4942-407e-a5db-2b4a74849170/kube-rbac-proxy/0.log" Jul 20 10:49:11.472074 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.472053 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a669f9b-4942-407e-a5db-2b4a74849170/kube-rbac-proxy-thanos/0.log" Jul 20 10:49:11.493090 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:11.493068 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_2a669f9b-4942-407e-a5db-2b4a74849170/init-config-reloader/0.log" Jul 20 10:49:14.241668 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.239742 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc"] Jul 20 10:49:14.241668 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.240321 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerName="copy" Jul 20 10:49:14.241668 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.240338 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerName="copy" Jul 20 10:49:14.241668 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.240382 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerName="gather" Jul 20 10:49:14.241668 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.240390 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerName="gather" Jul 20 10:49:14.241668 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.240505 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerName="copy" Jul 20 10:49:14.241668 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.240521 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8b9088-bc9e-4b42-8a31-19787df0e6a5" containerName="gather" Jul 20 10:49:14.246328 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.246293 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.248783 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.248761 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f7trj\"/\"default-dockercfg-rjvgf\"" Jul 20 10:49:14.249250 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.249229 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f7trj\"/\"openshift-service-ca.crt\"" Jul 20 10:49:14.249350 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.249271 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f7trj\"/\"kube-root-ca.crt\"" Jul 20 10:49:14.250605 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.250583 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc"] Jul 20 10:49:14.292211 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.292175 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvvgq\" (UniqueName: \"kubernetes.io/projected/c8bb8a18-862e-4e02-88c3-537349778bee-kube-api-access-vvvgq\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.292383 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.292240 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-proc\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.292383 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.292271 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-sys\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.292383 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.292293 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-lib-modules\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.292383 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.292315 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-podres\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393053 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393018 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-lib-modules\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393053 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393058 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-podres\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393278 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393084 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvvgq\" (UniqueName: \"kubernetes.io/projected/c8bb8a18-862e-4e02-88c3-537349778bee-kube-api-access-vvvgq\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393278 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393147 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-proc\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393278 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393169 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-sys\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393278 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393217 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-podres\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393278 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393223 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-lib-modules\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393278 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393236 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-sys\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.393278 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.393240 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c8bb8a18-862e-4e02-88c3-537349778bee-proc\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.401093 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.401062 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvvgq\" (UniqueName: \"kubernetes.io/projected/c8bb8a18-862e-4e02-88c3-537349778bee-kube-api-access-vvvgq\") pod \"perf-node-gather-daemonset-tkjzc\" (UID: \"c8bb8a18-862e-4e02-88c3-537349778bee\") " pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.556885 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.556793 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:14.702178 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:14.702148 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc"] Jul 20 10:49:14.706237 ip-10-0-133-245 kubenswrapper[2583]: W0720 10:49:14.706208 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc8bb8a18_862e_4e02_88c3_537349778bee.slice/crio-c7929f372a564dbc05a17c6d2abd99b6fbfe70f79c4fd327cc6d91ffc0df84b9 WatchSource:0}: Error finding container c7929f372a564dbc05a17c6d2abd99b6fbfe70f79c4fd327cc6d91ffc0df84b9: Status 404 returned error can't find the container with id c7929f372a564dbc05a17c6d2abd99b6fbfe70f79c4fd327cc6d91ffc0df84b9 Jul 20 10:49:15.377384 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:15.377351 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8l5d4_73c92407-c8f7-4de1-9b2e-ab6c050b9bde/dns/0.log" Jul 20 10:49:15.400795 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:15.400773 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8l5d4_73c92407-c8f7-4de1-9b2e-ab6c050b9bde/kube-rbac-proxy/0.log" Jul 20 10:49:15.483177 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:15.483142 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" event={"ID":"c8bb8a18-862e-4e02-88c3-537349778bee","Type":"ContainerStarted","Data":"930f8d986fdbbcffa37978e65adfb66cca6a5de25c089a366fa48bb9e057e46a"} Jul 20 10:49:15.483390 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:15.483194 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" event={"ID":"c8bb8a18-862e-4e02-88c3-537349778bee","Type":"ContainerStarted","Data":"c7929f372a564dbc05a17c6d2abd99b6fbfe70f79c4fd327cc6d91ffc0df84b9"} Jul 20 10:49:15.483390 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:15.483276 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:15.502575 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:15.502528 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" podStartSLOduration=1.5025146870000001 podStartE2EDuration="1.502514687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 10:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 10:49:15.501283672 +0000 UTC m=+3144.769273523" watchObservedRunningTime="2026-07-20 10:49:15.502514687 +0000 UTC m=+3144.770504513" Jul 20 10:49:15.583685 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:15.583661 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p5hzh_f582d91e-5b7e-4f8f-b849-5f3929c3c4be/dns-node-resolver/0.log" Jul 20 10:49:16.030276 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:16.030245 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-c49bf_2b3bd91d-eb78-4521-b05e-cd5c42193512/node-ca/0.log" Jul 20 10:49:17.166000 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:17.165969 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9sp8h_5315f21c-e91b-4a5f-bae3-a010314c33b8/serve-healthcheck-canary/0.log" Jul 20 10:49:17.553796 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:17.553745 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbjmc_3908aa74-e4c5-4b9d-b6f8-5c03dd95139b/kube-rbac-proxy/0.log" Jul 20 10:49:17.573973 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:17.573952 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbjmc_3908aa74-e4c5-4b9d-b6f8-5c03dd95139b/exporter/0.log" Jul 20 10:49:17.593696 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:17.593670 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbjmc_3908aa74-e4c5-4b9d-b6f8-5c03dd95139b/extractor/0.log" Jul 20 10:49:20.036929 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:20.036905 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-sl9sl_1d8f686c-8e6e-4b22-9eed-1e441c4b3d48/s3-init/0.log" Jul 20 10:49:20.051286 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:20.051261 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-sl9sl_1d8f686c-8e6e-4b22-9eed-1e441c4b3d48/download-hf-model/0.log" Jul 20 10:49:21.497145 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:21.497114 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f7trj/perf-node-gather-daemonset-tkjzc" Jul 20 10:49:23.993851 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:23.993813 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-72lwr_ed866833-2881-4b96-9de1-2d017834d981/migrator/0.log" Jul 20 10:49:24.013884 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:24.013861 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-72lwr_ed866833-2881-4b96-9de1-2d017834d981/graceful-termination/0.log" Jul 20 10:49:25.613782 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.613741 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pjvd4_676ddd76-0499-4ca3-9b33-9285a97ba3a9/kube-multus-additional-cni-plugins/0.log" Jul 20 10:49:25.634812 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.634786 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pjvd4_676ddd76-0499-4ca3-9b33-9285a97ba3a9/egress-router-binary-copy/0.log" Jul 20 10:49:25.654289 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.654263 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pjvd4_676ddd76-0499-4ca3-9b33-9285a97ba3a9/cni-plugins/0.log" Jul 20 10:49:25.673891 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.673859 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pjvd4_676ddd76-0499-4ca3-9b33-9285a97ba3a9/bond-cni-plugin/0.log" Jul 20 10:49:25.694094 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.694067 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pjvd4_676ddd76-0499-4ca3-9b33-9285a97ba3a9/routeoverride-cni/0.log" Jul 20 10:49:25.713150 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.713130 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pjvd4_676ddd76-0499-4ca3-9b33-9285a97ba3a9/whereabouts-cni-bincopy/0.log" Jul 20 10:49:25.730520 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.730497 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pjvd4_676ddd76-0499-4ca3-9b33-9285a97ba3a9/whereabouts-cni/0.log" Jul 20 10:49:25.755698 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.755669 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qzzkj_4ff41604-ddf8-4c25-9e42-95ba51b45e42/kube-multus/0.log" Jul 20 10:49:25.818878 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.818810 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fsjbf_d86aebe1-4eb3-43fc-a1a4-9e49a8970747/network-metrics-daemon/0.log" Jul 20 10:49:25.836991 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:25.836962 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fsjbf_d86aebe1-4eb3-43fc-a1a4-9e49a8970747/kube-rbac-proxy/0.log" Jul 20 10:49:27.002978 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:27.002953 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfh4h_aa274a27-90e6-409c-bba8-89fc85955020/ovn-controller/0.log" Jul 20 10:49:27.021133 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:27.021102 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfh4h_aa274a27-90e6-409c-bba8-89fc85955020/ovn-acl-logging/0.log" Jul 20 10:49:27.041508 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:27.041486 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfh4h_aa274a27-90e6-409c-bba8-89fc85955020/kube-rbac-proxy-node/0.log" Jul 20 10:49:27.067784 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:27.067732 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfh4h_aa274a27-90e6-409c-bba8-89fc85955020/kube-rbac-proxy-ovn-metrics/0.log" Jul 20 10:49:27.086126 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:27.086101 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfh4h_aa274a27-90e6-409c-bba8-89fc85955020/northd/0.log" Jul 20 10:49:27.104460 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:27.104433 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfh4h_aa274a27-90e6-409c-bba8-89fc85955020/nbdb/0.log" Jul 20 10:49:27.123856 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:27.123830 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfh4h_aa274a27-90e6-409c-bba8-89fc85955020/sbdb/0.log" Jul 20 10:49:27.167421 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:27.167393 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jfh4h_aa274a27-90e6-409c-bba8-89fc85955020/ovnkube-controller/0.log" Jul 20 10:49:28.183342 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:28.183314 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hpfbq_dd00f0c0-3934-4bf0-b87a-62b6d3821cb2/network-check-target-container/0.log" Jul 20 10:49:29.018530 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:29.018506 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-t4jpb_21c89f69-fad7-4709-b4b7-346c3d74251e/iptables-alerter/0.log" Jul 20 10:49:29.621951 ip-10-0-133-245 kubenswrapper[2583]: I0720 10:49:29.621909 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-s8fh9_6a1560cc-d37e-4613-8ee3-4184a0015d7d/tuned/0.log"