Jul 06 19:06:49.127846 ip-10-0-133-163 systemd[1]: Starting Kubernetes Kubelet... Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.493438 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497073 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497084 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497088 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497091 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497094 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497097 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497100 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:49.593635 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497103 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:49.566697 ip-10-0-133-163 systemd[1]: Started Kubernetes Kubelet. Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497106 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497111 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497115 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497118 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497121 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497125 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497128 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497132 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497135 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497138 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497141 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497144 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497147 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497150 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497153 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497156 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497159 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497162 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:49.596147 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497165 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497168 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497170 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497173 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497176 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497179 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497181 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497184 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497187 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497190 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497192 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497196 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497200 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497203 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497206 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497208 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497211 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497215 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497217 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497220 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:49.598159 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497222 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497225 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497228 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497231 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497235 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497239 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497241 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497244 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497247 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497250 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497252 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497255 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497257 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497260 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497262 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497265 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497268 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497270 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497273 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:49.600921 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497277 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497280 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497283 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497286 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497289 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497291 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497295 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497297 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497300 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497303 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497305 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497308 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497311 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497313 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497316 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497319 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497321 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497324 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497327 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497329 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:49.613878 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497332 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497335 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497337 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497340 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497342 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497344 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497347 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497350 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497353 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497356 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497358 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497361 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497364 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.497367 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498041 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498048 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498050 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498053 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498056 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498062 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:49.617810 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498065 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498069 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498072 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498075 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498078 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498081 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498084 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498087 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498089 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498092 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498094 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498097 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498100 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498102 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498105 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498107 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498110 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498112 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498116 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498118 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:49.618675 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498122 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498124 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498127 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498129 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498132 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498134 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498137 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498141 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498144 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498146 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498149 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498151 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498155 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498157 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498160 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498163 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498165 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498168 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498170 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498173 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:49.767887 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498175 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498178 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498180 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498183 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498186 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498188 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498191 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498193 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498196 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498198 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498203 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498205 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498208 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498210 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498213 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498216 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498218 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498222 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498224 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:49.783520 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498227 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498229 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498232 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498234 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498237 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498239 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498243 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498245 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498248 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498250 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498254 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498256 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498259 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498261 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498264 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498266 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498269 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498273 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498276 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498279 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:49.785683 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498282 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498285 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498287 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498291 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498294 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498297 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498300 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498304 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498307 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498309 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498312 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498314 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498317 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498319 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498701 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498706 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498709 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498712 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498720 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:49.787548 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498723 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498726 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498728 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498730 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498733 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498736 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498739 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498742 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498745 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498748 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498750 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498753 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498755 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498758 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498760 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498765 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498769 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498771 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498774 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498777 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:49.791193 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498780 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498783 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498785 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498788 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498791 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498795 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498798 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498802 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498805 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498808 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498812 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498816 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498819 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498822 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498825 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498827 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498830 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498832 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498834 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:49.794894 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498837 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498839 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498842 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498844 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498847 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498849 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498852 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498854 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498858 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498862 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498864 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498867 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498870 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498872 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498875 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498877 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498880 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498882 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498885 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498887 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:49.799222 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498890 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498893 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498895 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498898 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498901 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498904 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498906 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498909 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498911 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498914 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498916 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498919 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498922 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498924 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498927 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498929 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498932 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498934 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498937 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498939 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:49.799929 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498943 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498947 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498950 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498952 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498955 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498957 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498960 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498963 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498965 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498968 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498970 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498973 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498975 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498978 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.498980 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499070 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499090 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499097 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499101 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499105 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499109 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 19:06:49.801098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499112 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499117 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499120 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499123 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499126 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499129 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499132 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499135 2559 flags.go:64] FLAG: --cgroup-root="" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499138 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499141 2559 flags.go:64] FLAG: --client-ca-file="" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499143 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499148 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499154 2559 flags.go:64] FLAG: --cluster-domain="" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499157 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499160 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499163 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499167 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499170 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499173 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499176 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499179 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499182 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499185 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499188 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 19:06:49.801953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499191 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499194 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499198 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499201 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499203 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499206 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499209 2559 flags.go:64] FLAG: --enable-server="true" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499213 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499220 2559 flags.go:64] FLAG: --event-burst="100" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499223 2559 flags.go:64] FLAG: --event-qps="50" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499226 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499229 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499232 2559 flags.go:64] FLAG: --eviction-hard="" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499235 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499238 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499241 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499244 2559 flags.go:64] FLAG: --eviction-soft="" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499247 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499250 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499254 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499258 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499265 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499268 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499271 2559 flags.go:64] FLAG: --feature-gates="" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499275 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 19:06:49.803012 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499278 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499281 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499284 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499287 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499290 2559 flags.go:64] FLAG: --help="false" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499293 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-133-163.ec2.internal" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499297 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499300 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499303 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499306 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499309 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499312 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499315 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499318 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499321 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499324 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499327 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499330 2559 flags.go:64] FLAG: --kube-reserved="" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499333 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499336 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499339 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499342 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499345 2559 flags.go:64] FLAG: --lock-file="" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499347 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 19:06:49.804035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499350 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499353 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499359 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499364 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499366 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499369 2559 flags.go:64] FLAG: --logging-format="text" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499372 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499375 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499378 2559 flags.go:64] FLAG: --manifest-url="" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499381 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499385 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499388 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499392 2559 flags.go:64] FLAG: --max-pods="110" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499395 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499398 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499401 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499403 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499406 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499409 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499412 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499425 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499428 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499431 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 19:06:49.804827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499434 2559 flags.go:64] FLAG: --pod-cidr="" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499442 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499448 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499450 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499453 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499456 2559 flags.go:64] FLAG: --port="10250" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499459 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499462 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06b169a50df3cc5ef" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499465 2559 flags.go:64] FLAG: --qos-reserved="" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499468 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499471 2559 flags.go:64] FLAG: --register-node="true" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499475 2559 flags.go:64] FLAG: --register-with-taints="" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499478 2559 flags.go:64] FLAG: --registry-burst="10" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499482 2559 flags.go:64] FLAG: --registry-qps="5" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499485 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499488 2559 flags.go:64] FLAG: --reserved-memory="" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499491 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499495 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499512 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499515 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499518 2559 flags.go:64] FLAG: --runonce="false" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499522 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499524 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499527 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499530 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 19:06:49.806097 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499533 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499536 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499539 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499543 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499545 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499548 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499551 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499554 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499557 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499560 2559 flags.go:64] FLAG: --system-cgroups="" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499563 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499568 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499571 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499574 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499578 2559 flags.go:64] FLAG: --tls-min-version="" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499581 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499584 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499586 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499591 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499594 2559 flags.go:64] FLAG: --v="2" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499599 2559 flags.go:64] FLAG: --version="false" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499603 2559 flags.go:64] FLAG: --vmodule="" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499607 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.499610 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499779 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:49.806808 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499784 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499795 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499799 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499801 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499804 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499807 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499809 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499812 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499814 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499818 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499820 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499823 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499826 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499828 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499831 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499833 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499836 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499839 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499842 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499845 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:49.969286 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499848 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499850 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499854 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499858 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499861 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499865 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499869 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499874 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499877 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499880 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499882 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499885 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499887 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499890 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499893 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499895 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499898 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499900 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499903 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:49.970741 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499905 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499908 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499910 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499913 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499915 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499918 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499920 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499923 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499926 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499928 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499931 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499939 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499942 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499944 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499947 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499950 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499952 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499955 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499960 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:49.971703 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499974 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499979 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499983 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499986 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499989 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499991 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499994 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.499997 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500000 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500003 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500005 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500008 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500011 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500013 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500016 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500019 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500021 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500024 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500026 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500029 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:49.972260 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500031 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500034 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500037 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500039 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500047 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500055 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500058 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500060 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500063 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500066 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500068 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500073 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500075 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500079 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500082 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500084 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500087 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500089 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500092 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:49.972809 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.500094 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.500626 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.508583 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.508601 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.508625 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.508633 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508702 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508710 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508715 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508719 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508723 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508727 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508731 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508736 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:49.973354 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508740 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508744 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508748 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508752 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508756 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508760 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508764 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508768 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508772 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508777 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508782 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508785 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508788 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508790 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508793 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508796 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508798 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508801 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508805 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508809 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:49.973774 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508812 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508815 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508818 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508821 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508823 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508826 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508829 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508831 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508835 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508837 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508840 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508843 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508845 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508848 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508850 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508853 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508856 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508858 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508860 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508863 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:49.974384 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508865 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508868 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508870 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508873 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508875 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508878 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508880 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508883 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508886 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508888 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508891 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508894 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508897 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508899 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508902 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508905 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508907 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508910 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508913 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:49.974934 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508915 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508920 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508922 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508925 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508927 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508930 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508932 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508935 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508937 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508940 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508942 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508944 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508947 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508950 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508952 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508955 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508957 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508960 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508962 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508965 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:49.975472 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508967 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508970 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508972 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508975 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508980 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508982 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508986 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508990 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508993 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508996 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.508998 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509001 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.509007 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509113 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509117 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 19:06:49.976061 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509120 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509123 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509126 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509129 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509132 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509135 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509138 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509140 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509143 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509146 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509149 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509152 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509154 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509157 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509159 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509162 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509165 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509167 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509169 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 19:06:49.976547 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509172 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509175 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509177 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509181 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509183 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509186 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509188 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509191 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509194 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509196 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509199 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509203 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509205 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509208 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509210 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509213 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509216 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509218 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509221 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 19:06:49.977049 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509223 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509226 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509228 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509231 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509233 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509236 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509238 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509241 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509243 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509246 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509248 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509251 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509253 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509256 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509259 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509262 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509266 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509268 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509271 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509273 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 19:06:49.977617 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509276 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509279 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509281 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509284 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509288 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509290 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509293 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509296 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509298 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509301 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509304 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509306 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509310 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509313 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509316 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509319 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509322 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509324 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509327 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 19:06:49.978181 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509329 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509332 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509335 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509337 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509341 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509344 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509347 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509350 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509352 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509356 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509359 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509361 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509364 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509366 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509369 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509372 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509375 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509380 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509384 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 19:06:49.978764 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:49.509387 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.509391 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.509494 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.511729 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.513120 2559 server.go:1019] "Starting client certificate rotation" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.513597 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.513658 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.516202 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.519123 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.531939 2559 log.go:25] "Validated CRI v1 runtime API" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.534132 2559 log.go:25] "Validated CRI v1 image API" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.534814 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 19:06:49.979293 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.537839 2559 fs.go:135] Filesystem UUIDs: map[1c30c09d-c5ce-4dc5-8d6f-24dddadc1e4f:/dev/nvme0n1p4 539431ac-49ad-4df6-b18c-ec83e24359b2:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 06 19:06:49.979703 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.537856 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 19:06:49.979773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.542567 2559 manager.go:216] Machine: {Timestamp:2026-07-06 19:06:49.542070537 +0000 UTC m=+0.304850456 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099796 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe8ec48c3f217efe059fec751f17d SystemUUID:ec2fe8ec-48c3-f217-efe0-59fec751f17d BootID:c68ec52c-2861-49f5-9083-21ffb427e64f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:50:82:e9:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:50:82:e9:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f2:f8:6a:76:18:65 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 19:06:49.979773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.542657 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 19:06:49.979773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.542729 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 19:06:49.979773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.543621 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 19:06:49.979773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.543648 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-163.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 19:06:49.979773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.544067 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:06:49.979773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.544330 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.544342 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.544355 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.545111 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.546474 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.549557 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.549667 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.549693 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.549702 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.549716 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.549725 2559 kubelet.go:398] "Adding apiserver pod source" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.549733 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.550030 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.550045 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.555849 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.557732 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.557774 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559019 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559034 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559041 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559046 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559055 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559061 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559069 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559075 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559082 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559102 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559117 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559123 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559759 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.559767 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.560007 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.560160 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.562835 2559 server.go:1268] "Started kubelet" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.562917 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.562934 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.563022 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.567894 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.568320 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 19:06:49.980075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.573093 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-163.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.573125 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.576872 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.576884 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.576955 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.577530 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.577546 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.577530 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.577679 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.577688 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.577951 2559 factory.go:153] Registering CRI-O factory Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.577966 2559 factory.go:223] Registration of the crio container factory successfully Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.578017 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.578026 2559 factory.go:55] Registering systemd factory Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.578035 2559 factory.go:223] Registration of the systemd container factory successfully Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.578058 2559 factory.go:103] Registering Raw factory Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.578073 2559 manager.go:1196] Started watching for new ooms in manager Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.578676 2559 manager.go:349] Starting recovery of all containers Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.583165 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.583257 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-163.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.583189 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-163.ec2.internal.18bfc8d87aec6157 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-163.ec2.internal,UID:ip-10-0-133-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-163.ec2.internal,},FirstTimestamp:2026-07-06 19:06:49.562808663 +0000 UTC m=+0.325588582,LastTimestamp:2026-07-06 19:06:49.562808663 +0000 UTC m=+0.325588582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-163.ec2.internal,}" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.589745 2559 manager.go:354] Recovery completed Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.594603 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-db7fn" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.596309 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.599170 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.599197 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.599212 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.600571 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.600588 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.600636 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.600922 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:49.981522 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.601021 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-db7fn" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.601433 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-163.ec2.internal.18bfc8d87d1762bc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-163.ec2.internal,UID:ip-10-0-133-163.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-163.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-163.ec2.internal,},FirstTimestamp:2026-07-06 19:06:49.5991815 +0000 UTC m=+0.361961418,LastTimestamp:2026-07-06 19:06:49.5991815 +0000 UTC m=+0.361961418,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-163.ec2.internal,}" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.601780 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.601806 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.601817 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.602005 2559 policy_none.go:49] "None policy: Start" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.602025 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.602037 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.603460 2559 policy_none.go:47] "Start" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.659050 2559 manager.go:337] "Starting Device Plugin manager" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.659087 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.659098 2559 server.go:87] "Starting device plugin registration server" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.659367 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.659379 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.659463 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.659554 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.659562 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.660096 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.660142 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.712878 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.714081 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.714128 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.714159 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.714203 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.716813 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.759987 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.760892 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.760917 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.760926 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.760949 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-163.ec2.internal" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.772554 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-163.ec2.internal" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.772575 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-163.ec2.internal\": node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:49.982377 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.797982 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.815129 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal"] Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.815180 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.816045 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.816073 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.816084 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.817495 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.817631 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.817670 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.818212 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.818236 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.818250 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.818266 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.818287 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.818300 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.819610 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.819632 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.820438 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientMemory" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.820461 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.820474 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeHasSufficientPID" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.857270 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-163.ec2.internal\" not found" node="ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.861598 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-163.ec2.internal\" not found" node="ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.898696 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.978897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b8c2ecc0c280c7d443a14ca82ee9438-config\") pod \"kube-apiserver-proxy-ip-10-0-133-163.ec2.internal\" (UID: \"2b8c2ecc0c280c7d443a14ca82ee9438\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.978930 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be1b987fb07e7b0f33e157114c6d1fa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal\" (UID: \"be1b987fb07e7b0f33e157114c6d1fa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:49.978950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be1b987fb07e7b0f33e157114c6d1fa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal\" (UID: \"be1b987fb07e7b0f33e157114c6d1fa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.080282 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:49.998952 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:50.081114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.079608 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b8c2ecc0c280c7d443a14ca82ee9438-config\") pod \"kube-apiserver-proxy-ip-10-0-133-163.ec2.internal\" (UID: \"2b8c2ecc0c280c7d443a14ca82ee9438\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.081114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.079645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be1b987fb07e7b0f33e157114c6d1fa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal\" (UID: \"be1b987fb07e7b0f33e157114c6d1fa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.081114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.079661 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be1b987fb07e7b0f33e157114c6d1fa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal\" (UID: \"be1b987fb07e7b0f33e157114c6d1fa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.081114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.079706 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/be1b987fb07e7b0f33e157114c6d1fa9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal\" (UID: \"be1b987fb07e7b0f33e157114c6d1fa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.081114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.079711 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2b8c2ecc0c280c7d443a14ca82ee9438-config\") pod \"kube-apiserver-proxy-ip-10-0-133-163.ec2.internal\" (UID: \"2b8c2ecc0c280c7d443a14ca82ee9438\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.081114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.079747 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/be1b987fb07e7b0f33e157114c6d1fa9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal\" (UID: \"be1b987fb07e7b0f33e157114c6d1fa9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.262487 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.099710 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:50.262487 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.160898 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.262487 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.165370 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.262487 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.200513 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:50.324808 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.301259 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:50.494466 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.401803 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-163.ec2.internal\" not found" Jul 06 19:06:50.494466 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.420203 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:50.494466 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.477314 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.494466 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.488969 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:06:50.494466 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.490570 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.507422 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.512028 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.512047 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.512120 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.550578 2559 apiserver.go:52] "Watching apiserver" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.559279 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.561376 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.561455 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-v6rr5","kube-system/konnectivity-agent-vxk4f","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95","openshift-cluster-node-tuning-operator/tuned-n4cpc","openshift-image-registry/node-ca-w4fv5","openshift-multus/multus-6q5j2","openshift-multus/network-metrics-daemon-grwxz","openshift-network-diagnostics/network-check-target-765f5","kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal","openshift-dns/node-resolver-hzcts","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal","openshift-multus/multus-additional-cni-plugins-l624c","openshift-network-operator/iptables-alerter-4gr4l","openshift-ovn-kubernetes/ovnkube-node-bnqhk"] Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.563452 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.563527 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.568575 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.569852 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.570924 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.571267 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.571294 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.571485 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-89jbb\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.571899 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.571951 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.571961 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7jtqk\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.571966 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.572185 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.572985 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b2mkf\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.573051 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.573421 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.573853 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:06:50.661246 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.574601 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.574773 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.574845 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.574916 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-72t66\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.575087 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.575385 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.575893 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.575947 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.575956 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.576024 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fn2wp\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.576034 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.576341 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.576357 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.577119 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.577229 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.578351 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.579844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.581476 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.581629 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.581863 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.582106 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-crf24\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.582437 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.582637 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.582746 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5jhmf\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.584611 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.584773 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.586205 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.587164 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.587832 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 19:06:50.663560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.588140 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.588288 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l4ffd\"" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.588422 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.588584 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.588768 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6wbpq\"" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.588957 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g9sk\" (UniqueName: \"kubernetes.io/projected/52923da4-c1f8-4898-88d7-e29b5a1a0233-kube-api-access-9g9sk\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-cni-multus\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589353 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b1c4173c-c47b-43ac-88b3-3df615495517-konnectivity-ca\") pod \"konnectivity-agent-vxk4f\" (UID: \"b1c4173c-c47b-43ac-88b3-3df615495517\") " pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589367 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-registration-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589382 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysctl-d\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589395 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-host\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589410 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gxxl\" (UniqueName: \"kubernetes.io/projected/6389ea03-93de-4858-9ed7-3cef07c223d3-kube-api-access-2gxxl\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589424 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52923da4-c1f8-4898-88d7-e29b5a1a0233-host\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52923da4-c1f8-4898-88d7-e29b5a1a0233-serviceca\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-system-cni-dir\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.664450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589468 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589481 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-hostroot\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589495 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b1c4173c-c47b-43ac-88b3-3df615495517-agent-certs\") pod \"konnectivity-agent-vxk4f\" (UID: \"b1c4173c-c47b-43ac-88b3-3df615495517\") " pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysconfig\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589552 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-socket-dir-parent\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-cni-binary-copy\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589599 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-sys-fs\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-sys\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-netns\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-multus-certs\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-kubelet-config\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-dbus\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:50.665004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589715 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-systemd\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-tuned\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-daemon-config\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589767 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt6rp\" (UniqueName: \"kubernetes.io/projected/3678ac19-302c-49e3-adbd-cc07629c9bdd-kube-api-access-lt6rp\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6389ea03-93de-4858-9ed7-3cef07c223d3-tmp\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589794 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-socket-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd460de7-89f7-4c87-ae92-8e9d778c342d-tmp-dir\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589837 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-run\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-system-cni-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589892 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8707e886-cb93-4af3-be01-1c78a6c52b5f-cni-binary-copy\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589918 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-kubelet\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phjb7\" (UniqueName: \"kubernetes.io/projected/8707e886-cb93-4af3-be01-1c78a6c52b5f-kube-api-access-phjb7\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.589977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-cnibin\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590003 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-kubernetes\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.665878 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590017 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-cni-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590031 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-os-release\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590064 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m24fc\" (UniqueName: \"kubernetes.io/projected/e5534e2f-a7cc-451f-947a-6072a500c589-kube-api-access-m24fc\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590091 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nnv8\" (UniqueName: \"kubernetes.io/projected/cd460de7-89f7-4c87-ae92-8e9d778c342d-kube-api-access-2nnv8\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590106 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-os-release\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590138 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-var-lib-kubelet\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-etc-kubernetes\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590170 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-device-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590198 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd460de7-89f7-4c87-ae92-8e9d778c342d-hosts-file\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590267 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-cni-bin\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590288 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-modprobe-d\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590308 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-lib-modules\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.666324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590327 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-conf-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590381 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-cnibin\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-k8s-cni-cncf-io\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590422 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590445 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8898\" (UniqueName: \"kubernetes.io/projected/6bca2c2a-1036-4ee8-9f69-13b6560290d2-kube-api-access-r8898\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.590487 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysctl-conf\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.600212 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.603196 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 19:01:50 +0000 UTC" deadline="2027-12-05 23:07:21.699561421 +0000 UTC" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.603243 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12412h0m31.096320819s" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.620288 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pk4cl" Jul 06 19:06:50.666839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.629381 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pk4cl" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.680783 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690709 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-cnibin\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-kubernetes\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-cni-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690766 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-os-release\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690797 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690809 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-cnibin\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-kubernetes\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690870 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m24fc\" (UniqueName: \"kubernetes.io/projected/e5534e2f-a7cc-451f-947a-6072a500c589-kube-api-access-m24fc\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690899 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-os-release\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690922 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-cni-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690923 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-host-slash\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcq27\" (UniqueName: \"kubernetes.io/projected/b01c382f-b95c-4d16-8805-d85d910cabc2-kube-api-access-fcq27\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.690990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nnv8\" (UniqueName: \"kubernetes.io/projected/cd460de7-89f7-4c87-ae92-8e9d778c342d-kube-api-access-2nnv8\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:52.126520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-os-release\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691075 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-os-release\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-var-lib-kubelet\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-etc-kubernetes\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691220 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-etc-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691266 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-var-lib-kubelet\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-etc-kubernetes\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691294 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-node-log\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-log-socket\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-ovnkube-script-lib\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-device-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691405 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd460de7-89f7-4c87-ae92-8e9d778c342d-hosts-file\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691414 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-device-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.127212 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691429 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-cni-bin\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-kubelet\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691467 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd460de7-89f7-4c87-ae92-8e9d778c342d-hosts-file\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-modprobe-d\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-lib-modules\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691516 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-cni-bin\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-conf-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691559 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-conf-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691563 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691596 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-slash\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691616 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-modprobe-d\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-systemd\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691636 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-lib-modules\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691648 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-cnibin\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.127852 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.691711 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-k8s-cni-cncf-io\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691754 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691771 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691831 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-k8s-cni-cncf-io\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691848 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-ovn\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691848 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-cnibin\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.691885 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs podName:3678ac19-302c-49e3-adbd-cc07629c9bdd nodeName:}" failed. No retries permitted until 2026-07-06 19:06:51.191865934 +0000 UTC m=+1.954645840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs") pod "network-metrics-daemon-grwxz" (UID: "3678ac19-302c-49e3-adbd-cc07629c9bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691919 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-cni-netd\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.691955 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8898\" (UniqueName: \"kubernetes.io/projected/6bca2c2a-1036-4ee8-9f69-13b6560290d2-kube-api-access-r8898\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692032 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-systemd-units\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692103 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.128365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692125 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysctl-conf\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g9sk\" (UniqueName: \"kubernetes.io/projected/52923da4-c1f8-4898-88d7-e29b5a1a0233-kube-api-access-9g9sk\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-cni-multus\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692181 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b1c4173c-c47b-43ac-88b3-3df615495517-konnectivity-ca\") pod \"konnectivity-agent-vxk4f\" (UID: \"b1c4173c-c47b-43ac-88b3-3df615495517\") " pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-env-overrides\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692194 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692234 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-cni-multus\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-registration-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysctl-conf\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692279 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysctl-d\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692323 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-registration-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692295 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysctl-d\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692546 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-host\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.128827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gxxl\" (UniqueName: \"kubernetes.io/projected/6389ea03-93de-4858-9ed7-3cef07c223d3-kube-api-access-2gxxl\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692606 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52923da4-c1f8-4898-88d7-e29b5a1a0233-host\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692633 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52923da4-c1f8-4898-88d7-e29b5a1a0233-serviceca\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692641 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-host\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/52923da4-c1f8-4898-88d7-e29b5a1a0233-host\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-system-cni-dir\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692695 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692702 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b1c4173c-c47b-43ac-88b3-3df615495517-konnectivity-ca\") pod \"konnectivity-agent-vxk4f\" (UID: \"b1c4173c-c47b-43ac-88b3-3df615495517\") " pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692720 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-hostroot\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692733 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e5534e2f-a7cc-451f-947a-6072a500c589-system-cni-dir\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b1c4173c-c47b-43ac-88b3-3df615495517-agent-certs\") pod \"konnectivity-agent-vxk4f\" (UID: \"b1c4173c-c47b-43ac-88b3-3df615495517\") " pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692768 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-hostroot\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-658d8\" (UniqueName: \"kubernetes.io/projected/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-kube-api-access-658d8\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-etc-selinux\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysconfig\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.129799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692846 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-socket-dir-parent\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692889 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-socket-dir-parent\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692908 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-sysconfig\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-cni-binary-copy\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.692936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-iptables-alerter-script\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693049 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693065 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693083 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-cni-bin\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693098 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-sys-fs\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693055 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/52923da4-c1f8-4898-88d7-e29b5a1a0233-serviceca\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693127 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-sys\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693160 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-sys\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-netns\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693225 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-run-netns\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.130310 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.693245 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-netns\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693305 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-sys-fs\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.693319 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret podName:77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:51.193302562 +0000 UTC m=+1.956082471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret") pod "global-pull-secret-syncer-v6rr5" (UID: "77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693321 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e5534e2f-a7cc-451f-947a-6072a500c589-cni-binary-copy\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693250 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-ovnkube-config\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-multus-certs\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693410 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-run-multus-certs\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-kubelet-config\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693463 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-dbus\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-kubelet-config\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693483 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-systemd\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.130886 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-tuned\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693534 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-dbus\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693544 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-daemon-config\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693547 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-systemd\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693568 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt6rp\" (UniqueName: \"kubernetes.io/projected/3678ac19-302c-49e3-adbd-cc07629c9bdd-kube-api-access-lt6rp\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6389ea03-93de-4858-9ed7-3cef07c223d3-tmp\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693614 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-var-lib-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b01c382f-b95c-4d16-8805-d85d910cabc2-ovn-node-metrics-cert\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693663 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-socket-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693686 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd460de7-89f7-4c87-ae92-8e9d778c342d-tmp-dir\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-run\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693751 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-system-cni-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8707e886-cb93-4af3-be01-1c78a6c52b5f-cni-binary-copy\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693798 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-kubelet\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.693824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phjb7\" (UniqueName: \"kubernetes.io/projected/8707e886-cb93-4af3-be01-1c78a6c52b5f-kube-api-access-phjb7\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131383 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.694022 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6389ea03-93de-4858-9ed7-3cef07c223d3-run\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.694035 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8707e886-cb93-4af3-be01-1c78a6c52b5f-multus-daemon-config\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.694063 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-host-var-lib-kubelet\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.694112 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8707e886-cb93-4af3-be01-1c78a6c52b5f-system-cni-dir\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.694156 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6bca2c2a-1036-4ee8-9f69-13b6560290d2-socket-dir\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.694261 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd460de7-89f7-4c87-ae92-8e9d778c342d-tmp-dir\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.694492 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8707e886-cb93-4af3-be01-1c78a6c52b5f-cni-binary-copy\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.696429 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6389ea03-93de-4858-9ed7-3cef07c223d3-tmp\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.696519 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6389ea03-93de-4858-9ed7-3cef07c223d3-etc-tuned\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.696662 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b1c4173c-c47b-43ac-88b3-3df615495517-agent-certs\") pod \"konnectivity-agent-vxk4f\" (UID: \"b1c4173c-c47b-43ac-88b3-3df615495517\") " pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.698016 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.698031 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.698040 2559 projected.go:196] Error preparing data for projected volume kube-api-access-db8ct for pod openshift-network-diagnostics/network-check-target-765f5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:50.698085 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct podName:4a7b7608-819e-437b-bd60-6c7b7e75cbd7 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:51.198074782 +0000 UTC m=+1.960854709 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-db8ct" (UniqueName: "kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct") pod "network-check-target-765f5" (UID: "4a7b7608-819e-437b-bd60-6c7b7e75cbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.700571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m24fc\" (UniqueName: \"kubernetes.io/projected/e5534e2f-a7cc-451f-947a-6072a500c589-kube-api-access-m24fc\") pod \"multus-additional-cni-plugins-l624c\" (UID: \"e5534e2f-a7cc-451f-947a-6072a500c589\") " pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.131954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.701011 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g9sk\" (UniqueName: \"kubernetes.io/projected/52923da4-c1f8-4898-88d7-e29b5a1a0233-kube-api-access-9g9sk\") pod \"node-ca-w4fv5\" (UID: \"52923da4-c1f8-4898-88d7-e29b5a1a0233\") " pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.701399 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nnv8\" (UniqueName: \"kubernetes.io/projected/cd460de7-89f7-4c87-ae92-8e9d778c342d-kube-api-access-2nnv8\") pod \"node-resolver-hzcts\" (UID: \"cd460de7-89f7-4c87-ae92-8e9d778c342d\") " pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:50.701445 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8898\" (UniqueName: \"kubernetes.io/projected/6bca2c2a-1036-4ee8-9f69-13b6560290d2-kube-api-access-r8898\") pod \"aws-ebs-csi-driver-node-ztr95\" (UID: \"6bca2c2a-1036-4ee8-9f69-13b6560290d2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.037216 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt6rp\" (UniqueName: \"kubernetes.io/projected/3678ac19-302c-49e3-adbd-cc07629c9bdd-kube-api-access-lt6rp\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.037755 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gxxl\" (UniqueName: \"kubernetes.io/projected/6389ea03-93de-4858-9ed7-3cef07c223d3-kube-api-access-2gxxl\") pod \"tuned-n4cpc\" (UID: \"6389ea03-93de-4858-9ed7-3cef07c223d3\") " pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.037951 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phjb7\" (UniqueName: \"kubernetes.io/projected/8707e886-cb93-4af3-be01-1c78a6c52b5f-kube-api-access-phjb7\") pod \"multus-6q5j2\" (UID: \"8707e886-cb93-4af3-be01-1c78a6c52b5f\") " pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.071234 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l624c" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-env-overrides\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-658d8\" (UniqueName: \"kubernetes.io/projected/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-kube-api-access-658d8\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128810 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-iptables-alerter-script\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128843 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-cni-bin\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128905 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-run-ovn-kubernetes\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128945 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-run-netns\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128983 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-run-netns\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128947 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-cni-bin\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.128985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-ovnkube-config\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129050 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-var-lib-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b01c382f-b95c-4d16-8805-d85d910cabc2-ovn-node-metrics-cert\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129110 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-var-lib-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129135 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-host-slash\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129160 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcq27\" (UniqueName: \"kubernetes.io/projected/b01c382f-b95c-4d16-8805-d85d910cabc2-kube-api-access-fcq27\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129205 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-etc-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129229 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-node-log\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129254 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-log-socket\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-ovnkube-script-lib\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-kubelet\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129320 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-env-overrides\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129354 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-etc-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.132950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129382 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-log-socket\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129387 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-iptables-alerter-script\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129395 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-slash\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129357 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-slash\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129422 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-node-log\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129437 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-host-slash\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-systemd\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129465 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-systemd\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129398 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-kubelet\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129482 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-ovnkube-config\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-ovn\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-cni-netd\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129571 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-openvswitch\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129592 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-systemd-units\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133390 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129618 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-run-ovn\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129647 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-cni-netd\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129658 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-systemd-units\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129734 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b01c382f-b95c-4d16-8805-d85d910cabc2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.129938 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b01c382f-b95c-4d16-8805-d85d910cabc2-ovnkube-script-lib\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.133902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.131241 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b01c382f-b95c-4d16-8805-d85d910cabc2-ovn-node-metrics-cert\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.258807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.138827 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-658d8\" (UniqueName: \"kubernetes.io/projected/3241e7fd-e5a5-4fb4-a358-805a8acdd3d8-kube-api-access-658d8\") pod \"iptables-alerter-4gr4l\" (UID: \"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8\") " pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.258807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.141486 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcq27\" (UniqueName: \"kubernetes.io/projected/b01c382f-b95c-4d16-8805-d85d910cabc2-kube-api-access-fcq27\") pod \"ovnkube-node-bnqhk\" (UID: \"b01c382f-b95c-4d16-8805-d85d910cabc2\") " pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.258807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.228645 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:06:52.258807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.246083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.267628 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.289506 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w4fv5" Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.310861 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b8c2ecc0c280c7d443a14ca82ee9438.slice/crio-9232a22e2f615a8d318272e9ef30f07374b79023e4555fcbb3d2954b6fe69166 WatchSource:0}: Error finding container 9232a22e2f615a8d318272e9ef30f07374b79023e4555fcbb3d2954b6fe69166: Status 404 returned error can't find the container with id 9232a22e2f615a8d318272e9ef30f07374b79023e4555fcbb3d2954b6fe69166 Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.311461 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe1b987fb07e7b0f33e157114c6d1fa9.slice/crio-a2d0e2730224e15a2795037f63b72833788fe7851d6eb544aafce08e3794db22 WatchSource:0}: Error finding container a2d0e2730224e15a2795037f63b72833788fe7851d6eb544aafce08e3794db22: Status 404 returned error can't find the container with id a2d0e2730224e15a2795037f63b72833788fe7851d6eb544aafce08e3794db22 Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.312068 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52923da4_c1f8_4898_88d7_e29b5a1a0233.slice/crio-3ae9a871924807a2a6fadda6ba8804401d233dc902b56ba4cd14a9ba90caf1b5 WatchSource:0}: Error finding container 3ae9a871924807a2a6fadda6ba8804401d233dc902b56ba4cd14a9ba90caf1b5: Status 404 returned error can't find the container with id 3ae9a871924807a2a6fadda6ba8804401d233dc902b56ba4cd14a9ba90caf1b5 Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.313191 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6q5j2" Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.316227 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hzcts" Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.316283 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.324915 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd460de7_89f7_4c87_ae92_8e9d778c342d.slice/crio-f800dcb9094043a8c2e88d670311974244974289759d5163bc7c9fa210eb3dda WatchSource:0}: Error finding container f800dcb9094043a8c2e88d670311974244974289759d5163bc7c9fa210eb3dda: Status 404 returned error can't find the container with id f800dcb9094043a8c2e88d670311974244974289759d5163bc7c9fa210eb3dda Jul 06 19:06:52.371521 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.366861 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5534e2f_a7cc_451f_947a_6072a500c589.slice/crio-b19a81af0cf22f511968313ad1ebec40e74b3a97a76a7b66c0f1d33bf9b233ee WatchSource:0}: Error finding container b19a81af0cf22f511968313ad1ebec40e74b3a97a76a7b66c0f1d33bf9b233ee: Status 404 returned error can't find the container with id b19a81af0cf22f511968313ad1ebec40e74b3a97a76a7b66c0f1d33bf9b233ee Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.389844 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4gr4l" Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.396294 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.399381 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3241e7fd_e5a5_4fb4_a358_805a8acdd3d8.slice/crio-7e906f23849021fe0ee1f77db5bf625b86f14c899c02ba4ed90b7bd62720b879 WatchSource:0}: Error finding container 7e906f23849021fe0ee1f77db5bf625b86f14c899c02ba4ed90b7bd62720b879: Status 404 returned error can't find the container with id 7e906f23849021fe0ee1f77db5bf625b86f14c899c02ba4ed90b7bd62720b879 Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.403848 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb01c382f_b95c_4d16_8805_d85d910cabc2.slice/crio-94f2ce8c28f4ed73a40fa818d7a41c9e5a075b842132a34364bdd3e25e085cf7 WatchSource:0}: Error finding container 94f2ce8c28f4ed73a40fa818d7a41c9e5a075b842132a34364bdd3e25e085cf7: Status 404 returned error can't find the container with id 94f2ce8c28f4ed73a40fa818d7a41c9e5a075b842132a34364bdd3e25e085cf7 Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.533093 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.533137 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.533156 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:52.533239 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:52.533243 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:52.533263 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:52.533282 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:52.533292 2559 projected.go:196] Error preparing data for projected volume kube-api-access-db8ct for pod openshift-network-diagnostics/network-check-target-765f5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:52.533296 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs podName:3678ac19-302c-49e3-adbd-cc07629c9bdd nodeName:}" failed. No retries permitted until 2026-07-06 19:06:53.533281441 +0000 UTC m=+2.962036509 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs") pod "network-metrics-daemon-grwxz" (UID: "3678ac19-302c-49e3-adbd-cc07629c9bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:52.558791 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:52.533309 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret podName:77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:53.533303235 +0000 UTC m=+2.962058302 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret") pod "global-pull-secret-syncer-v6rr5" (UID: "77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:52.560158 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:52.533340 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct podName:4a7b7608-819e-437b-bd60-6c7b7e75cbd7 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:53.533326779 +0000 UTC m=+2.962081870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-db8ct" (UniqueName: "kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct") pod "network-check-target-765f5" (UID: "4a7b7608-819e-437b-bd60-6c7b7e75cbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:52.754173 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.585354 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6389ea03_93de_4858_9ed7_3cef07c223d3.slice/crio-272fc140f2d2432bec40e39d701c50168bad7c34c21c1f3113bb0d1982f0e386 WatchSource:0}: Error finding container 272fc140f2d2432bec40e39d701c50168bad7c34c21c1f3113bb0d1982f0e386: Status 404 returned error can't find the container with id 272fc140f2d2432bec40e39d701c50168bad7c34c21c1f3113bb0d1982f0e386 Jul 06 19:06:52.754173 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:06:52.624175 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bca2c2a_1036_4ee8_9f69_13b6560290d2.slice/crio-efced90cbe45dd702aff3e029b1a2c97461acf82f7df2ef82fcd8627aa3b06a4 WatchSource:0}: Error finding container efced90cbe45dd702aff3e029b1a2c97461acf82f7df2ef82fcd8627aa3b06a4: Status 404 returned error can't find the container with id efced90cbe45dd702aff3e029b1a2c97461acf82f7df2ef82fcd8627aa3b06a4 Jul 06 19:06:52.899306 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.868563 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 19:06:52.981623 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.965951 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:01:51 +0000 UTC" deadline="2028-01-12 06:34:11.568119726 +0000 UTC" Jul 06 19:06:52.981623 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:52.966020 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13307h27m18.60210644s" Jul 06 19:06:53.079226 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.059172 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w4fv5" event={"ID":"52923da4-c1f8-4898-88d7-e29b5a1a0233","Type":"ContainerStarted","Data":"3ae9a871924807a2a6fadda6ba8804401d233dc902b56ba4cd14a9ba90caf1b5"} Jul 06 19:06:53.079226 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.061710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" event={"ID":"2b8c2ecc0c280c7d443a14ca82ee9438","Type":"ContainerStarted","Data":"9232a22e2f615a8d318272e9ef30f07374b79023e4555fcbb3d2954b6fe69166"} Jul 06 19:06:53.079226 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.064209 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxk4f" event={"ID":"b1c4173c-c47b-43ac-88b3-3df615495517","Type":"ContainerStarted","Data":"13dfec8321732559b02c0b13b9075b6d49e6bc494c904d34fda387578c02c303"} Jul 06 19:06:53.079226 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.068997 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" event={"ID":"6bca2c2a-1036-4ee8-9f69-13b6560290d2","Type":"ContainerStarted","Data":"efced90cbe45dd702aff3e029b1a2c97461acf82f7df2ef82fcd8627aa3b06a4"} Jul 06 19:06:53.088776 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.088741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4gr4l" event={"ID":"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8","Type":"ContainerStarted","Data":"7e906f23849021fe0ee1f77db5bf625b86f14c899c02ba4ed90b7bd62720b879"} Jul 06 19:06:53.091456 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.091428 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzcts" event={"ID":"cd460de7-89f7-4c87-ae92-8e9d778c342d","Type":"ContainerStarted","Data":"f800dcb9094043a8c2e88d670311974244974289759d5163bc7c9fa210eb3dda"} Jul 06 19:06:53.104485 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.104452 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6q5j2" event={"ID":"8707e886-cb93-4af3-be01-1c78a6c52b5f","Type":"ContainerStarted","Data":"1751d2fcfd9a2781cb6156fe5f55466312ee656c3ebe265d68fd62c1b7eeeb03"} Jul 06 19:06:53.108354 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.108324 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" event={"ID":"be1b987fb07e7b0f33e157114c6d1fa9","Type":"ContainerStarted","Data":"a2d0e2730224e15a2795037f63b72833788fe7851d6eb544aafce08e3794db22"} Jul 06 19:06:53.112666 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.112640 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" event={"ID":"6389ea03-93de-4858-9ed7-3cef07c223d3","Type":"ContainerStarted","Data":"272fc140f2d2432bec40e39d701c50168bad7c34c21c1f3113bb0d1982f0e386"} Jul 06 19:06:53.116692 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.116653 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"94f2ce8c28f4ed73a40fa818d7a41c9e5a075b842132a34364bdd3e25e085cf7"} Jul 06 19:06:53.125266 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.125208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerStarted","Data":"b19a81af0cf22f511968313ad1ebec40e74b3a97a76a7b66c0f1d33bf9b233ee"} Jul 06 19:06:53.542462 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.542382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:53.542462 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.542432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:53.542778 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.542476 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:53.542778 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:53.542606 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:53.542778 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:53.542668 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret podName:77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:55.542649802 +0000 UTC m=+4.971404876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret") pod "global-pull-secret-syncer-v6rr5" (UID: "77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:53.543609 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:53.543322 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:53.543609 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:53.543346 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:53.543609 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:53.543359 2559 projected.go:196] Error preparing data for projected volume kube-api-access-db8ct for pod openshift-network-diagnostics/network-check-target-765f5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:53.543609 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:53.543407 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct podName:4a7b7608-819e-437b-bd60-6c7b7e75cbd7 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:55.543389877 +0000 UTC m=+4.972144964 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-db8ct" (UniqueName: "kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct") pod "network-check-target-765f5" (UID: "4a7b7608-819e-437b-bd60-6c7b7e75cbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:53.543609 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:53.543479 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:53.543609 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:53.543513 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs podName:3678ac19-302c-49e3-adbd-cc07629c9bdd nodeName:}" failed. No retries permitted until 2026-07-06 19:06:55.543501586 +0000 UTC m=+4.972256656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs") pod "network-metrics-daemon-grwxz" (UID: "3678ac19-302c-49e3-adbd-cc07629c9bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:53.966972 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.966838 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 19:01:51 +0000 UTC" deadline="2028-04-14 15:04:07.002986016 +0000 UTC" Jul 06 19:06:53.966972 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:53.966877 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15547h57m13.03611286s" Jul 06 19:06:54.049649 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:54.048786 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:54.049649 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:54.048922 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:06:54.049649 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:54.049324 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:54.049649 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:54.049421 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:06:54.049649 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:54.049488 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:54.049649 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:54.049596 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:06:55.560854 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:55.560813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:55.561321 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:55.560893 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:55.561321 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:55.560923 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:55.561321 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:55.561088 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:55.561321 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:55.561150 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs podName:3678ac19-302c-49e3-adbd-cc07629c9bdd nodeName:}" failed. No retries permitted until 2026-07-06 19:06:59.561132055 +0000 UTC m=+8.989887126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs") pod "network-metrics-daemon-grwxz" (UID: "3678ac19-302c-49e3-adbd-cc07629c9bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:55.561869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:55.561551 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:55.561869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:55.561603 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret podName:77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae nodeName:}" failed. No retries permitted until 2026-07-06 19:06:59.561588184 +0000 UTC m=+8.990343257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret") pod "global-pull-secret-syncer-v6rr5" (UID: "77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:55.561869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:55.561686 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:55.561869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:55.561701 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:55.561869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:55.561714 2559 projected.go:196] Error preparing data for projected volume kube-api-access-db8ct for pod openshift-network-diagnostics/network-check-target-765f5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:55.561869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:55.561755 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct podName:4a7b7608-819e-437b-bd60-6c7b7e75cbd7 nodeName:}" failed. No retries permitted until 2026-07-06 19:06:59.561743092 +0000 UTC m=+8.990498162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-db8ct" (UniqueName: "kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct") pod "network-check-target-765f5" (UID: "4a7b7608-819e-437b-bd60-6c7b7e75cbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:56.049241 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:56.049208 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:56.049494 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:56.049324 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:06:56.049494 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:56.049359 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:56.049494 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:56.049365 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:56.049494 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:56.049479 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:06:56.049854 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:56.049598 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:06:58.049111 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:58.048882 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:58.049597 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:58.048919 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:58.049597 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:58.049203 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:06:58.049597 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:58.048920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:58.049597 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:58.049319 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:06:58.049597 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:58.049408 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:59.597432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:59.597478 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:06:59.597518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:59.597625 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:59.597655 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:59.597669 2559 projected.go:196] Error preparing data for projected volume kube-api-access-db8ct for pod openshift-network-diagnostics/network-check-target-765f5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:59.597684 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:59.597636 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:59.597725 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct podName:4a7b7608-819e-437b-bd60-6c7b7e75cbd7 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:07.597705904 +0000 UTC m=+17.026460976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-db8ct" (UniqueName: "kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct") pod "network-check-target-765f5" (UID: "4a7b7608-819e-437b-bd60-6c7b7e75cbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:59.597744 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs podName:3678ac19-302c-49e3-adbd-cc07629c9bdd nodeName:}" failed. No retries permitted until 2026-07-06 19:07:07.597735828 +0000 UTC m=+17.026490901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs") pod "network-metrics-daemon-grwxz" (UID: "3678ac19-302c-49e3-adbd-cc07629c9bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:06:59.598057 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:06:59.597756 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret podName:77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae nodeName:}" failed. No retries permitted until 2026-07-06 19:07:07.59775046 +0000 UTC m=+17.026505527 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret") pod "global-pull-secret-syncer-v6rr5" (UID: "77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:00.048883 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:00.048470 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:00.048883 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:00.048520 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:00.048883 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:00.048632 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:00.048883 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:00.048699 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:00.048883 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:00.048746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:00.048883 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:00.048811 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:02.048483 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:02.048398 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:02.048483 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:02.048441 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:02.049023 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:02.048516 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:02.049023 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:02.048537 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:02.049023 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:02.048615 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:02.049023 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:02.048689 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:04.048641 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:04.048569 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:04.048964 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:04.048569 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:04.048964 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:04.048684 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:04.048964 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:04.048569 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:04.048964 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:04.048746 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:04.048964 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:04.048842 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:06.049109 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:06.049073 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:06.049610 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:06.049082 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:06.049610 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:06.049196 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:06.049610 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:06.049296 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:06.049610 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:06.049082 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:06.049610 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:06.049433 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:07.657442 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:07.657406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:07.657899 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:07.657452 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:07.657899 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:07.657498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:07.657899 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:07.657618 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:07.657899 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:07.657673 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs podName:3678ac19-302c-49e3-adbd-cc07629c9bdd nodeName:}" failed. No retries permitted until 2026-07-06 19:07:23.657658764 +0000 UTC m=+33.086413836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs") pod "network-metrics-daemon-grwxz" (UID: "3678ac19-302c-49e3-adbd-cc07629c9bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:07.657899 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:07.657618 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:07.657899 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:07.657703 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret podName:77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae nodeName:}" failed. No retries permitted until 2026-07-06 19:07:23.657697279 +0000 UTC m=+33.086452347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret") pod "global-pull-secret-syncer-v6rr5" (UID: "77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:07.658121 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:07.657616 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:07.658121 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:07.657970 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:07.658121 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:07.657981 2559 projected.go:196] Error preparing data for projected volume kube-api-access-db8ct for pod openshift-network-diagnostics/network-check-target-765f5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:07.658121 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:07.658021 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct podName:4a7b7608-819e-437b-bd60-6c7b7e75cbd7 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:23.658011277 +0000 UTC m=+33.086766345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-db8ct" (UniqueName: "kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct") pod "network-check-target-765f5" (UID: "4a7b7608-819e-437b-bd60-6c7b7e75cbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:08.049018 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:08.048985 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:08.049018 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:08.049014 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:08.049224 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:08.049103 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:08.049224 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:08.049133 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:08.049224 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:08.049210 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:08.049392 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:08.049260 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:10.048779 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:10.048742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:10.049237 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:10.048742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:10.049237 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:10.048871 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:10.049237 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:10.048742 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:10.049237 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:10.048946 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:10.049237 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:10.049061 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:12.049095 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:12.049057 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:12.049095 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:12.049083 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:12.049596 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:12.049185 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:12.049596 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:12.049331 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:12.049596 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:12.049380 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:12.049596 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:12.049443 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:13.175923 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.175707 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6q5j2" event={"ID":"8707e886-cb93-4af3-be01-1c78a6c52b5f","Type":"ContainerStarted","Data":"f6b150d03bb90f477c9ee4e36ad210c21ee059f6a5b612848115f548c281cd7f"} Jul 06 19:07:13.177332 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.177308 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" event={"ID":"6389ea03-93de-4858-9ed7-3cef07c223d3","Type":"ContainerStarted","Data":"40a3355634a7774f4fa2fc9b499d9968c108489acea2a8c23822a3deb1e3c6a2"} Jul 06 19:07:13.179456 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.179439 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:07:13.179861 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.179841 2559 generic.go:356] "Generic (PLEG): container finished" podID="b01c382f-b95c-4d16-8805-d85d910cabc2" containerID="49cb77cb42a3d9c107f7c5f0601dbe1a773ccf9ece573fe0e2ffc45c186e7757" exitCode=1 Jul 06 19:07:13.179942 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.179906 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"7f15cec6784f36203cf30b5588dea9c967e31800ed2f29ee8539f1d95516dd1f"} Jul 06 19:07:13.179993 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.179974 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"2032b06ea8aeb29d65ef200412e6fa02e1ff73cc598c2cb64a1f9a9fb603c518"} Jul 06 19:07:13.180042 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.180027 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerDied","Data":"49cb77cb42a3d9c107f7c5f0601dbe1a773ccf9ece573fe0e2ffc45c186e7757"} Jul 06 19:07:13.180096 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.180076 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"10047ae12044d6c6afafd1ed10e8243db04fc37de08689c106bf9630c49d9a8c"} Jul 06 19:07:13.182642 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.182621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" event={"ID":"2b8c2ecc0c280c7d443a14ca82ee9438","Type":"ContainerStarted","Data":"fee4b33384d736ba0001fa615ce2401878b4a2bd00395b4ced350653b558b522"} Jul 06 19:07:13.197046 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.197000 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6q5j2" podStartSLOduration=1.767428752 podStartE2EDuration="22.196987813s" totalImagesPullingTime="20.429559061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:13.196837815 +0000 UTC m=+22.625592905" watchObservedRunningTime="2026-07-06 19:07:13.196987813 +0000 UTC m=+22.625742903" Jul 06 19:07:13.235734 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.235696 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n4cpc" podStartSLOduration=2.289677508 podStartE2EDuration="22.235681725s" totalImagesPullingTime="19.946004217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:13.216661759 +0000 UTC m=+22.645416854" watchObservedRunningTime="2026-07-06 19:07:13.235681725 +0000 UTC m=+22.664436815" Jul 06 19:07:13.235935 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:13.235918 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-163.ec2.internal" podStartSLOduration=22.235913724 podStartE2EDuration="22.235913724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:13.235585456 +0000 UTC m=+22.664340547" watchObservedRunningTime="2026-07-06 19:07:13.235913724 +0000 UTC m=+22.664668813" Jul 06 19:07:14.048789 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.048600 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:14.049028 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.048660 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:14.049028 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:14.048867 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:14.049028 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:14.048948 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:14.049028 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.048664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:14.049224 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:14.049059 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:14.187269 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.187243 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:07:14.187679 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.187638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"79b4f132a6971908081033c8d24932d1bcb759a7dd02f66b0b6c405532806f74"} Jul 06 19:07:14.187740 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.187723 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"a8c296ae7de50b2acecfeb1d3e9a9121f67415f611589f4282231eca579924a2"} Jul 06 19:07:14.189050 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.189025 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5534e2f-a7cc-451f-947a-6072a500c589" containerID="180b0a3c25e2de4d6e1402098ca44a51f4360bec9838803ed8e6b9fae4586769" exitCode=0 Jul 06 19:07:14.189181 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.189072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerDied","Data":"180b0a3c25e2de4d6e1402098ca44a51f4360bec9838803ed8e6b9fae4586769"} Jul 06 19:07:14.190660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.190594 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w4fv5" event={"ID":"52923da4-c1f8-4898-88d7-e29b5a1a0233","Type":"ContainerStarted","Data":"1e39c3d4dc434a243249a649791d797e0f70765c85ddbdaa90b6515a92a9a198"} Jul 06 19:07:14.192057 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.192020 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vxk4f" event={"ID":"b1c4173c-c47b-43ac-88b3-3df615495517","Type":"ContainerStarted","Data":"0e25909028910f35a0a91d816b75c941a0a7c45dff9abd0072fdfd1e0c3f0529"} Jul 06 19:07:14.193338 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.193318 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" event={"ID":"6bca2c2a-1036-4ee8-9f69-13b6560290d2","Type":"ContainerStarted","Data":"5bfdf5f99224fe851c65a1fbf0e703a3dcc1839577509e71e41048f6fc9213b8"} Jul 06 19:07:14.194656 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.194629 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4gr4l" event={"ID":"3241e7fd-e5a5-4fb4-a358-805a8acdd3d8","Type":"ContainerStarted","Data":"4590ddae90b2ffa77ec660096063e33edd2d20bbb4c5c0ca0ea3dfc44b11b8a5"} Jul 06 19:07:14.196039 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.196019 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hzcts" event={"ID":"cd460de7-89f7-4c87-ae92-8e9d778c342d","Type":"ContainerStarted","Data":"cbdbe29b9e9a7060239804c3d135ebbdf5ce44f6ded155855bda861e65b07e79"} Jul 06 19:07:14.197349 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.197328 2559 generic.go:356] "Generic (PLEG): container finished" podID="be1b987fb07e7b0f33e157114c6d1fa9" containerID="255d9d4a867384f8c1d3890fd31c299a6936e1ab2ccca71ecede04d2308c7606" exitCode=0 Jul 06 19:07:14.197439 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.197412 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" event={"ID":"be1b987fb07e7b0f33e157114c6d1fa9","Type":"ContainerDied","Data":"255d9d4a867384f8c1d3890fd31c299a6936e1ab2ccca71ecede04d2308c7606"} Jul 06 19:07:14.238047 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.238002 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4gr4l" podStartSLOduration=3.13780227 podStartE2EDuration="23.237984564s" totalImagesPullingTime="20.100182294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:14.237359118 +0000 UTC m=+23.666114210" watchObservedRunningTime="2026-07-06 19:07:14.237984564 +0000 UTC m=+23.666739655" Jul 06 19:07:14.253380 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.253326 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w4fv5" podStartSLOduration=3.040644711 podStartE2EDuration="23.253307645s" totalImagesPullingTime="20.212662934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:14.252701236 +0000 UTC m=+23.681456330" watchObservedRunningTime="2026-07-06 19:07:14.253307645 +0000 UTC m=+23.682062736" Jul 06 19:07:14.270135 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.270091 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hzcts" podStartSLOduration=7.614454188 podStartE2EDuration="23.270073109s" totalImagesPullingTime="15.655618921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:14.269548365 +0000 UTC m=+23.698303458" watchObservedRunningTime="2026-07-06 19:07:14.270073109 +0000 UTC m=+23.698828202" Jul 06 19:07:14.302534 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.302480 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vxk4f" podStartSLOduration=7.995182908 podStartE2EDuration="23.302465411s" totalImagesPullingTime="15.307282503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:14.302037985 +0000 UTC m=+23.730793077" watchObservedRunningTime="2026-07-06 19:07:14.302465411 +0000 UTC m=+23.731220500" Jul 06 19:07:14.863908 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:14.863877 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 19:07:15.006516 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:15.006280 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T19:07:14.863898047Z","UUID":"ead0fec2-5c5d-49eb-973c-cc7f72eef00c","Handler":null,"Name":"","Endpoint":""} Jul 06 19:07:15.008001 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:15.007981 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 19:07:15.008151 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:15.008020 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 19:07:15.202318 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:15.202285 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" event={"ID":"6bca2c2a-1036-4ee8-9f69-13b6560290d2","Type":"ContainerStarted","Data":"a2e8e997698fffec92a5519dc26b213197993f0852c8bd15f9936a0b3f879f7b"} Jul 06 19:07:15.204218 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:15.204180 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" event={"ID":"be1b987fb07e7b0f33e157114c6d1fa9","Type":"ContainerStarted","Data":"dc18327b3b399d0caf1b909d0ed65761d132fa7ce0a56a6875c963db137669af"} Jul 06 19:07:15.225617 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:15.225574 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-163.ec2.internal" podStartSLOduration=24.225561204 podStartE2EDuration="24.225561204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:15.224970048 +0000 UTC m=+24.653725138" watchObservedRunningTime="2026-07-06 19:07:15.225561204 +0000 UTC m=+24.654316294" Jul 06 19:07:16.048890 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:16.048852 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:16.048890 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:16.048891 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:16.049107 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:16.048893 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:16.049107 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:16.048963 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:16.049107 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:16.049045 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:16.049199 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:16.049133 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:16.209807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:16.209776 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:07:16.210244 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:16.210220 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"3b3df3c934bab975ea4177789fcfd67a691e24ff0c00e685e2c0f1390e06e34e"} Jul 06 19:07:16.212575 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:16.212543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" event={"ID":"6bca2c2a-1036-4ee8-9f69-13b6560290d2","Type":"ContainerStarted","Data":"1064237c1624b307347b5fe6a1c26df5f3ace522ccc5c93c237118850e4e7dd0"} Jul 06 19:07:16.233825 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:16.233783 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ztr95" podStartSLOduration=2.926689099 podStartE2EDuration="25.233769359s" totalImagesPullingTime="22.30708026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:16.233099197 +0000 UTC m=+25.661854280" watchObservedRunningTime="2026-07-06 19:07:16.233769359 +0000 UTC m=+25.662524449" Jul 06 19:07:18.048937 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:18.048747 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:18.049361 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:18.048763 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:18.049361 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:18.049032 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:18.049361 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:18.048781 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:18.049361 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:18.049110 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:18.049361 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:18.049183 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:19.164269 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:19.164241 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:07:19.164724 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:19.164708 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:07:19.165812 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:19.165790 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:07:19.166199 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:19.166185 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vxk4f" Jul 06 19:07:20.049166 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.048981 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:20.049367 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.049006 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:20.049367 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:20.049263 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:20.049367 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.049034 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:20.049367 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:20.049336 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:20.049516 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:20.049388 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:20.224539 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.224512 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:07:20.225247 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.225223 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"60c66a5e49a97e2183cd880047495e225539eb40e49266f95e9510813c18b59b"} Jul 06 19:07:20.228067 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.225999 2559 scope.go:117] "RemoveContainer" containerID="49cb77cb42a3d9c107f7c5f0601dbe1a773ccf9ece573fe0e2ffc45c186e7757" Jul 06 19:07:20.228067 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.226884 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:07:20.230376 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.230351 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5534e2f-a7cc-451f-947a-6072a500c589" containerID="57ba4bb68731629a444dcd069ccb6baf6d02ac4c42b42f14e86bc425c8abf94f" exitCode=0 Jul 06 19:07:20.230475 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.230434 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerDied","Data":"57ba4bb68731629a444dcd069ccb6baf6d02ac4c42b42f14e86bc425c8abf94f"} Jul 06 19:07:20.247345 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:20.247327 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:07:21.237656 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.237630 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:07:21.238122 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.238092 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" event={"ID":"b01c382f-b95c-4d16-8805-d85d910cabc2","Type":"ContainerStarted","Data":"6cc2b325bd96ee4ee11b889d5372baab6116182eeb4c774b36369092f4958437"} Jul 06 19:07:21.238347 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.238330 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:07:21.238510 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.238484 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:07:21.241632 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.241566 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerStarted","Data":"007501a51296e244ec06b5980af4ef7adc2ea9dc64f195aefcbb7703a666ccc5"} Jul 06 19:07:21.254997 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.254972 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:07:21.265766 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.265716 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" podStartSLOduration=10.098098716 podStartE2EDuration="30.265698609s" totalImagesPullingTime="20.167599893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:21.265669169 +0000 UTC m=+30.694424261" watchObservedRunningTime="2026-07-06 19:07:21.265698609 +0000 UTC m=+30.694453699" Jul 06 19:07:21.474114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.474086 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-grwxz"] Jul 06 19:07:21.474270 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.474194 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:21.474315 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:21.474269 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:21.477162 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.477135 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v6rr5"] Jul 06 19:07:21.477283 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.477238 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:21.477354 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:21.477335 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:21.477798 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.477779 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-765f5"] Jul 06 19:07:21.477904 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:21.477867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:21.477953 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:21.477937 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:22.245619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:22.245517 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5534e2f-a7cc-451f-947a-6072a500c589" containerID="007501a51296e244ec06b5980af4ef7adc2ea9dc64f195aefcbb7703a666ccc5" exitCode=0 Jul 06 19:07:22.245619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:22.245560 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerDied","Data":"007501a51296e244ec06b5980af4ef7adc2ea9dc64f195aefcbb7703a666ccc5"} Jul 06 19:07:23.048824 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:23.048796 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:23.048979 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:23.048800 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:23.048979 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:23.048920 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:23.049059 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.048994 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:23.049059 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.048897 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:23.049123 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.049062 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:23.682350 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:23.682188 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:23.682370 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.682407 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:23.682419 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.682434 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.682449 2559 projected.go:196] Error preparing data for projected volume kube-api-access-db8ct for pod openshift-network-diagnostics/network-check-target-765f5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.682507 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.682541 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct podName:4a7b7608-819e-437b-bd60-6c7b7e75cbd7 nodeName:}" failed. No retries permitted until 2026-07-06 19:07:55.68250038 +0000 UTC m=+65.111255465 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-db8ct" (UniqueName: "kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct") pod "network-check-target-765f5" (UID: "4a7b7608-819e-437b-bd60-6c7b7e75cbd7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.682547 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.682588 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs podName:3678ac19-302c-49e3-adbd-cc07629c9bdd nodeName:}" failed. No retries permitted until 2026-07-06 19:07:55.682571153 +0000 UTC m=+65.111326238 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs") pod "network-metrics-daemon-grwxz" (UID: "3678ac19-302c-49e3-adbd-cc07629c9bdd") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 19:07:23.682752 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:23.682602 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret podName:77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae nodeName:}" failed. No retries permitted until 2026-07-06 19:07:55.682595862 +0000 UTC m=+65.111350930 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret") pod "global-pull-secret-syncer-v6rr5" (UID: "77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae") : object "kube-system"/"original-pull-secret" not registered Jul 06 19:07:24.251576 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:24.251546 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5534e2f-a7cc-451f-947a-6072a500c589" containerID="e811a813d18558d455de30773d3d69d6307d8da021a6860f8d20749f12f45f8e" exitCode=0 Jul 06 19:07:24.251576 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:24.251586 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerDied","Data":"e811a813d18558d455de30773d3d69d6307d8da021a6860f8d20749f12f45f8e"} Jul 06 19:07:25.049120 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.049019 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:25.049120 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.049061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:25.049120 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.049066 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:25.049708 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:25.049140 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-765f5" podUID="4a7b7608-819e-437b-bd60-6c7b7e75cbd7" Jul 06 19:07:25.049708 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:25.049219 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v6rr5" podUID="77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae" Jul 06 19:07:25.049708 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:25.049329 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-grwxz" podUID="3678ac19-302c-49e3-adbd-cc07629c9bdd" Jul 06 19:07:25.323367 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.323291 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-163.ec2.internal" event="NodeReady" Jul 06 19:07:25.323513 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.323419 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 19:07:25.362319 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.362282 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cf854d8ff-nml4j"] Jul 06 19:07:25.364272 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.364257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.366395 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.366379 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbqzz\"" Jul 06 19:07:25.367497 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.367479 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 19:07:25.367618 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.367597 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 19:07:25.367977 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.367962 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 19:07:25.374789 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.374766 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 19:07:25.376172 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.376156 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-b2ffv"] Jul 06 19:07:25.377838 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.377825 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.380348 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.380326 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8qsj9\"" Jul 06 19:07:25.380435 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.380352 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 19:07:25.380435 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.380381 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 19:07:25.385069 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.385042 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf854d8ff-nml4j"] Jul 06 19:07:25.385540 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.385512 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7p69l"] Jul 06 19:07:25.387340 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.387326 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7p69l" Jul 06 19:07:25.389605 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.389585 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 19:07:25.389860 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.389847 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 19:07:25.389981 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.389966 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 19:07:25.390137 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.390123 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nltxv\"" Jul 06 19:07:25.398776 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.398756 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7p69l"] Jul 06 19:07:25.404656 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.404639 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b2ffv"] Jul 06 19:07:25.495713 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-certificates\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.495885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cwbm\" (UniqueName: \"kubernetes.io/projected/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-kube-api-access-4cwbm\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.495885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495745 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpgjm\" (UniqueName: \"kubernetes.io/projected/fbfedbd0-94f2-496b-a82a-e1e90fe0cea0-kube-api-access-vpgjm\") pod \"ingress-canary-7p69l\" (UID: \"fbfedbd0-94f2-496b-a82a-e1e90fe0cea0\") " pod="openshift-ingress-canary/ingress-canary-7p69l" Jul 06 19:07:25.495885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495777 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgqjr\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-kube-api-access-kgqjr\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.495885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495846 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/571dfc0f-615f-4a8f-a87a-deed6f0a802d-ca-trust-extracted\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.496081 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495883 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-installation-pull-secrets\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.496081 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495915 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-trusted-ca\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.496081 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495969 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-config-volume\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.496081 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.495994 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-image-registry-private-configuration\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.496081 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.496039 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbfedbd0-94f2-496b-a82a-e1e90fe0cea0-cert\") pod \"ingress-canary-7p69l\" (UID: \"fbfedbd0-94f2-496b-a82a-e1e90fe0cea0\") " pod="openshift-ingress-canary/ingress-canary-7p69l" Jul 06 19:07:25.496307 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.496087 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-tmp-dir\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.496307 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.496119 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.496307 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.496161 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.496307 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.496194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-bound-sa-token\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.579483 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.579401 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:25.597352 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-tmp-dir\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.597352 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597354 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.597626 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597372 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.597626 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597399 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-bound-sa-token\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.597626 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597486 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-certificates\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.597626 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:25.597513 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:25.597626 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cwbm\" (UniqueName: \"kubernetes.io/projected/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-kube-api-access-4cwbm\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.597887 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:25.597646 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls podName:f5a778b2-3edb-4fb2-a305-b847e04a3b8c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:26.097585285 +0000 UTC m=+35.526340371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls") pod "dns-default-b2ffv" (UID: "f5a778b2-3edb-4fb2-a305-b847e04a3b8c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:25.597887 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:25.597679 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:25.597887 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:25.597697 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf854d8ff-nml4j: secret "image-registry-tls" not found Jul 06 19:07:25.597887 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597701 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpgjm\" (UniqueName: \"kubernetes.io/projected/fbfedbd0-94f2-496b-a82a-e1e90fe0cea0-kube-api-access-vpgjm\") pod \"ingress-canary-7p69l\" (UID: \"fbfedbd0-94f2-496b-a82a-e1e90fe0cea0\") " pod="openshift-ingress-canary/ingress-canary-7p69l" Jul 06 19:07:25.597887 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597733 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgqjr\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-kube-api-access-kgqjr\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.597887 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597742 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-tmp-dir\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.597887 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:25.597753 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls podName:571dfc0f-615f-4a8f-a87a-deed6f0a802d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:26.097735904 +0000 UTC m=+35.526490989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls") pod "image-registry-6cf854d8ff-nml4j" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d") : secret "image-registry-tls" not found Jul 06 19:07:25.598243 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/571dfc0f-615f-4a8f-a87a-deed6f0a802d-ca-trust-extracted\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.598243 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597953 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-installation-pull-secrets\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.598243 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.597988 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-trusted-ca\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.598243 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.598147 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-certificates\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.598243 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.598197 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-config-volume\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.598243 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.598227 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-image-registry-private-configuration\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.598504 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.598253 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbfedbd0-94f2-496b-a82a-e1e90fe0cea0-cert\") pod \"ingress-canary-7p69l\" (UID: \"fbfedbd0-94f2-496b-a82a-e1e90fe0cea0\") " pod="openshift-ingress-canary/ingress-canary-7p69l" Jul 06 19:07:25.598504 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.598310 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/571dfc0f-615f-4a8f-a87a-deed6f0a802d-ca-trust-extracted\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.599112 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.598988 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-config-volume\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.599112 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.599010 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-trusted-ca\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.602837 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.602815 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-image-registry-private-configuration\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.603009 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.602838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-installation-pull-secrets\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.603009 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.602854 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fbfedbd0-94f2-496b-a82a-e1e90fe0cea0-cert\") pod \"ingress-canary-7p69l\" (UID: \"fbfedbd0-94f2-496b-a82a-e1e90fe0cea0\") " pod="openshift-ingress-canary/ingress-canary-7p69l" Jul 06 19:07:25.607080 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.607059 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpgjm\" (UniqueName: \"kubernetes.io/projected/fbfedbd0-94f2-496b-a82a-e1e90fe0cea0-kube-api-access-vpgjm\") pod \"ingress-canary-7p69l\" (UID: \"fbfedbd0-94f2-496b-a82a-e1e90fe0cea0\") " pod="openshift-ingress-canary/ingress-canary-7p69l" Jul 06 19:07:25.607396 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.607375 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-bound-sa-token\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.607486 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.607466 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgqjr\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-kube-api-access-kgqjr\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:25.608488 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.608470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cwbm\" (UniqueName: \"kubernetes.io/projected/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-kube-api-access-4cwbm\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:25.678238 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.678202 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:25.695098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.695071 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7p69l" Jul 06 19:07:25.855217 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:25.855137 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7p69l"] Jul 06 19:07:25.860003 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:07:25.859956 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbfedbd0_94f2_496b_a82a_e1e90fe0cea0.slice/crio-f8bc6348f72d4db9ec1453de0eb9392c541568597e2f3ea21948952aeaa2fd3a WatchSource:0}: Error finding container f8bc6348f72d4db9ec1453de0eb9392c541568597e2f3ea21948952aeaa2fd3a: Status 404 returned error can't find the container with id f8bc6348f72d4db9ec1453de0eb9392c541568597e2f3ea21948952aeaa2fd3a Jul 06 19:07:26.110926 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:26.110886 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:26.111559 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:26.110937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:26.111559 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:26.111060 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:26.111559 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:26.111074 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf854d8ff-nml4j: secret "image-registry-tls" not found Jul 06 19:07:26.111559 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:26.111074 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:26.111559 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:26.111144 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls podName:f5a778b2-3edb-4fb2-a305-b847e04a3b8c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:27.111123232 +0000 UTC m=+36.539878306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls") pod "dns-default-b2ffv" (UID: "f5a778b2-3edb-4fb2-a305-b847e04a3b8c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:26.111559 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:26.111166 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls podName:571dfc0f-615f-4a8f-a87a-deed6f0a802d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:27.111156322 +0000 UTC m=+36.539911406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls") pod "image-registry-6cf854d8ff-nml4j" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d") : secret "image-registry-tls" not found Jul 06 19:07:26.260628 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:26.260586 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7p69l" event={"ID":"fbfedbd0-94f2-496b-a82a-e1e90fe0cea0","Type":"ContainerStarted","Data":"f8bc6348f72d4db9ec1453de0eb9392c541568597e2f3ea21948952aeaa2fd3a"} Jul 06 19:07:27.049295 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.049043 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:27.050877 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.050043 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:27.050877 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.050373 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:27.052056 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.052031 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:07:27.052896 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.052878 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:07:27.053124 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.053104 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:07:27.053642 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.053300 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s5gst\"" Jul 06 19:07:27.053642 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.053421 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:07:27.053642 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.053544 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h4n82\"" Jul 06 19:07:27.120035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.120002 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:27.120466 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:27.120042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:27.120466 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:27.120169 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:27.120466 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:27.120192 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:27.120466 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:27.120206 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf854d8ff-nml4j: secret "image-registry-tls" not found Jul 06 19:07:27.120466 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:27.120237 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls podName:f5a778b2-3edb-4fb2-a305-b847e04a3b8c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:29.120218031 +0000 UTC m=+38.548973122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls") pod "dns-default-b2ffv" (UID: "f5a778b2-3edb-4fb2-a305-b847e04a3b8c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:27.120466 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:27.120252 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls podName:571dfc0f-615f-4a8f-a87a-deed6f0a802d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:29.120245768 +0000 UTC m=+38.549000840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls") pod "image-registry-6cf854d8ff-nml4j" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d") : secret "image-registry-tls" not found Jul 06 19:07:29.140104 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:29.140074 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:29.140104 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:29.140109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:29.140673 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:29.140243 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:29.140673 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:29.140258 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:29.140673 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:29.140272 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf854d8ff-nml4j: secret "image-registry-tls" not found Jul 06 19:07:29.140673 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:29.140319 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls podName:f5a778b2-3edb-4fb2-a305-b847e04a3b8c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:33.140300665 +0000 UTC m=+42.569055760 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls") pod "dns-default-b2ffv" (UID: "f5a778b2-3edb-4fb2-a305-b847e04a3b8c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:29.140673 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:29.140338 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls podName:571dfc0f-615f-4a8f-a87a-deed6f0a802d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:33.140329167 +0000 UTC m=+42.569084237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls") pod "image-registry-6cf854d8ff-nml4j" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d") : secret "image-registry-tls" not found Jul 06 19:07:29.763439 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:29.763406 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:29.832088 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:29.832056 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:30.273646 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:30.273576 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5534e2f-a7cc-451f-947a-6072a500c589" containerID="c40f893d3ae8c53b08cf79c6dba302f23f859ca6191cbddc5ff7f9bd5b56cda5" exitCode=0 Jul 06 19:07:30.274039 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:30.273657 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerDied","Data":"c40f893d3ae8c53b08cf79c6dba302f23f859ca6191cbddc5ff7f9bd5b56cda5"} Jul 06 19:07:30.275164 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:30.275140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7p69l" event={"ID":"fbfedbd0-94f2-496b-a82a-e1e90fe0cea0","Type":"ContainerStarted","Data":"cae13a1b27edcd133c8cee418f3c218fc850897309d79721885bfc080f756b73"} Jul 06 19:07:30.319202 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:30.319153 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7p69l" podStartSLOduration=1.207912831 podStartE2EDuration="5.319135094s" totalImagesPullingTime="4.111222263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:30.318682223 +0000 UTC m=+39.747437315" watchObservedRunningTime="2026-07-06 19:07:30.319135094 +0000 UTC m=+39.747890205" Jul 06 19:07:30.748868 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:30.748827 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:30.841930 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:30.841898 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:30.944072 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:30.944034 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:31.280393 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:31.280360 2559 generic.go:356] "Generic (PLEG): container finished" podID="e5534e2f-a7cc-451f-947a-6072a500c589" containerID="9c681df3d94f1a22c84cc33f915134e34924ac61020fdc583ac434ec46f46e42" exitCode=0 Jul 06 19:07:31.280783 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:31.280436 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerDied","Data":"9c681df3d94f1a22c84cc33f915134e34924ac61020fdc583ac434ec46f46e42"} Jul 06 19:07:32.285846 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:32.285796 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l624c" event={"ID":"e5534e2f-a7cc-451f-947a-6072a500c589","Type":"ContainerStarted","Data":"9702875148f2f30a6c1ffd262d6c94c5a9a5c0c2de486efad40275b533bc0df8"} Jul 06 19:07:32.310773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:32.310719 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l624c" podStartSLOduration=8.196704267 podStartE2EDuration="41.310702473s" totalImagesPullingTime="33.113998206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:07:32.309289073 +0000 UTC m=+41.738044164" watchObservedRunningTime="2026-07-06 19:07:32.310702473 +0000 UTC m=+41.739457588" Jul 06 19:07:32.438488 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:32.438455 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:32.541344 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:32.541263 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:32.742989 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:32.740736 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:32.842298 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:32.842213 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:32.916270 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:32.916236 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" limit=1024 Jul 06 19:07:33.168724 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:33.168690 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:33.168885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:33.168727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:33.168885 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:33.168840 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:33.168885 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:33.168878 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:33.168983 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:33.168889 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf854d8ff-nml4j: secret "image-registry-tls" not found Jul 06 19:07:33.168983 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:33.168905 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls podName:f5a778b2-3edb-4fb2-a305-b847e04a3b8c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:41.168890025 +0000 UTC m=+50.597645093 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls") pod "dns-default-b2ffv" (UID: "f5a778b2-3edb-4fb2-a305-b847e04a3b8c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:33.168983 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:33.168931 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls podName:571dfc0f-615f-4a8f-a87a-deed6f0a802d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:41.168920092 +0000 UTC m=+50.597675160 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls") pod "image-registry-6cf854d8ff-nml4j" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d") : secret "image-registry-tls" not found Jul 06 19:07:41.226065 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:41.226026 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:41.226065 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:41.226065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:41.226487 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:41.226188 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:41.226487 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:41.226253 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls podName:f5a778b2-3edb-4fb2-a305-b847e04a3b8c nodeName:}" failed. No retries permitted until 2026-07-06 19:07:57.226236802 +0000 UTC m=+66.654991875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls") pod "dns-default-b2ffv" (UID: "f5a778b2-3edb-4fb2-a305-b847e04a3b8c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:41.226487 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:41.226191 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:41.226487 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:41.226297 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf854d8ff-nml4j: secret "image-registry-tls" not found Jul 06 19:07:41.226487 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:41.226347 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls podName:571dfc0f-615f-4a8f-a87a-deed6f0a802d nodeName:}" failed. No retries permitted until 2026-07-06 19:07:57.226335078 +0000 UTC m=+66.655090169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls") pod "image-registry-6cf854d8ff-nml4j" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d") : secret "image-registry-tls" not found Jul 06 19:07:53.258207 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:53.258178 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bnqhk" Jul 06 19:07:55.733402 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.733362 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:55.733402 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.733401 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:07:55.733929 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.733431 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:55.736225 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.736197 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 19:07:55.736612 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.736222 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 19:07:55.736905 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.736328 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 19:07:55.743724 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:55.743698 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 19:07:55.743830 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:55.743767 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs podName:3678ac19-302c-49e3-adbd-cc07629c9bdd nodeName:}" failed. No retries permitted until 2026-07-06 19:08:59.743749136 +0000 UTC m=+129.172504220 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs") pod "network-metrics-daemon-grwxz" (UID: "3678ac19-302c-49e3-adbd-cc07629c9bdd") : secret "metrics-daemon-secret" not found Jul 06 19:07:55.745548 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.745518 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 19:07:55.746761 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.746739 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae-original-pull-secret\") pod \"global-pull-secret-syncer-v6rr5\" (UID: \"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae\") " pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:55.756316 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.756294 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db8ct\" (UniqueName: \"kubernetes.io/projected/4a7b7608-819e-437b-bd60-6c7b7e75cbd7-kube-api-access-db8ct\") pod \"network-check-target-765f5\" (UID: \"4a7b7608-819e-437b-bd60-6c7b7e75cbd7\") " pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:55.866662 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.866627 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s5gst\"" Jul 06 19:07:55.872434 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.872420 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v6rr5" Jul 06 19:07:55.874568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:55.874551 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:07:56.006774 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:56.006692 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-765f5"] Jul 06 19:07:56.009900 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:07:56.009868 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a7b7608_819e_437b_bd60_6c7b7e75cbd7.slice/crio-5fa2cadb68d5e47141746d55801b7df2adce1f853faebe238b2ebcfd8bf59433 WatchSource:0}: Error finding container 5fa2cadb68d5e47141746d55801b7df2adce1f853faebe238b2ebcfd8bf59433: Status 404 returned error can't find the container with id 5fa2cadb68d5e47141746d55801b7df2adce1f853faebe238b2ebcfd8bf59433 Jul 06 19:07:56.020934 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:56.020908 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v6rr5"] Jul 06 19:07:56.024052 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:07:56.024025 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e12c0d_3c8f_451c_a52f_e9d5fc2c16ae.slice/crio-febb18f66409de66710b2da794e9436bcacb6f2d8bf380d2b5c6e70c4b9b11df WatchSource:0}: Error finding container febb18f66409de66710b2da794e9436bcacb6f2d8bf380d2b5c6e70c4b9b11df: Status 404 returned error can't find the container with id febb18f66409de66710b2da794e9436bcacb6f2d8bf380d2b5c6e70c4b9b11df Jul 06 19:07:56.339324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:56.339208 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v6rr5" event={"ID":"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae","Type":"ContainerStarted","Data":"febb18f66409de66710b2da794e9436bcacb6f2d8bf380d2b5c6e70c4b9b11df"} Jul 06 19:07:56.340223 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:56.340200 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-765f5" event={"ID":"4a7b7608-819e-437b-bd60-6c7b7e75cbd7","Type":"ContainerStarted","Data":"5fa2cadb68d5e47141746d55801b7df2adce1f853faebe238b2ebcfd8bf59433"} Jul 06 19:07:57.244035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:57.244001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:07:57.244035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:57.244039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:07:57.244513 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:57.244173 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 19:07:57.244513 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:57.244179 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 19:07:57.244513 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:57.244255 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls podName:f5a778b2-3edb-4fb2-a305-b847e04a3b8c nodeName:}" failed. No retries permitted until 2026-07-06 19:08:29.244234703 +0000 UTC m=+98.672989778 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls") pod "dns-default-b2ffv" (UID: "f5a778b2-3edb-4fb2-a305-b847e04a3b8c") : secret "dns-default-metrics-tls" not found Jul 06 19:07:57.244513 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:57.244186 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cf854d8ff-nml4j: secret "image-registry-tls" not found Jul 06 19:07:57.244513 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:07:57.244319 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls podName:571dfc0f-615f-4a8f-a87a-deed6f0a802d nodeName:}" failed. No retries permitted until 2026-07-06 19:08:29.244307314 +0000 UTC m=+98.673062395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls") pod "image-registry-6cf854d8ff-nml4j" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d") : secret "image-registry-tls" not found Jul 06 19:07:58.514035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.513821 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4"] Jul 06 19:07:58.516759 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.516737 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4" Jul 06 19:07:58.518772 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.518740 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dzf2z\"" Jul 06 19:07:58.539660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.538783 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp"] Jul 06 19:07:58.540884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.540861 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4"] Jul 06 19:07:58.540979 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.540958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.543937 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.543914 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 06 19:07:58.543937 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.543936 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-w9prw\"" Jul 06 19:07:58.544244 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.544213 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 06 19:07:58.544362 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.544269 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 06 19:07:58.544506 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.544489 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 06 19:07:58.555839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.555815 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp"] Jul 06 19:07:58.556085 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.556060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhggw\" (UniqueName: \"kubernetes.io/projected/3b9e9edc-7b6e-41c5-9004-783341623143-kube-api-access-bhggw\") pod \"network-check-source-989f8b8dc-w7ng4\" (UID: \"3b9e9edc-7b6e-41c5-9004-783341623143\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4" Jul 06 19:07:58.657085 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.657046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mztkp\" (UniqueName: \"kubernetes.io/projected/d05a83c2-2366-47f6-8f84-94f66c7a5499-kube-api-access-mztkp\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.657272 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.657152 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhggw\" (UniqueName: \"kubernetes.io/projected/3b9e9edc-7b6e-41c5-9004-783341623143-kube-api-access-bhggw\") pod \"network-check-source-989f8b8dc-w7ng4\" (UID: \"3b9e9edc-7b6e-41c5-9004-783341623143\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4" Jul 06 19:07:58.657272 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.657187 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d05a83c2-2366-47f6-8f84-94f66c7a5499-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.657272 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.657229 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d05a83c2-2366-47f6-8f84-94f66c7a5499-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.672734 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.672701 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhggw\" (UniqueName: \"kubernetes.io/projected/3b9e9edc-7b6e-41c5-9004-783341623143-kube-api-access-bhggw\") pod \"network-check-source-989f8b8dc-w7ng4\" (UID: \"3b9e9edc-7b6e-41c5-9004-783341623143\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4" Jul 06 19:07:58.758510 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.758475 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d05a83c2-2366-47f6-8f84-94f66c7a5499-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.758676 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.758558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mztkp\" (UniqueName: \"kubernetes.io/projected/d05a83c2-2366-47f6-8f84-94f66c7a5499-kube-api-access-mztkp\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.758676 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.758640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d05a83c2-2366-47f6-8f84-94f66c7a5499-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.759244 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.759217 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d05a83c2-2366-47f6-8f84-94f66c7a5499-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.761104 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.761073 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d05a83c2-2366-47f6-8f84-94f66c7a5499-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.771315 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.771248 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mztkp\" (UniqueName: \"kubernetes.io/projected/d05a83c2-2366-47f6-8f84-94f66c7a5499-kube-api-access-mztkp\") pod \"kube-storage-version-migrator-operator-846bf668f7-qvpqp\" (UID: \"d05a83c2-2366-47f6-8f84-94f66c7a5499\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:07:58.827242 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.827205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4" Jul 06 19:07:58.850491 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:07:58.850453 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" Jul 06 19:08:00.905608 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:00.905579 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4"] Jul 06 19:08:00.909072 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:00.909039 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b9e9edc_7b6e_41c5_9004_783341623143.slice/crio-1ff44c90eac46ac3cf3cff89c3afcea083925e41921a68ee33cf74ef46ac1de3 WatchSource:0}: Error finding container 1ff44c90eac46ac3cf3cff89c3afcea083925e41921a68ee33cf74ef46ac1de3: Status 404 returned error can't find the container with id 1ff44c90eac46ac3cf3cff89c3afcea083925e41921a68ee33cf74ef46ac1de3 Jul 06 19:08:00.922582 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:00.922558 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp"] Jul 06 19:08:00.927096 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:00.927075 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd05a83c2_2366_47f6_8f84_94f66c7a5499.slice/crio-2d27d4dd2e969b3678a55382d53ab426eaeaaead2b9d94eb645b3162de7fae50 WatchSource:0}: Error finding container 2d27d4dd2e969b3678a55382d53ab426eaeaaead2b9d94eb645b3162de7fae50: Status 404 returned error can't find the container with id 2d27d4dd2e969b3678a55382d53ab426eaeaaead2b9d94eb645b3162de7fae50 Jul 06 19:08:01.354006 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.353968 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-765f5" event={"ID":"4a7b7608-819e-437b-bd60-6c7b7e75cbd7","Type":"ContainerStarted","Data":"86302102a1f165f7dfd8ede50b2a5ab52f1385705a728a82f3830dca8417b51b"} Jul 06 19:08:01.354201 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.354078 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:08:01.355247 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.355213 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" event={"ID":"d05a83c2-2366-47f6-8f84-94f66c7a5499","Type":"ContainerStarted","Data":"2d27d4dd2e969b3678a55382d53ab426eaeaaead2b9d94eb645b3162de7fae50"} Jul 06 19:08:01.356598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.356574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v6rr5" event={"ID":"77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae","Type":"ContainerStarted","Data":"d503c409a005f92446c03145a64fe26351a6bd2ad00b152903b2a68ea79e656e"} Jul 06 19:08:01.357979 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.357950 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4" event={"ID":"3b9e9edc-7b6e-41c5-9004-783341623143","Type":"ContainerStarted","Data":"ec747b7390cb9a3a9d4747070eea4a69db19462fb19fc580df53975a0380ad01"} Jul 06 19:08:01.358075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.357986 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4" event={"ID":"3b9e9edc-7b6e-41c5-9004-783341623143","Type":"ContainerStarted","Data":"1ff44c90eac46ac3cf3cff89c3afcea083925e41921a68ee33cf74ef46ac1de3"} Jul 06 19:08:01.375396 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.375344 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-765f5" podStartSLOduration=65.614931399 podStartE2EDuration="1m10.375330537s" totalImagesPullingTime="4.760399138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:01.374722737 +0000 UTC m=+70.803477828" watchObservedRunningTime="2026-07-06 19:08:01.375330537 +0000 UTC m=+70.804085620" Jul 06 19:08:01.392354 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.392308 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-w7ng4" podStartSLOduration=3.392298666 podStartE2EDuration="3.392298666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:01.391758337 +0000 UTC m=+70.820513428" watchObservedRunningTime="2026-07-06 19:08:01.392298666 +0000 UTC m=+70.821053786" Jul 06 19:08:01.405740 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:01.405696 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v6rr5" podStartSLOduration=65.65052395 podStartE2EDuration="1m10.4056805s" totalImagesPullingTime="4.75515655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:01.405067476 +0000 UTC m=+70.833822563" watchObservedRunningTime="2026-07-06 19:08:01.4056805 +0000 UTC m=+70.834435586" Jul 06 19:08:04.368047 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.368010 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" event={"ID":"d05a83c2-2366-47f6-8f84-94f66c7a5499","Type":"ContainerStarted","Data":"cd5f12eff37bf0313e5519694b6105591b8537f53fdb89638777dd2500d1cee1"} Jul 06 19:08:04.384883 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.384828 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" podStartSLOduration=3.3820222859999998 podStartE2EDuration="6.384808353s" totalImagesPullingTime="3.002786067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:04.383750936 +0000 UTC m=+73.812506028" watchObservedRunningTime="2026-07-06 19:08:04.384808353 +0000 UTC m=+73.813563444" Jul 06 19:08:04.796380 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.796300 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rpdvc"] Jul 06 19:08:04.814903 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.814869 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rpdvc"] Jul 06 19:08:04.815054 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.815021 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:04.817735 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.817700 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 19:08:04.817873 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.817737 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 19:08:04.818455 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.818428 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 19:08:04.818586 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.818466 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kwzb4\"" Jul 06 19:08:04.818586 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.818507 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 19:08:04.906618 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.906583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:04.906618 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.906624 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-crio-socket\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:04.906871 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.906727 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:04.906871 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.906779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-data-volume\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:04.906871 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:04.906813 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dx9d\" (UniqueName: \"kubernetes.io/projected/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-api-access-6dx9d\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.007239 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.007202 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.007424 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.007249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-data-volume\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.007424 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.007272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dx9d\" (UniqueName: \"kubernetes.io/projected/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-api-access-6dx9d\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.007424 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.007301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.007424 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.007322 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-crio-socket\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.007424 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.007415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-crio-socket\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.007711 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:05.007422 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:08:05.007711 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:05.007440 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:05.007711 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:05.007501 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:05.507482122 +0000 UTC m=+74.936237189 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : configmap "kube-rbac-proxy" not found Jul 06 19:08:05.007711 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:05.007520 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:05.507511664 +0000 UTC m=+74.936266732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:05.007711 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.007668 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-data-volume\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.016004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.015976 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dx9d\" (UniqueName: \"kubernetes.io/projected/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-api-access-6dx9d\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.509954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.509916 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.510403 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.509992 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:05.510403 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:05.510132 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:05.510403 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:05.510149 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:08:05.510403 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:05.510206 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:06.510187484 +0000 UTC m=+75.938942575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:05.510403 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:05.510224 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:06.510215265 +0000 UTC m=+75.938970333 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : configmap "kube-rbac-proxy" not found Jul 06 19:08:05.751084 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.751048 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g"] Jul 06 19:08:05.753478 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.753452 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" Jul 06 19:08:05.756452 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.756433 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 06 19:08:05.756579 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.756534 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 06 19:08:05.757271 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.757254 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-xfsgh\"" Jul 06 19:08:05.767441 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.767386 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g"] Jul 06 19:08:05.813563 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.813518 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nppt4\" (UniqueName: \"kubernetes.io/projected/a1cad0dd-89e4-4176-b225-f29d2a08db9d-kube-api-access-nppt4\") pod \"migrator-d57d58cc9-kkw6g\" (UID: \"a1cad0dd-89e4-4176-b225-f29d2a08db9d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" Jul 06 19:08:05.914454 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.914417 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nppt4\" (UniqueName: \"kubernetes.io/projected/a1cad0dd-89e4-4176-b225-f29d2a08db9d-kube-api-access-nppt4\") pod \"migrator-d57d58cc9-kkw6g\" (UID: \"a1cad0dd-89e4-4176-b225-f29d2a08db9d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" Jul 06 19:08:05.930019 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:05.929993 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nppt4\" (UniqueName: \"kubernetes.io/projected/a1cad0dd-89e4-4176-b225-f29d2a08db9d-kube-api-access-nppt4\") pod \"migrator-d57d58cc9-kkw6g\" (UID: \"a1cad0dd-89e4-4176-b225-f29d2a08db9d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" Jul 06 19:08:06.062903 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:06.062820 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" Jul 06 19:08:06.184464 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:06.184434 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g"] Jul 06 19:08:06.187351 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:06.187327 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1cad0dd_89e4_4176_b225_f29d2a08db9d.slice/crio-9b2678ee98afd42da685a7576fc5207e1940b3c1e969eeb013a598308ccfc98e WatchSource:0}: Error finding container 9b2678ee98afd42da685a7576fc5207e1940b3c1e969eeb013a598308ccfc98e: Status 404 returned error can't find the container with id 9b2678ee98afd42da685a7576fc5207e1940b3c1e969eeb013a598308ccfc98e Jul 06 19:08:06.375257 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:06.375221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" event={"ID":"a1cad0dd-89e4-4176-b225-f29d2a08db9d","Type":"ContainerStarted","Data":"9b2678ee98afd42da685a7576fc5207e1940b3c1e969eeb013a598308ccfc98e"} Jul 06 19:08:06.519444 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:06.519407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:06.519869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:06.519521 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:08:06.519869 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:06.519565 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:06.519869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:06.519595 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:08.519577386 +0000 UTC m=+77.948332453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : configmap "kube-rbac-proxy" not found Jul 06 19:08:06.519869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:06.519674 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:06.519869 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:06.519730 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:08.51971397 +0000 UTC m=+77.948469041 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:06.989278 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:06.989244 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzcts_cd460de7-89f7-4c87-ae92-8e9d778c342d/dns-node-resolver/0.log" Jul 06 19:08:07.380093 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:07.380055 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" event={"ID":"a1cad0dd-89e4-4176-b225-f29d2a08db9d","Type":"ContainerStarted","Data":"5f844934ba8ff30b8961d028b800b2eb1eb8a5462fdb9b02f77ce1423f734239"} Jul 06 19:08:07.380248 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:07.380119 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" event={"ID":"a1cad0dd-89e4-4176-b225-f29d2a08db9d","Type":"ContainerStarted","Data":"df32a389e020063035f7c5de5f5171ba1515b458d90e3108cd8f1be9a69f7273"} Jul 06 19:08:07.398481 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:07.398434 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-kkw6g" podStartSLOduration=1.4112486419999999 podStartE2EDuration="2.398420002s" totalImagesPullingTime="987.17136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:07.397122373 +0000 UTC m=+76.825877463" watchObservedRunningTime="2026-07-06 19:08:07.398420002 +0000 UTC m=+76.827175091" Jul 06 19:08:07.987741 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:07.987704 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w4fv5_52923da4-c1f8-4898-88d7-e29b5a1a0233/node-ca/0.log" Jul 06 19:08:08.536084 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:08.536048 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:08.536308 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:08.536119 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:08.536308 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:08.536176 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:08:08.536308 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:08.536246 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:12.53622774 +0000 UTC m=+81.964982816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : configmap "kube-rbac-proxy" not found Jul 06 19:08:08.536308 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:08.536250 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:08.536308 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:08.536285 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:12.536275369 +0000 UTC m=+81.965030437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:08.788275 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:08.788190 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7p69l_fbfedbd0-94f2-496b-a82a-e1e90fe0cea0/serve-healthcheck-canary/0.log" Jul 06 19:08:12.569619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:12.569579 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:12.570006 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:12.569655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:12.570006 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:12.569699 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 19:08:12.570006 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:12.569766 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:20.5697472 +0000 UTC m=+89.998502281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : configmap "kube-rbac-proxy" not found Jul 06 19:08:12.570006 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:12.569775 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 19:08:12.570006 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:12.569810 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls podName:1df8adcf-496c-47dc-a699-0b8e5dd1bd67 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:20.569799832 +0000 UTC m=+89.998554914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rpdvc" (UID: "1df8adcf-496c-47dc-a699-0b8e5dd1bd67") : secret "insights-runtime-extractor-tls" not found Jul 06 19:08:20.633126 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:20.632963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:20.633126 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:20.633053 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:20.633753 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:20.633494 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:20.635356 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:20.635330 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1df8adcf-496c-47dc-a699-0b8e5dd1bd67-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rpdvc\" (UID: \"1df8adcf-496c-47dc-a699-0b8e5dd1bd67\") " pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:20.724351 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:20.724317 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rpdvc" Jul 06 19:08:20.847464 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:20.847432 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rpdvc"] Jul 06 19:08:20.850835 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:20.850805 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1df8adcf_496c_47dc_a699_0b8e5dd1bd67.slice/crio-0d1e0f7ee3f86cfb5df0b65a79c958318200bbe07630a983467308cd2b4e23d7 WatchSource:0}: Error finding container 0d1e0f7ee3f86cfb5df0b65a79c958318200bbe07630a983467308cd2b4e23d7: Status 404 returned error can't find the container with id 0d1e0f7ee3f86cfb5df0b65a79c958318200bbe07630a983467308cd2b4e23d7 Jul 06 19:08:21.421773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:21.421742 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpdvc" event={"ID":"1df8adcf-496c-47dc-a699-0b8e5dd1bd67","Type":"ContainerStarted","Data":"0d1e0f7ee3f86cfb5df0b65a79c958318200bbe07630a983467308cd2b4e23d7"} Jul 06 19:08:25.436468 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:25.436383 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpdvc" event={"ID":"1df8adcf-496c-47dc-a699-0b8e5dd1bd67","Type":"ContainerStarted","Data":"5876335d080d2986799a42f780ede4f84053d8704d04358ae255ef9719f6c84c"} Jul 06 19:08:25.436468 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:25.436438 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpdvc" event={"ID":"1df8adcf-496c-47dc-a699-0b8e5dd1bd67","Type":"ContainerStarted","Data":"00b92b6a7b2de6210ed4065a491eac2973278ae465ac54bf82978c05a5e34773"} Jul 06 19:08:28.450360 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:28.450328 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rpdvc" event={"ID":"1df8adcf-496c-47dc-a699-0b8e5dd1bd67","Type":"ContainerStarted","Data":"e2400cdf6306cd36587191c64b93170b7b63217ee6778e4dd8e95971ba1ac1fc"} Jul 06 19:08:28.472686 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:28.472646 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rpdvc" podStartSLOduration=17.857441029 podStartE2EDuration="24.472630546s" totalImagesPullingTime="6.615189517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:08:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:28.471279233 +0000 UTC m=+97.900034324" watchObservedRunningTime="2026-07-06 19:08:28.472630546 +0000 UTC m=+97.901385636" Jul 06 19:08:29.291310 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.291268 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68"] Jul 06 19:08:29.293222 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.293205 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" Jul 06 19:08:29.297727 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.297700 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 19:08:29.297902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.297726 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 19:08:29.298935 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.298917 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 19:08:29.300040 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.300018 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 19:08:29.301636 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.301621 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ms5ld\"" Jul 06 19:08:29.304258 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.304243 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:08:29.304329 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.304266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:08:29.306452 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.306432 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5a778b2-3edb-4fb2-a305-b847e04a3b8c-metrics-tls\") pod \"dns-default-b2ffv\" (UID: \"f5a778b2-3edb-4fb2-a305-b847e04a3b8c\") " pod="openshift-dns/dns-default-b2ffv" Jul 06 19:08:29.306611 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.306594 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"image-registry-6cf854d8ff-nml4j\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:08:29.313431 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.313410 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68"] Jul 06 19:08:29.392169 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.392134 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-b5rgq"] Jul 06 19:08:29.394166 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.394147 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-b5rgq" Jul 06 19:08:29.396736 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.396714 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 19:08:29.397025 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.397010 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 19:08:29.397901 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.397885 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jp8hz\"" Jul 06 19:08:29.404537 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.404506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnvfh\" (UniqueName: \"kubernetes.io/projected/6644ce6d-6d7b-4d6c-8fa7-8d92952e955e-kube-api-access-pnvfh\") pod \"managed-serviceaccount-addon-agent-65fbccc984-8tc68\" (UID: \"6644ce6d-6d7b-4d6c-8fa7-8d92952e955e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" Jul 06 19:08:29.404618 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.404560 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6644ce6d-6d7b-4d6c-8fa7-8d92952e955e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65fbccc984-8tc68\" (UID: \"6644ce6d-6d7b-4d6c-8fa7-8d92952e955e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" Jul 06 19:08:29.419220 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.416759 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-b5rgq"] Jul 06 19:08:29.505017 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.504985 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6644ce6d-6d7b-4d6c-8fa7-8d92952e955e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65fbccc984-8tc68\" (UID: \"6644ce6d-6d7b-4d6c-8fa7-8d92952e955e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" Jul 06 19:08:29.505421 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.505031 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnvfh\" (UniqueName: \"kubernetes.io/projected/6644ce6d-6d7b-4d6c-8fa7-8d92952e955e-kube-api-access-pnvfh\") pod \"managed-serviceaccount-addon-agent-65fbccc984-8tc68\" (UID: \"6644ce6d-6d7b-4d6c-8fa7-8d92952e955e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" Jul 06 19:08:29.505421 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.505076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b52zk\" (UniqueName: \"kubernetes.io/projected/4616f553-cc08-46ab-bef1-0a5c60d0180c-kube-api-access-b52zk\") pod \"downloads-685bfb5f64-b5rgq\" (UID: \"4616f553-cc08-46ab-bef1-0a5c60d0180c\") " pod="openshift-console/downloads-685bfb5f64-b5rgq" Jul 06 19:08:29.507443 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.507421 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6644ce6d-6d7b-4d6c-8fa7-8d92952e955e-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65fbccc984-8tc68\" (UID: \"6644ce6d-6d7b-4d6c-8fa7-8d92952e955e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" Jul 06 19:08:29.521562 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.521518 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnvfh\" (UniqueName: \"kubernetes.io/projected/6644ce6d-6d7b-4d6c-8fa7-8d92952e955e-kube-api-access-pnvfh\") pod \"managed-serviceaccount-addon-agent-65fbccc984-8tc68\" (UID: \"6644ce6d-6d7b-4d6c-8fa7-8d92952e955e\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" Jul 06 19:08:29.576985 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.576909 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbqzz\"" Jul 06 19:08:29.584950 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.584922 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:08:29.595489 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.595462 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8qsj9\"" Jul 06 19:08:29.596507 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.596486 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-b2ffv" Jul 06 19:08:29.605728 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.605698 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b52zk\" (UniqueName: \"kubernetes.io/projected/4616f553-cc08-46ab-bef1-0a5c60d0180c-kube-api-access-b52zk\") pod \"downloads-685bfb5f64-b5rgq\" (UID: \"4616f553-cc08-46ab-bef1-0a5c60d0180c\") " pod="openshift-console/downloads-685bfb5f64-b5rgq" Jul 06 19:08:29.614489 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.614457 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" Jul 06 19:08:29.624043 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.623991 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b52zk\" (UniqueName: \"kubernetes.io/projected/4616f553-cc08-46ab-bef1-0a5c60d0180c-kube-api-access-b52zk\") pod \"downloads-685bfb5f64-b5rgq\" (UID: \"4616f553-cc08-46ab-bef1-0a5c60d0180c\") " pod="openshift-console/downloads-685bfb5f64-b5rgq" Jul 06 19:08:29.703204 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.703177 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-b5rgq" Jul 06 19:08:29.761930 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.761811 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf854d8ff-nml4j"] Jul 06 19:08:29.769816 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:29.768891 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod571dfc0f_615f_4a8f_a87a_deed6f0a802d.slice/crio-19c7dd83ad485e1bb49e54eac8cf4a36d6c004dbe139a01dcab75ad8a73d923d WatchSource:0}: Error finding container 19c7dd83ad485e1bb49e54eac8cf4a36d6c004dbe139a01dcab75ad8a73d923d: Status 404 returned error can't find the container with id 19c7dd83ad485e1bb49e54eac8cf4a36d6c004dbe139a01dcab75ad8a73d923d Jul 06 19:08:29.781164 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.781141 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-b2ffv"] Jul 06 19:08:29.785022 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:29.784998 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a778b2_3edb_4fb2_a305_b847e04a3b8c.slice/crio-00cfbd81acc3ce08a685547812445d2e434d623cdacf5b51437a3360634ad8ab WatchSource:0}: Error finding container 00cfbd81acc3ce08a685547812445d2e434d623cdacf5b51437a3360634ad8ab: Status 404 returned error can't find the container with id 00cfbd81acc3ce08a685547812445d2e434d623cdacf5b51437a3360634ad8ab Jul 06 19:08:29.792296 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.792272 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68"] Jul 06 19:08:29.798842 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:29.798819 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6644ce6d_6d7b_4d6c_8fa7_8d92952e955e.slice/crio-88b03fa9766421824728e85a05c4f7da7f140acdbb22c1b49ceba4354b1fe313 WatchSource:0}: Error finding container 88b03fa9766421824728e85a05c4f7da7f140acdbb22c1b49ceba4354b1fe313: Status 404 returned error can't find the container with id 88b03fa9766421824728e85a05c4f7da7f140acdbb22c1b49ceba4354b1fe313 Jul 06 19:08:29.853188 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:29.853093 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-b5rgq"] Jul 06 19:08:29.855388 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:29.855363 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4616f553_cc08_46ab_bef1_0a5c60d0180c.slice/crio-a67ee9d7c61cd710e62c11be1d395d9ce828873fc1824be1bcea0629be13eee7 WatchSource:0}: Error finding container a67ee9d7c61cd710e62c11be1d395d9ce828873fc1824be1bcea0629be13eee7: Status 404 returned error can't find the container with id a67ee9d7c61cd710e62c11be1d395d9ce828873fc1824be1bcea0629be13eee7 Jul 06 19:08:30.459468 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:30.459394 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" event={"ID":"6644ce6d-6d7b-4d6c-8fa7-8d92952e955e","Type":"ContainerStarted","Data":"88b03fa9766421824728e85a05c4f7da7f140acdbb22c1b49ceba4354b1fe313"} Jul 06 19:08:30.461483 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:30.461400 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2ffv" event={"ID":"f5a778b2-3edb-4fb2-a305-b847e04a3b8c","Type":"ContainerStarted","Data":"00cfbd81acc3ce08a685547812445d2e434d623cdacf5b51437a3360634ad8ab"} Jul 06 19:08:30.463102 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:30.463029 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-b5rgq" event={"ID":"4616f553-cc08-46ab-bef1-0a5c60d0180c","Type":"ContainerStarted","Data":"a67ee9d7c61cd710e62c11be1d395d9ce828873fc1824be1bcea0629be13eee7"} Jul 06 19:08:30.465129 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:30.465104 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" event={"ID":"571dfc0f-615f-4a8f-a87a-deed6f0a802d","Type":"ContainerStarted","Data":"34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a"} Jul 06 19:08:30.465239 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:30.465150 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" event={"ID":"571dfc0f-615f-4a8f-a87a-deed6f0a802d","Type":"ContainerStarted","Data":"19c7dd83ad485e1bb49e54eac8cf4a36d6c004dbe139a01dcab75ad8a73d923d"} Jul 06 19:08:30.465453 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:30.465435 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:08:30.493322 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:30.493270 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" podStartSLOduration=99.493251605 podStartE2EDuration="1m39.493251605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:30.491333124 +0000 UTC m=+99.920088238" watchObservedRunningTime="2026-07-06 19:08:30.493251605 +0000 UTC m=+99.922006697" Jul 06 19:08:32.363875 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:32.363841 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-765f5" Jul 06 19:08:33.477187 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:33.477149 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" event={"ID":"6644ce6d-6d7b-4d6c-8fa7-8d92952e955e","Type":"ContainerStarted","Data":"56013febd87174aa7790608aa653eb3afd2e45be9f0f6e21d426f0c285ab7787"} Jul 06 19:08:33.478901 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:33.478876 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2ffv" event={"ID":"f5a778b2-3edb-4fb2-a305-b847e04a3b8c","Type":"ContainerStarted","Data":"dd2cc891f3f72467feb80fe766509524431ae9157d6e6767e8e34052a11edc0f"} Jul 06 19:08:33.479011 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:33.478918 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-b2ffv" event={"ID":"f5a778b2-3edb-4fb2-a305-b847e04a3b8c","Type":"ContainerStarted","Data":"a9c761123ede0776807a5bdeb4ab86af436c53d3023eecee82ab1e1b913e67b0"} Jul 06 19:08:33.479047 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:33.479005 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-b2ffv" Jul 06 19:08:33.494949 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:33.494908 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65fbccc984-8tc68" podStartSLOduration=1.161425183 podStartE2EDuration="4.494894665s" totalImagesPullingTime="3.333469482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:33.493720161 +0000 UTC m=+102.922475251" watchObservedRunningTime="2026-07-06 19:08:33.494894665 +0000 UTC m=+102.923649756" Jul 06 19:08:33.513863 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:33.513821 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-b2ffv" podStartSLOduration=65.309370299 podStartE2EDuration="1m8.513806946s" totalImagesPullingTime="3.204436647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:07:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:33.512877552 +0000 UTC m=+102.941632642" watchObservedRunningTime="2026-07-06 19:08:33.513806946 +0000 UTC m=+102.942562035" Jul 06 19:08:34.756764 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:34.756727 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl"] Jul 06 19:08:34.778754 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:34.778730 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl"] Jul 06 19:08:34.778902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:34.778821 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" Jul 06 19:08:34.781185 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:34.781159 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 19:08:34.781311 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:34.781231 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-vk2c2\"" Jul 06 19:08:34.949675 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:34.949637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/406157e3-78f6-40ed-b2b0-942b294ecf7f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fnjcl\" (UID: \"406157e3-78f6-40ed-b2b0-942b294ecf7f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" Jul 06 19:08:35.050849 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:35.050758 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/406157e3-78f6-40ed-b2b0-942b294ecf7f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fnjcl\" (UID: \"406157e3-78f6-40ed-b2b0-942b294ecf7f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" Jul 06 19:08:35.053866 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:35.053838 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/406157e3-78f6-40ed-b2b0-942b294ecf7f-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-fnjcl\" (UID: \"406157e3-78f6-40ed-b2b0-942b294ecf7f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" Jul 06 19:08:35.089318 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:35.089289 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" Jul 06 19:08:35.253935 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:35.253903 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl"] Jul 06 19:08:35.257607 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:35.257570 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406157e3_78f6_40ed_b2b0_942b294ecf7f.slice/crio-62e568dd03a96a75a68ae6228ea447ff2e00e5ea85e8438e7f9abfd3954838f0 WatchSource:0}: Error finding container 62e568dd03a96a75a68ae6228ea447ff2e00e5ea85e8438e7f9abfd3954838f0: Status 404 returned error can't find the container with id 62e568dd03a96a75a68ae6228ea447ff2e00e5ea85e8438e7f9abfd3954838f0 Jul 06 19:08:35.486794 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:35.486757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" event={"ID":"406157e3-78f6-40ed-b2b0-942b294ecf7f","Type":"ContainerStarted","Data":"62e568dd03a96a75a68ae6228ea447ff2e00e5ea85e8438e7f9abfd3954838f0"} Jul 06 19:08:37.496232 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:37.496189 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" event={"ID":"406157e3-78f6-40ed-b2b0-942b294ecf7f","Type":"ContainerStarted","Data":"e1e8a3e9251662fceb816c80c0ec011169c51f06cb8d099e6359ba5b68b998dc"} Jul 06 19:08:37.496714 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:37.496410 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" Jul 06 19:08:37.502038 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:37.502006 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" Jul 06 19:08:37.516421 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:37.516372 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-fnjcl" podStartSLOduration=2.317548221 podStartE2EDuration="3.516357865s" totalImagesPullingTime="1.198809644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:37.515289403 +0000 UTC m=+106.944044493" watchObservedRunningTime="2026-07-06 19:08:37.516357865 +0000 UTC m=+106.945112955" Jul 06 19:08:38.315384 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.315348 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-858575bb48-wx8qk"] Jul 06 19:08:38.317739 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.317711 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.319932 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.319911 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 19:08:38.320771 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.320750 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 19:08:38.320873 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.320782 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 19:08:38.320873 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.320860 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 19:08:38.320988 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.320880 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 19:08:38.320988 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.320814 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kcv9t\"" Jul 06 19:08:38.327506 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.327455 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858575bb48-wx8qk"] Jul 06 19:08:38.371967 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.371938 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-serving-cert\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.372113 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.371977 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-config\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.372113 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.372048 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-service-ca\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.372113 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.372088 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-oauth-serving-cert\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.372286 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.372137 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs478\" (UniqueName: \"kubernetes.io/projected/81d8baa7-7587-4b15-a25c-785b6a7cc16a-kube-api-access-cs478\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.372286 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.372168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-oauth-config\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.472565 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.472534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-serving-cert\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.472744 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.472571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-config\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.472744 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.472615 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-service-ca\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.472744 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.472636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-oauth-serving-cert\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.472744 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.472683 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs478\" (UniqueName: \"kubernetes.io/projected/81d8baa7-7587-4b15-a25c-785b6a7cc16a-kube-api-access-cs478\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.472744 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.472722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-oauth-config\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.473408 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.473383 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-config\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.473517 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.473462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-oauth-serving-cert\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.473517 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.473470 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-service-ca\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.475421 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.475403 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-oauth-config\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.475550 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.475515 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-serving-cert\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.483308 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.483287 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs478\" (UniqueName: \"kubernetes.io/projected/81d8baa7-7587-4b15-a25c-785b6a7cc16a-kube-api-access-cs478\") pod \"console-858575bb48-wx8qk\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.628799 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.628762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:38.770443 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:38.770418 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858575bb48-wx8qk"] Jul 06 19:08:38.772678 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:38.772650 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d8baa7_7587_4b15_a25c_785b6a7cc16a.slice/crio-a8380b2865c31d038b6e50e11db150478781124455d810beae9e855644775e45 WatchSource:0}: Error finding container a8380b2865c31d038b6e50e11db150478781124455d810beae9e855644775e45: Status 404 returned error can't find the container with id a8380b2865c31d038b6e50e11db150478781124455d810beae9e855644775e45 Jul 06 19:08:39.506193 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:39.506150 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858575bb48-wx8qk" event={"ID":"81d8baa7-7587-4b15-a25c-785b6a7cc16a","Type":"ContainerStarted","Data":"a8380b2865c31d038b6e50e11db150478781124455d810beae9e855644775e45"} Jul 06 19:08:42.216867 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.216836 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp"] Jul 06 19:08:42.219201 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.219176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.223718 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.223694 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-lz9tt\"" Jul 06 19:08:42.223930 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.223905 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 06 19:08:42.223930 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.223923 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 19:08:42.224195 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.224170 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 06 19:08:42.225126 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.225107 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 19:08:42.225875 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.225859 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 06 19:08:42.225875 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.225871 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 19:08:42.240962 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.240935 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8z92x"] Jul 06 19:08:42.243638 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.243619 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp"] Jul 06 19:08:42.243761 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.243746 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.246143 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.246121 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vljwc\"" Jul 06 19:08:42.246780 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.246726 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 19:08:42.246888 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.246793 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 19:08:42.246888 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.246807 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 19:08:42.302489 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302457 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-tls\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.302661 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302499 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-sys\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.302661 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302536 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrbk9\" (UniqueName: \"kubernetes.io/projected/6279987f-d922-47d0-b537-bb89db633b84-kube-api-access-qrbk9\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.302661 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302575 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6279987f-d922-47d0-b537-bb89db633b84-metrics-client-ca\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.302661 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.302850 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jmps\" (UniqueName: \"kubernetes.io/projected/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-api-access-6jmps\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.302850 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302772 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-textfile\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.302850 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302793 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.302850 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.302850 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302825 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-wtmp\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.302850 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302847 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.303122 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302944 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-root\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.303122 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302973 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.303122 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.302999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.303122 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.303067 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.404083 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404043 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.404083 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-tls\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404320 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-sys\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404320 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404133 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrbk9\" (UniqueName: \"kubernetes.io/projected/6279987f-d922-47d0-b537-bb89db633b84-kube-api-access-qrbk9\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404320 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:42.404236 2559 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 19:08:42.404320 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:42.404307 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-tls podName:6279987f-d922-47d0-b537-bb89db633b84 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:42.90428727 +0000 UTC m=+112.333042351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-tls") pod "node-exporter-8z92x" (UID: "6279987f-d922-47d0-b537-bb89db633b84") : secret "node-exporter-tls" not found Jul 06 19:08:42.404320 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404309 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-sys\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404571 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404364 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6279987f-d922-47d0-b537-bb89db633b84-metrics-client-ca\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404571 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404421 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.404571 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jmps\" (UniqueName: \"kubernetes.io/projected/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-api-access-6jmps\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.404571 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404494 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-textfile\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404571 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.404571 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.404885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404597 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-wtmp\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404644 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404715 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-root\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404735 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-wtmp\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.404885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404786 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.404885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404835 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.404885 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404857 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-textfile\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.405330 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6279987f-d922-47d0-b537-bb89db633b84-root\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.405330 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.404937 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.405330 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.405091 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6279987f-d922-47d0-b537-bb89db633b84-metrics-client-ca\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.405330 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.405295 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-accelerators-collector-config\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.405545 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.405393 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.407399 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.407372 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.407560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.407452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.407560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.407512 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.414148 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.414126 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jmps\" (UniqueName: \"kubernetes.io/projected/62edf2c2-e23c-4fdb-afd2-19b9ccd04b73-kube-api-access-6jmps\") pod \"kube-state-metrics-7c9dbb8b7d-z4nnp\" (UID: \"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.414605 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.414582 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrbk9\" (UniqueName: \"kubernetes.io/projected/6279987f-d922-47d0-b537-bb89db633b84-kube-api-access-qrbk9\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.530139 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.530058 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" Jul 06 19:08:42.909513 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.909477 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-tls\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:42.912035 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:42.912012 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6279987f-d922-47d0-b537-bb89db633b84-node-exporter-tls\") pod \"node-exporter-8z92x\" (UID: \"6279987f-d922-47d0-b537-bb89db633b84\") " pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:43.154960 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.154927 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8z92x" Jul 06 19:08:43.366181 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.366149 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:08:43.369182 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.369161 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.372017 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.371981 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:08:43.372346 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.372323 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:08:43.372467 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.372389 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l9mjg\"" Jul 06 19:08:43.372467 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.372390 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:08:43.372698 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.372683 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:08:43.372813 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.372697 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:08:43.372872 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.372830 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:08:43.372872 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.372835 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:08:43.373099 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.373079 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:08:43.373217 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.373172 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:08:43.388594 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.388570 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:08:43.413284 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413256 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413284 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413287 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413508 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413314 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413508 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413508 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413438 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-config-out\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413508 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413454 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413508 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413485 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413514 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-web-config\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5b2d\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-kube-api-access-n5b2d\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413636 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.413807 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.413681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.484425 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.484396 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-b2ffv" Jul 06 19:08:43.514556 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.514510 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.514728 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.514605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.514797 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:08:43.514733 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle podName:90cfe660-436f-4469-8432-aef67113ecf9 nodeName:}" failed. No retries permitted until 2026-07-06 19:08:44.014710317 +0000 UTC m=+113.443465408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "90cfe660-436f-4469-8432-aef67113ecf9") : configmap references non-existent config key: ca-bundle.crt Jul 06 19:08:43.514902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.514878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-config-out\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515033 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.514920 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515147 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515128 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515211 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515165 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515264 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515316 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-web-config\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515316 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5b2d\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-kube-api-access-n5b2d\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515422 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515319 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515422 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515355 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515422 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.515588 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.515432 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.516225 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.516202 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.516761 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.516452 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.518280 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.517851 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.518280 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.518257 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-config-volume\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.520109 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.518745 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.520109 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.518917 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-config-out\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.520109 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.519427 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.520109 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.519597 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.520355 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.520293 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.521326 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.521027 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.523326 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.523303 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-web-config\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:43.526736 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:43.526693 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5b2d\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-kube-api-access-n5b2d\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:44.019155 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:44.019123 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:44.019999 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:44.019965 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:44.280045 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:44.279959 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:08:46.734514 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.734480 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b5cbcb456-tckx2"] Jul 06 19:08:46.737382 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.737360 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.740001 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.739980 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 19:08:46.741431 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.741410 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 19:08:46.741669 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.741645 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 19:08:46.742418 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.742396 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-lxv4h\"" Jul 06 19:08:46.742579 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.742556 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 19:08:46.743205 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.743182 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fpdartqhheb16\"" Jul 06 19:08:46.749877 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.749856 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b5cbcb456-tckx2"] Jul 06 19:08:46.844308 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.844266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-secret-metrics-server-tls\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.844478 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.844326 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-secret-metrics-server-client-certs\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.844478 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.844418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-metrics-server-audit-profiles\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.844591 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.844493 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-audit-log\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.844591 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.844572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.844684 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.844600 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-client-ca-bundle\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.844684 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.844628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt26t\" (UniqueName: \"kubernetes.io/projected/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-kube-api-access-lt26t\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.945402 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.945297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-audit-log\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.945402 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.945374 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.945402 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.945406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-client-ca-bundle\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.945723 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.945434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt26t\" (UniqueName: \"kubernetes.io/projected/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-kube-api-access-lt26t\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.945723 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.945487 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-secret-metrics-server-tls\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.945723 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.945513 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-secret-metrics-server-client-certs\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.945723 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.945554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-metrics-server-audit-profiles\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.945923 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.945773 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-audit-log\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.946443 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.946402 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-metrics-server-audit-profiles\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.946692 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.946659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.948903 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.948876 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-secret-metrics-server-client-certs\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.949007 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.948934 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-secret-metrics-server-tls\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.949340 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.949315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-client-ca-bundle\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:46.965296 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:46.965271 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt26t\" (UniqueName: \"kubernetes.io/projected/f6700403-6ed1-4cf1-b260-e6384ee3d9cc-kube-api-access-lt26t\") pod \"metrics-server-5b5cbcb456-tckx2\" (UID: \"f6700403-6ed1-4cf1-b260-e6384ee3d9cc\") " pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:47.053567 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.053469 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:08:47.070650 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.070622 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858575bb48-wx8qk"] Jul 06 19:08:47.122382 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.122346 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ccd889694-hxl9t"] Jul 06 19:08:47.124806 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.124775 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.133705 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.133680 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 19:08:47.139395 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.139373 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccd889694-hxl9t"] Jul 06 19:08:47.146884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.146853 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-serving-cert\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.147008 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.146909 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-console-config\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.147075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.146999 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhnk\" (UniqueName: \"kubernetes.io/projected/bf456197-1f57-4063-9831-56018437b74b-kube-api-access-xqhnk\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.147115 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.147081 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-trusted-ca-bundle\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.147184 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.147168 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-oauth-config\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.147236 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.147213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-oauth-serving-cert\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.147280 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.147266 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-service-ca\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.248053 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248018 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-serving-cert\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.248053 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-console-config\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.248323 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248087 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhnk\" (UniqueName: \"kubernetes.io/projected/bf456197-1f57-4063-9831-56018437b74b-kube-api-access-xqhnk\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.248323 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248112 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-trusted-ca-bundle\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.248323 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-oauth-config\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.248323 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-oauth-serving-cert\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.248323 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248276 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-service-ca\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.248989 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-console-config\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.249114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.248996 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-service-ca\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.249114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.249047 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-oauth-serving-cert\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.249183 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.249117 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-trusted-ca-bundle\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.250895 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.250871 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-oauth-config\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.251139 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.251114 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-serving-cert\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.258272 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.258229 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhnk\" (UniqueName: \"kubernetes.io/projected/bf456197-1f57-4063-9831-56018437b74b-kube-api-access-xqhnk\") pod \"console-6ccd889694-hxl9t\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:47.435871 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:47.435837 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:48.600942 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.600912 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:08:48.619264 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.619240 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.624000 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.623965 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:08:48.624164 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.624054 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:08:48.624164 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.624068 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:08:48.624461 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.624447 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kn2bz\"" Jul 06 19:08:48.625159 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.625114 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:08:48.625159 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.625164 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:08:48.625502 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.625477 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:08:48.625502 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.625501 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:08:48.625690 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.625501 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:08:48.625690 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.625555 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:08:48.625690 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.625517 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:08:48.625690 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.625621 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-de6duf6vp4gun\"" Jul 06 19:08:48.631650 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.631623 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:08:48.632090 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.632074 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:08:48.634437 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.634420 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:08:48.648827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.648809 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:08:48.654011 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.653991 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:08:48.661818 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.661798 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.661912 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.661827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.661912 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.661854 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-config\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.661912 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.661871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662026 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.661929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662026 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.661968 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662026 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.661986 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662026 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662167 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662046 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662167 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662076 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662167 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662093 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-config-out\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662167 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662130 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662167 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662156 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662334 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662195 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8xsc\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-kube-api-access-w8xsc\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662334 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662228 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-web-config\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662334 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662273 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662334 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662334 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662311 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662497 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662341 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.662497 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.662357 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.729656 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:48.729312 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6279987f_d922_47d0_b537_bb89db633b84.slice/crio-fe025d4a328f4f97e3aad0797f4022ce3b4abfe8acf63150f94ac3dac6cb62df WatchSource:0}: Error finding container fe025d4a328f4f97e3aad0797f4022ce3b4abfe8acf63150f94ac3dac6cb62df: Status 404 returned error can't find the container with id fe025d4a328f4f97e3aad0797f4022ce3b4abfe8acf63150f94ac3dac6cb62df Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764249 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764298 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764335 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764375 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-config\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764407 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764434 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764469 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.764498 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.770547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.770370 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773448 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-config-out\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773547 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773581 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8xsc\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-kube-api-access-w8xsc\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-web-config\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773753 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773793 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.773830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.774958 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.776359 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.788619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.777462 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.789568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.777465 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.789568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.781654 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.789568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.781909 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.789568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.785941 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.789568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.786281 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-config\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.789568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.786588 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.789568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.788773 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.796645 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.795930 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.796645 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.796000 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.796781 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.796708 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.797492 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.797057 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-config-out\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.797492 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.797212 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-web-config\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.797492 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.797424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.801324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.800856 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.802774 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.802750 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8xsc\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-kube-api-access-w8xsc\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.808183 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.808140 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:48.924404 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.924371 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:08:48.927832 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:48.927785 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90cfe660_436f_4469_8432_aef67113ecf9.slice/crio-ddc3167012781185a22b79625e4f6b5029d02a112243ef8fe99b2774b3b83416 WatchSource:0}: Error finding container ddc3167012781185a22b79625e4f6b5029d02a112243ef8fe99b2774b3b83416: Status 404 returned error can't find the container with id ddc3167012781185a22b79625e4f6b5029d02a112243ef8fe99b2774b3b83416 Jul 06 19:08:48.929022 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:48.929001 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:08:49.087616 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.087537 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:08:49.089328 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:49.089295 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4843834c_0324_4982_af17_af9472805cff.slice/crio-7703120b78cf58039468528c1bceb8583840aa9bfdabfe61b6a1b1c8040e8ce2 WatchSource:0}: Error finding container 7703120b78cf58039468528c1bceb8583840aa9bfdabfe61b6a1b1c8040e8ce2: Status 404 returned error can't find the container with id 7703120b78cf58039468528c1bceb8583840aa9bfdabfe61b6a1b1c8040e8ce2 Jul 06 19:08:49.146173 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.146122 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ccd889694-hxl9t"] Jul 06 19:08:49.149977 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.149200 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b5cbcb456-tckx2"] Jul 06 19:08:49.151610 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.151493 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp"] Jul 06 19:08:49.153449 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:49.153403 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf456197_1f57_4063_9831_56018437b74b.slice/crio-825aa50058b87c7f91de9fbf8126e623437027a4077fb02c02a227fb616e0861 WatchSource:0}: Error finding container 825aa50058b87c7f91de9fbf8126e623437027a4077fb02c02a227fb616e0861: Status 404 returned error can't find the container with id 825aa50058b87c7f91de9fbf8126e623437027a4077fb02c02a227fb616e0861 Jul 06 19:08:49.153707 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:49.153682 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6700403_6ed1_4cf1_b260_e6384ee3d9cc.slice/crio-5ccf5dab9f83c30171d8baa0c129de346375399fd1d44217acd98c007947e854 WatchSource:0}: Error finding container 5ccf5dab9f83c30171d8baa0c129de346375399fd1d44217acd98c007947e854: Status 404 returned error can't find the container with id 5ccf5dab9f83c30171d8baa0c129de346375399fd1d44217acd98c007947e854 Jul 06 19:08:49.154266 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:08:49.154242 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62edf2c2_e23c_4fdb_afd2_19b9ccd04b73.slice/crio-3cba2822c25dc7a117d4fa8985d67048675ac08e78aa5c7224d78997a6f41868 WatchSource:0}: Error finding container 3cba2822c25dc7a117d4fa8985d67048675ac08e78aa5c7224d78997a6f41868: Status 404 returned error can't find the container with id 3cba2822c25dc7a117d4fa8985d67048675ac08e78aa5c7224d78997a6f41868 Jul 06 19:08:49.549628 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.549466 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" event={"ID":"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73","Type":"ContainerStarted","Data":"3cba2822c25dc7a117d4fa8985d67048675ac08e78aa5c7224d78997a6f41868"} Jul 06 19:08:49.557273 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.556428 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccd889694-hxl9t" event={"ID":"bf456197-1f57-4063-9831-56018437b74b","Type":"ContainerStarted","Data":"7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e"} Jul 06 19:08:49.557273 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.556484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccd889694-hxl9t" event={"ID":"bf456197-1f57-4063-9831-56018437b74b","Type":"ContainerStarted","Data":"825aa50058b87c7f91de9fbf8126e623437027a4077fb02c02a227fb616e0861"} Jul 06 19:08:49.566554 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.565892 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-b5rgq" event={"ID":"4616f553-cc08-46ab-bef1-0a5c60d0180c","Type":"ContainerStarted","Data":"ee8a6c7f76ccb0544e069c45795932cd8fa58a918a4dcf2401dfc88dce36a80c"} Jul 06 19:08:49.568578 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.567616 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-b5rgq" Jul 06 19:08:49.570308 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.570284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858575bb48-wx8qk" event={"ID":"81d8baa7-7587-4b15-a25c-785b6a7cc16a","Type":"ContainerStarted","Data":"b2a5bdeab0101e4c44d3d02aef6fa47cfde5a8df34e5738299bc877718cddc4c"} Jul 06 19:08:49.576881 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.576790 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerStarted","Data":"7703120b78cf58039468528c1bceb8583840aa9bfdabfe61b6a1b1c8040e8ce2"} Jul 06 19:08:49.581088 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.578989 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ccd889694-hxl9t" podStartSLOduration=2.578969386 podStartE2EDuration="2.578969386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:49.578293484 +0000 UTC m=+119.007048574" watchObservedRunningTime="2026-07-06 19:08:49.578969386 +0000 UTC m=+119.007724456" Jul 06 19:08:49.581088 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.580836 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-b5rgq" Jul 06 19:08:49.583739 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.583618 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerStarted","Data":"ddc3167012781185a22b79625e4f6b5029d02a112243ef8fe99b2774b3b83416"} Jul 06 19:08:49.593968 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.593879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z92x" event={"ID":"6279987f-d922-47d0-b537-bb89db633b84","Type":"ContainerStarted","Data":"fe025d4a328f4f97e3aad0797f4022ce3b4abfe8acf63150f94ac3dac6cb62df"} Jul 06 19:08:49.596092 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.596036 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" event={"ID":"f6700403-6ed1-4cf1-b260-e6384ee3d9cc","Type":"ContainerStarted","Data":"5ccf5dab9f83c30171d8baa0c129de346375399fd1d44217acd98c007947e854"} Jul 06 19:08:49.599388 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.599310 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-858575bb48-wx8qk" podStartSLOduration=1.651119153 podStartE2EDuration="11.599293952s" totalImagesPullingTime="9.948174799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:49.598810476 +0000 UTC m=+119.027565566" watchObservedRunningTime="2026-07-06 19:08:49.599293952 +0000 UTC m=+119.028049046" Jul 06 19:08:49.648450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:49.647585 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-b5rgq" podStartSLOduration=1.6892078179999999 podStartE2EDuration="20.64756277s" totalImagesPullingTime="18.958354952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:49.624900354 +0000 UTC m=+119.053655445" watchObservedRunningTime="2026-07-06 19:08:49.64756277 +0000 UTC m=+119.076317862" Jul 06 19:08:51.475412 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:51.474901 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:08:52.426078 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:52.426044 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cf854d8ff-nml4j"] Jul 06 19:08:53.623440 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.623407 2559 generic.go:356] "Generic (PLEG): container finished" podID="4843834c-0324-4982-af17-af9472805cff" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" exitCode=0 Jul 06 19:08:53.623996 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.623504 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerDied","Data":"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477"} Jul 06 19:08:53.626126 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.626095 2559 generic.go:356] "Generic (PLEG): container finished" podID="90cfe660-436f-4469-8432-aef67113ecf9" containerID="0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1" exitCode=0 Jul 06 19:08:53.626239 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.626185 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerDied","Data":"0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1"} Jul 06 19:08:53.628210 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.628180 2559 generic.go:356] "Generic (PLEG): container finished" podID="6279987f-d922-47d0-b537-bb89db633b84" containerID="8270a450ca08047a3d2d1f797b50435fd448d8ef7c0b5623a6251fbc91eeee43" exitCode=0 Jul 06 19:08:53.628313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.628260 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z92x" event={"ID":"6279987f-d922-47d0-b537-bb89db633b84","Type":"ContainerDied","Data":"8270a450ca08047a3d2d1f797b50435fd448d8ef7c0b5623a6251fbc91eeee43"} Jul 06 19:08:53.630150 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.630128 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" event={"ID":"f6700403-6ed1-4cf1-b260-e6384ee3d9cc","Type":"ContainerStarted","Data":"feede6072a3eab9d1e77b862c360de116393455a25b19c5fe3b8da2e1f68d6ae"} Jul 06 19:08:53.632620 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.632586 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" event={"ID":"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73","Type":"ContainerStarted","Data":"8f58233ced1727d6333d80ad86b31815a52fc6e9d654c22f1b96a36e4d1498b2"} Jul 06 19:08:53.632712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.632646 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" event={"ID":"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73","Type":"ContainerStarted","Data":"870dedc13f435b030083d79cf26368fa4d480949133b35acbf77ae1b9cbaceeb"} Jul 06 19:08:53.632712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.632674 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" event={"ID":"62edf2c2-e23c-4fdb-afd2-19b9ccd04b73","Type":"ContainerStarted","Data":"38cb846445db8534f13b3a5d0692856fa87bb737f61fb074150c1a960d1e7365"} Jul 06 19:08:53.695976 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.695921 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" podStartSLOduration=4.325451833 podStartE2EDuration="7.695901686s" totalImagesPullingTime="3.370449853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:53.694935358 +0000 UTC m=+123.123690450" watchObservedRunningTime="2026-07-06 19:08:53.695901686 +0000 UTC m=+123.124656832" Jul 06 19:08:53.751206 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:53.751152 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z4nnp" podStartSLOduration=8.384412233 podStartE2EDuration="11.751135348s" totalImagesPullingTime="3.366723115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:53.749740459 +0000 UTC m=+123.178495590" watchObservedRunningTime="2026-07-06 19:08:53.751135348 +0000 UTC m=+123.179890437" Jul 06 19:08:54.644705 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:54.643570 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z92x" event={"ID":"6279987f-d922-47d0-b537-bb89db633b84","Type":"ContainerStarted","Data":"9c7dffd03a3fe2d47d8146ef01df9c8f52e3f865914e15d5ea51722279c6204b"} Jul 06 19:08:54.644705 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:54.643628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8z92x" event={"ID":"6279987f-d922-47d0-b537-bb89db633b84","Type":"ContainerStarted","Data":"fe9435fe718704e5cc9cdcbc3e02ded32bf4937c0dae128c7cc070ccc876ff85"} Jul 06 19:08:54.667791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:54.667151 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8z92x" podStartSLOduration=8.753315659 podStartE2EDuration="12.667128966s" totalImagesPullingTime="3.791302637s" totalInitContainerRuntime="122.51067ms" isStatefulPod=true podCreationTimestamp="2026-07-06 19:08:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:08:54.66427051 +0000 UTC m=+124.093025601" watchObservedRunningTime="2026-07-06 19:08:54.667128966 +0000 UTC m=+124.095884057" Jul 06 19:08:57.436699 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:57.436670 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:57.437110 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:57.436733 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:57.442183 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:57.442161 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:57.665460 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:57.665416 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerStarted","Data":"48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a"} Jul 06 19:08:57.670817 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:57.670792 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:08:58.629900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:58.629853 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:08:58.674083 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:58.674047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerStarted","Data":"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5"} Jul 06 19:08:58.674252 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:58.674128 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerStarted","Data":"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289"} Jul 06 19:08:58.678660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:58.678459 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerStarted","Data":"5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0"} Jul 06 19:08:58.678660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:58.678518 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerStarted","Data":"9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310"} Jul 06 19:08:58.678660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:58.678577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerStarted","Data":"1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b"} Jul 06 19:08:58.678660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:58.678611 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerStarted","Data":"0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006"} Jul 06 19:08:59.794185 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:59.794138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:08:59.796445 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:08:59.796415 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3678ac19-302c-49e3-adbd-cc07629c9bdd-metrics-certs\") pod \"network-metrics-daemon-grwxz\" (UID: \"3678ac19-302c-49e3-adbd-cc07629c9bdd\") " pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:09:00.081783 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.081698 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-h4n82\"" Jul 06 19:09:00.089830 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.089803 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-grwxz" Jul 06 19:09:00.400180 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.400157 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-grwxz"] Jul 06 19:09:00.402556 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:09:00.402518 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3678ac19_302c_49e3_adbd_cc07629c9bdd.slice/crio-030be4cf7a997950d541c2a257c76cdc3ce97418b29750a69188d89890fe1eac WatchSource:0}: Error finding container 030be4cf7a997950d541c2a257c76cdc3ce97418b29750a69188d89890fe1eac: Status 404 returned error can't find the container with id 030be4cf7a997950d541c2a257c76cdc3ce97418b29750a69188d89890fe1eac Jul 06 19:09:00.688076 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.688051 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grwxz" event={"ID":"3678ac19-302c-49e3-adbd-cc07629c9bdd","Type":"ContainerStarted","Data":"030be4cf7a997950d541c2a257c76cdc3ce97418b29750a69188d89890fe1eac"} Jul 06 19:09:00.691141 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.691115 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerStarted","Data":"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc"} Jul 06 19:09:00.691263 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.691186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerStarted","Data":"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe"} Jul 06 19:09:00.691263 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.691225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerStarted","Data":"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f"} Jul 06 19:09:00.694064 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.694045 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerStarted","Data":"652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e"} Jul 06 19:09:00.731701 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:00.731633 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.745388786 podStartE2EDuration="17.731613122s" totalImagesPullingTime="8.954757871s" totalInitContainerRuntime="31.466465ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:00.729799701 +0000 UTC m=+130.158554793" watchObservedRunningTime="2026-07-06 19:09:00.731613122 +0000 UTC m=+130.160368215" Jul 06 19:09:01.701092 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:01.701049 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerStarted","Data":"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c"} Jul 06 19:09:01.732712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:01.732661 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.93795272 podStartE2EDuration="13.732644583s" totalImagesPullingTime="9.771217967s" totalInitContainerRuntime="23.473896ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:08:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:01.730836662 +0000 UTC m=+131.159591769" watchObservedRunningTime="2026-07-06 19:09:01.732644583 +0000 UTC m=+131.161399672" Jul 06 19:09:02.706440 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:02.706404 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grwxz" event={"ID":"3678ac19-302c-49e3-adbd-cc07629c9bdd","Type":"ContainerStarted","Data":"8da9311da9678c224c0e110aa094c37626563240a38ea4f03cebb5ed5bcc8edd"} Jul 06 19:09:02.706827 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:02.706461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-grwxz" event={"ID":"3678ac19-302c-49e3-adbd-cc07629c9bdd","Type":"ContainerStarted","Data":"673b8b7228f46ac23ca482eafa75663ea177c1d93c453957f3123eb02696c57e"} Jul 06 19:09:02.726586 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:02.726542 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-grwxz" podStartSLOduration=130.175224388 podStartE2EDuration="2m11.726510153s" totalImagesPullingTime="1.551285765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:06:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:09:02.724440754 +0000 UTC m=+132.153195844" watchObservedRunningTime="2026-07-06 19:09:02.726510153 +0000 UTC m=+132.155265243" Jul 06 19:09:03.014521 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:03.014438 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ccd889694-hxl9t"] Jul 06 19:09:03.929644 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:03.929611 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:09:07.053765 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:07.053738 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:09:07.053765 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:07.053780 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:09:14.608120 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:14.608054 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-858575bb48-wx8qk" podUID="81d8baa7-7587-4b15-a25c-785b6a7cc16a" containerName="console" containerID="cri-o://b2a5bdeab0101e4c44d3d02aef6fa47cfde5a8df34e5738299bc877718cddc4c" gracePeriod=15 Jul 06 19:09:14.755253 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:14.755222 2559 generic.go:356] "Generic (PLEG): container finished" podID="81d8baa7-7587-4b15-a25c-785b6a7cc16a" containerID="b2a5bdeab0101e4c44d3d02aef6fa47cfde5a8df34e5738299bc877718cddc4c" exitCode=0 Jul 06 19:09:14.755423 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:14.755295 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858575bb48-wx8qk" event={"ID":"81d8baa7-7587-4b15-a25c-785b6a7cc16a","Type":"ContainerDied","Data":"b2a5bdeab0101e4c44d3d02aef6fa47cfde5a8df34e5738299bc877718cddc4c"} Jul 06 19:09:14.872245 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:14.872218 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:09:15.030497 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.030466 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-serving-cert\") pod \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " Jul 06 19:09:15.030689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.030509 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-config\") pod \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " Jul 06 19:09:15.030689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.030565 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-service-ca\") pod \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " Jul 06 19:09:15.030689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.030650 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs478\" (UniqueName: \"kubernetes.io/projected/81d8baa7-7587-4b15-a25c-785b6a7cc16a-kube-api-access-cs478\") pod \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " Jul 06 19:09:15.030689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.030688 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-oauth-serving-cert\") pod \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " Jul 06 19:09:15.030903 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.030716 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-oauth-config\") pod \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\" (UID: \"81d8baa7-7587-4b15-a25c-785b6a7cc16a\") " Jul 06 19:09:15.031007 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.030981 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-config" (OuterVolumeSpecName: "console-config") pod "81d8baa7-7587-4b15-a25c-785b6a7cc16a" (UID: "81d8baa7-7587-4b15-a25c-785b6a7cc16a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:15.031111 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.031077 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-service-ca" (OuterVolumeSpecName: "service-ca") pod "81d8baa7-7587-4b15-a25c-785b6a7cc16a" (UID: "81d8baa7-7587-4b15-a25c-785b6a7cc16a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:15.031190 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.031084 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "81d8baa7-7587-4b15-a25c-785b6a7cc16a" (UID: "81d8baa7-7587-4b15-a25c-785b6a7cc16a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:15.032839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.032807 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81d8baa7-7587-4b15-a25c-785b6a7cc16a-kube-api-access-cs478" (OuterVolumeSpecName: "kube-api-access-cs478") pod "81d8baa7-7587-4b15-a25c-785b6a7cc16a" (UID: "81d8baa7-7587-4b15-a25c-785b6a7cc16a"). InnerVolumeSpecName "kube-api-access-cs478". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:15.032934 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.032830 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "81d8baa7-7587-4b15-a25c-785b6a7cc16a" (UID: "81d8baa7-7587-4b15-a25c-785b6a7cc16a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:15.032934 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.032885 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "81d8baa7-7587-4b15-a25c-785b6a7cc16a" (UID: "81d8baa7-7587-4b15-a25c-785b6a7cc16a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:15.132408 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.132340 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-config\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:15.132408 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.132363 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-service-ca\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:15.132408 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.132374 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs478\" (UniqueName: \"kubernetes.io/projected/81d8baa7-7587-4b15-a25c-785b6a7cc16a-kube-api-access-cs478\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:15.132408 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.132383 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/81d8baa7-7587-4b15-a25c-785b6a7cc16a-oauth-serving-cert\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:15.132408 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.132392 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-oauth-config\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:15.132408 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.132400 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/81d8baa7-7587-4b15-a25c-785b6a7cc16a-console-serving-cert\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:15.760064 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.760037 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858575bb48-wx8qk" Jul 06 19:09:15.760580 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.760035 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858575bb48-wx8qk" event={"ID":"81d8baa7-7587-4b15-a25c-785b6a7cc16a","Type":"ContainerDied","Data":"a8380b2865c31d038b6e50e11db150478781124455d810beae9e855644775e45"} Jul 06 19:09:15.760580 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.760191 2559 scope.go:117] "RemoveContainer" containerID="b2a5bdeab0101e4c44d3d02aef6fa47cfde5a8df34e5738299bc877718cddc4c" Jul 06 19:09:15.778082 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.778058 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-858575bb48-wx8qk"] Jul 06 19:09:15.783039 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:15.783019 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-858575bb48-wx8qk"] Jul 06 19:09:17.053655 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.053615 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81d8baa7-7587-4b15-a25c-785b6a7cc16a" path="/var/lib/kubelet/pods/81d8baa7-7587-4b15-a25c-785b6a7cc16a/volumes" Jul 06 19:09:17.450375 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.450313 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" podUID="571dfc0f-615f-4a8f-a87a-deed6f0a802d" containerName="registry" containerID="cri-o://34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a" gracePeriod=30 Jul 06 19:09:17.739355 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.739320 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:09:17.753592 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.753570 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-certificates\") pod \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " Jul 06 19:09:17.753725 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.753610 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") pod \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " Jul 06 19:09:17.753725 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.753634 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-bound-sa-token\") pod \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " Jul 06 19:09:17.753725 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.753668 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-trusted-ca\") pod \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " Jul 06 19:09:17.753725 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.753712 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-installation-pull-secrets\") pod \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " Jul 06 19:09:17.753899 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.753740 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/571dfc0f-615f-4a8f-a87a-deed6f0a802d-ca-trust-extracted\") pod \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " Jul 06 19:09:17.753899 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.753780 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgqjr\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-kube-api-access-kgqjr\") pod \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " Jul 06 19:09:17.753899 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.753822 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-image-registry-private-configuration\") pod \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\" (UID: \"571dfc0f-615f-4a8f-a87a-deed6f0a802d\") " Jul 06 19:09:17.754285 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.754243 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "571dfc0f-615f-4a8f-a87a-deed6f0a802d" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:17.754285 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.754249 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "571dfc0f-615f-4a8f-a87a-deed6f0a802d" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:17.756624 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.756586 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "571dfc0f-615f-4a8f-a87a-deed6f0a802d" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:17.756755 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.756656 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "571dfc0f-615f-4a8f-a87a-deed6f0a802d" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:17.756755 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.756730 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "571dfc0f-615f-4a8f-a87a-deed6f0a802d" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:17.756869 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.756816 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "571dfc0f-615f-4a8f-a87a-deed6f0a802d" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:17.756909 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.756864 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-kube-api-access-kgqjr" (OuterVolumeSpecName: "kube-api-access-kgqjr") pod "571dfc0f-615f-4a8f-a87a-deed6f0a802d" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d"). InnerVolumeSpecName "kube-api-access-kgqjr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:17.764197 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.764171 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/571dfc0f-615f-4a8f-a87a-deed6f0a802d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "571dfc0f-615f-4a8f-a87a-deed6f0a802d" (UID: "571dfc0f-615f-4a8f-a87a-deed6f0a802d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:09:17.771003 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.770975 2559 generic.go:356] "Generic (PLEG): container finished" podID="571dfc0f-615f-4a8f-a87a-deed6f0a802d" containerID="34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a" exitCode=0 Jul 06 19:09:17.771121 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.771021 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" Jul 06 19:09:17.771121 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.771052 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" event={"ID":"571dfc0f-615f-4a8f-a87a-deed6f0a802d","Type":"ContainerDied","Data":"34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a"} Jul 06 19:09:17.771121 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.771109 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf854d8ff-nml4j" event={"ID":"571dfc0f-615f-4a8f-a87a-deed6f0a802d","Type":"ContainerDied","Data":"19c7dd83ad485e1bb49e54eac8cf4a36d6c004dbe139a01dcab75ad8a73d923d"} Jul 06 19:09:17.771275 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.771135 2559 scope.go:117] "RemoveContainer" containerID="34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a" Jul 06 19:09:17.781181 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.781159 2559 scope.go:117] "RemoveContainer" containerID="34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a" Jul 06 19:09:17.781487 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:09:17.781468 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a\": container with ID starting with 34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a not found: ID does not exist" containerID="34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a" Jul 06 19:09:17.781565 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.781496 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a"} err="failed to get container status \"34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a\": rpc error: code = NotFound desc = could not find container \"34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a\": container with ID starting with 34727eae44fe54a8bf7c7ceaf51167fad5add17bf5f99367fe6c8f5b6711455a not found: ID does not exist" Jul 06 19:09:17.793969 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.793939 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cf854d8ff-nml4j"] Jul 06 19:09:17.798657 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.798636 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cf854d8ff-nml4j"] Jul 06 19:09:17.855022 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.854976 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgqjr\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-kube-api-access-kgqjr\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:17.855022 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.855025 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-image-registry-private-configuration\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:17.855216 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.855046 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-certificates\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:17.855216 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.855065 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-registry-tls\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:17.855216 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.855084 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/571dfc0f-615f-4a8f-a87a-deed6f0a802d-bound-sa-token\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:17.855216 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.855100 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/571dfc0f-615f-4a8f-a87a-deed6f0a802d-trusted-ca\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:17.855216 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.855117 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/571dfc0f-615f-4a8f-a87a-deed6f0a802d-installation-pull-secrets\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:17.855216 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:17.855136 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/571dfc0f-615f-4a8f-a87a-deed6f0a802d-ca-trust-extracted\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:19.056418 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:19.056380 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="571dfc0f-615f-4a8f-a87a-deed6f0a802d" path="/var/lib/kubelet/pods/571dfc0f-615f-4a8f-a87a-deed6f0a802d/volumes" Jul 06 19:09:20.178925 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:20.178884 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7p69l_fbfedbd0-94f2-496b-a82a-e1e90fe0cea0/serve-healthcheck-canary/0.log" Jul 06 19:09:20.784870 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:20.784835 2559 generic.go:356] "Generic (PLEG): container finished" podID="d05a83c2-2366-47f6-8f84-94f66c7a5499" containerID="cd5f12eff37bf0313e5519694b6105591b8537f53fdb89638777dd2500d1cee1" exitCode=0 Jul 06 19:09:20.785028 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:20.784908 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" event={"ID":"d05a83c2-2366-47f6-8f84-94f66c7a5499","Type":"ContainerDied","Data":"cd5f12eff37bf0313e5519694b6105591b8537f53fdb89638777dd2500d1cee1"} Jul 06 19:09:20.785239 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:20.785225 2559 scope.go:117] "RemoveContainer" containerID="cd5f12eff37bf0313e5519694b6105591b8537f53fdb89638777dd2500d1cee1" Jul 06 19:09:21.790100 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:21.790068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-qvpqp" event={"ID":"d05a83c2-2366-47f6-8f84-94f66c7a5499","Type":"ContainerStarted","Data":"3bf252824a5e2f3834c187d2fa5883aee4b39387d308f0c46b03bc5136dc80a7"} Jul 06 19:09:27.058927 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:27.058897 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:09:27.062681 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:27.062657 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b5cbcb456-tckx2" Jul 06 19:09:28.040405 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.040344 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6ccd889694-hxl9t" podUID="bf456197-1f57-4063-9831-56018437b74b" containerName="console" containerID="cri-o://7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e" gracePeriod=15 Jul 06 19:09:28.310909 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.310833 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:09:28.343615 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.343583 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-oauth-serving-cert\") pod \"bf456197-1f57-4063-9831-56018437b74b\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " Jul 06 19:09:28.343809 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.343634 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-trusted-ca-bundle\") pod \"bf456197-1f57-4063-9831-56018437b74b\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " Jul 06 19:09:28.343809 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.343683 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-service-ca\") pod \"bf456197-1f57-4063-9831-56018437b74b\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " Jul 06 19:09:28.343809 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.343726 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqhnk\" (UniqueName: \"kubernetes.io/projected/bf456197-1f57-4063-9831-56018437b74b-kube-api-access-xqhnk\") pod \"bf456197-1f57-4063-9831-56018437b74b\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " Jul 06 19:09:28.343980 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.343933 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-serving-cert\") pod \"bf456197-1f57-4063-9831-56018437b74b\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " Jul 06 19:09:28.344036 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.343980 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-oauth-config\") pod \"bf456197-1f57-4063-9831-56018437b74b\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " Jul 06 19:09:28.344099 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344065 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bf456197-1f57-4063-9831-56018437b74b" (UID: "bf456197-1f57-4063-9831-56018437b74b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:28.344148 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344122 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-console-config\") pod \"bf456197-1f57-4063-9831-56018437b74b\" (UID: \"bf456197-1f57-4063-9831-56018437b74b\") " Jul 06 19:09:28.344223 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344197 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-service-ca" (OuterVolumeSpecName: "service-ca") pod "bf456197-1f57-4063-9831-56018437b74b" (UID: "bf456197-1f57-4063-9831-56018437b74b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:28.344313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344281 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bf456197-1f57-4063-9831-56018437b74b" (UID: "bf456197-1f57-4063-9831-56018437b74b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:28.344499 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344452 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-console-config" (OuterVolumeSpecName: "console-config") pod "bf456197-1f57-4063-9831-56018437b74b" (UID: "bf456197-1f57-4063-9831-56018437b74b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:09:28.344634 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344555 2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-service-ca\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:28.344634 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344575 2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-console-config\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:28.344634 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344589 2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-oauth-serving-cert\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:28.344634 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.344604 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf456197-1f57-4063-9831-56018437b74b-trusted-ca-bundle\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:28.346043 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.346011 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bf456197-1f57-4063-9831-56018437b74b" (UID: "bf456197-1f57-4063-9831-56018437b74b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:28.346484 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.346463 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf456197-1f57-4063-9831-56018437b74b-kube-api-access-xqhnk" (OuterVolumeSpecName: "kube-api-access-xqhnk") pod "bf456197-1f57-4063-9831-56018437b74b" (UID: "bf456197-1f57-4063-9831-56018437b74b"). InnerVolumeSpecName "kube-api-access-xqhnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:09:28.346558 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.346465 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bf456197-1f57-4063-9831-56018437b74b" (UID: "bf456197-1f57-4063-9831-56018437b74b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:09:28.445005 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.444977 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqhnk\" (UniqueName: \"kubernetes.io/projected/bf456197-1f57-4063-9831-56018437b74b-kube-api-access-xqhnk\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:28.445005 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.445001 2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-serving-cert\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:28.445005 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.445010 2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bf456197-1f57-4063-9831-56018437b74b-console-oauth-config\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:09:28.818616 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.818577 2559 generic.go:356] "Generic (PLEG): container finished" podID="bf456197-1f57-4063-9831-56018437b74b" containerID="7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e" exitCode=0 Jul 06 19:09:28.818791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.818624 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ccd889694-hxl9t" Jul 06 19:09:28.818791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.818667 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccd889694-hxl9t" event={"ID":"bf456197-1f57-4063-9831-56018437b74b","Type":"ContainerDied","Data":"7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e"} Jul 06 19:09:28.818791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.818750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ccd889694-hxl9t" event={"ID":"bf456197-1f57-4063-9831-56018437b74b","Type":"ContainerDied","Data":"825aa50058b87c7f91de9fbf8126e623437027a4077fb02c02a227fb616e0861"} Jul 06 19:09:28.818791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.818775 2559 scope.go:117] "RemoveContainer" containerID="7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e" Jul 06 19:09:28.827115 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.827096 2559 scope.go:117] "RemoveContainer" containerID="7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e" Jul 06 19:09:28.827362 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:09:28.827343 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e\": container with ID starting with 7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e not found: ID does not exist" containerID="7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e" Jul 06 19:09:28.827429 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.827370 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e"} err="failed to get container status \"7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e\": rpc error: code = NotFound desc = could not find container \"7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e\": container with ID starting with 7a8cf9791ab06f57ee592630a251846aed873f80bab1ddb006f68b33f8aebf7e not found: ID does not exist" Jul 06 19:09:28.840728 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.840698 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ccd889694-hxl9t"] Jul 06 19:09:28.846027 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:28.846005 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ccd889694-hxl9t"] Jul 06 19:09:29.054001 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:29.053967 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf456197-1f57-4063-9831-56018437b74b" path="/var/lib/kubelet/pods/bf456197-1f57-4063-9831-56018437b74b/volumes" Jul 06 19:09:48.930113 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:48.930028 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:09:48.949704 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:48.949679 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:09:49.926763 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:09:49.926735 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:02.895678 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:02.895640 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:02.896215 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:02.895921 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="alertmanager" containerID="cri-o://48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a" gracePeriod=120 Jul 06 19:10:02.896215 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:02.895992 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy-web" containerID="cri-o://1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b" gracePeriod=120 Jul 06 19:10:02.896215 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:02.895992 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy-metric" containerID="cri-o://5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0" gracePeriod=120 Jul 06 19:10:02.896215 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:02.896048 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy" containerID="cri-o://9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310" gracePeriod=120 Jul 06 19:10:02.896215 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:02.896068 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="config-reloader" containerID="cri-o://0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006" gracePeriod=120 Jul 06 19:10:02.896215 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:02.896094 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="prom-label-proxy" containerID="cri-o://652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e" gracePeriod=120 Jul 06 19:10:03.969237 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969205 2559 generic.go:356] "Generic (PLEG): container finished" podID="90cfe660-436f-4469-8432-aef67113ecf9" containerID="652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e" exitCode=0 Jul 06 19:10:03.969237 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969230 2559 generic.go:356] "Generic (PLEG): container finished" podID="90cfe660-436f-4469-8432-aef67113ecf9" containerID="5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0" exitCode=0 Jul 06 19:10:03.969237 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969236 2559 generic.go:356] "Generic (PLEG): container finished" podID="90cfe660-436f-4469-8432-aef67113ecf9" containerID="9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310" exitCode=0 Jul 06 19:10:03.969237 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969242 2559 generic.go:356] "Generic (PLEG): container finished" podID="90cfe660-436f-4469-8432-aef67113ecf9" containerID="0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006" exitCode=0 Jul 06 19:10:03.969688 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969247 2559 generic.go:356] "Generic (PLEG): container finished" podID="90cfe660-436f-4469-8432-aef67113ecf9" containerID="48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a" exitCode=0 Jul 06 19:10:03.969688 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969276 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerDied","Data":"652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e"} Jul 06 19:10:03.969688 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969337 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerDied","Data":"5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0"} Jul 06 19:10:03.969688 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969362 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerDied","Data":"9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310"} Jul 06 19:10:03.969688 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969386 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerDied","Data":"0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006"} Jul 06 19:10:03.969688 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:03.969410 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerDied","Data":"48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a"} Jul 06 19:10:04.139968 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.139944 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:04.252929 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.252848 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-cluster-tls-config\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.252929 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.252884 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-tls-assets\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.252929 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.252928 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253179 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.252955 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-main-tls\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253179 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.252983 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253179 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253018 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-metrics-client-ca\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253179 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253062 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-web\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253179 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253097 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-web-config\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253179 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253123 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5b2d\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-kube-api-access-n5b2d\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253179 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253158 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253188 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-main-db\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253233 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-config-out\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253560 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253268 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-config-volume\") pod \"90cfe660-436f-4469-8432-aef67113ecf9\" (UID: \"90cfe660-436f-4469-8432-aef67113ecf9\") " Jul 06 19:10:04.253785 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.253750 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:04.254184 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.254151 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:10:04.254506 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.254480 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:04.255650 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.255619 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:04.255749 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.255695 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:10:04.256151 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.256124 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:04.256972 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.256930 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-config-out" (OuterVolumeSpecName: "config-out") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:10:04.256972 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.256930 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-config-volume" (OuterVolumeSpecName: "config-volume") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:04.257089 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.256972 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-kube-api-access-n5b2d" (OuterVolumeSpecName: "kube-api-access-n5b2d") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "kube-api-access-n5b2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:10:04.257089 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.256995 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:04.257791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.257770 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:04.260787 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.260758 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:04.267114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.267091 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-web-config" (OuterVolumeSpecName: "web-config") pod "90cfe660-436f-4469-8432-aef67113ecf9" (UID: "90cfe660-436f-4469-8432-aef67113ecf9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:04.354682 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354646 2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-metrics-client-ca\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354682 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354676 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354716 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-web-config\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354728 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5b2d\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-kube-api-access-n5b2d\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354739 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354752 2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-alertmanager-main-db\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354763 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/90cfe660-436f-4469-8432-aef67113ecf9-config-out\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354775 2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-config-volume\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354785 2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-cluster-tls-config\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354797 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/90cfe660-436f-4469-8432-aef67113ecf9-tls-assets\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354809 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354822 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-main-tls\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.354900 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.354837 2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/90cfe660-436f-4469-8432-aef67113ecf9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:04.978683 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.978641 2559 generic.go:356] "Generic (PLEG): container finished" podID="90cfe660-436f-4469-8432-aef67113ecf9" containerID="1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b" exitCode=0 Jul 06 19:10:04.979088 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.978677 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerDied","Data":"1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b"} Jul 06 19:10:04.979088 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.978723 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:04.979088 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.978809 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"90cfe660-436f-4469-8432-aef67113ecf9","Type":"ContainerDied","Data":"ddc3167012781185a22b79625e4f6b5029d02a112243ef8fe99b2774b3b83416"} Jul 06 19:10:04.979088 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.978863 2559 scope.go:117] "RemoveContainer" containerID="652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e" Jul 06 19:10:04.986851 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.986827 2559 scope.go:117] "RemoveContainer" containerID="5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0" Jul 06 19:10:04.993600 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:04.993583 2559 scope.go:117] "RemoveContainer" containerID="9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310" Jul 06 19:10:05.000339 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.000322 2559 scope.go:117] "RemoveContainer" containerID="1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b" Jul 06 19:10:05.007758 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.007734 2559 scope.go:117] "RemoveContainer" containerID="0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006" Jul 06 19:10:05.007758 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.007753 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:05.015104 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.014892 2559 scope.go:117] "RemoveContainer" containerID="48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a" Jul 06 19:10:05.015822 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.015800 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:05.021806 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.021789 2559 scope.go:117] "RemoveContainer" containerID="0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1" Jul 06 19:10:05.028479 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.028463 2559 scope.go:117] "RemoveContainer" containerID="652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e" Jul 06 19:10:05.028781 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:05.028759 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e\": container with ID starting with 652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e not found: ID does not exist" containerID="652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e" Jul 06 19:10:05.028846 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.028790 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e"} err="failed to get container status \"652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e\": rpc error: code = NotFound desc = could not find container \"652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e\": container with ID starting with 652d613b1e99d79f5262ef9cd25779dc81528bd9c78b1f12d9e87d9ac909153e not found: ID does not exist" Jul 06 19:10:05.028846 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.028809 2559 scope.go:117] "RemoveContainer" containerID="5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0" Jul 06 19:10:05.029039 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:05.029022 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0\": container with ID starting with 5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0 not found: ID does not exist" containerID="5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0" Jul 06 19:10:05.029099 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.029048 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0"} err="failed to get container status \"5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0\": rpc error: code = NotFound desc = could not find container \"5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0\": container with ID starting with 5600568161d9bf9fbbd7eedf7a524c1c32c04d00f6f804f5896f079560039fb0 not found: ID does not exist" Jul 06 19:10:05.029099 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.029071 2559 scope.go:117] "RemoveContainer" containerID="9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310" Jul 06 19:10:05.029311 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:05.029295 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310\": container with ID starting with 9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310 not found: ID does not exist" containerID="9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310" Jul 06 19:10:05.029348 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.029316 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310"} err="failed to get container status \"9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310\": rpc error: code = NotFound desc = could not find container \"9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310\": container with ID starting with 9303ce0d0ee5af31d3bf616db78b60ca7181751380b98f62e4846d3f6d035310 not found: ID does not exist" Jul 06 19:10:05.029348 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.029332 2559 scope.go:117] "RemoveContainer" containerID="1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b" Jul 06 19:10:05.029570 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:05.029551 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b\": container with ID starting with 1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b not found: ID does not exist" containerID="1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b" Jul 06 19:10:05.029640 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.029580 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b"} err="failed to get container status \"1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b\": rpc error: code = NotFound desc = could not find container \"1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b\": container with ID starting with 1ccfbd78cd029ecce1d7535902bb230cc4077839787e1f616f87084111c39b6b not found: ID does not exist" Jul 06 19:10:05.029640 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.029601 2559 scope.go:117] "RemoveContainer" containerID="0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006" Jul 06 19:10:05.029840 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:05.029825 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006\": container with ID starting with 0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006 not found: ID does not exist" containerID="0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006" Jul 06 19:10:05.029874 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.029843 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006"} err="failed to get container status \"0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006\": rpc error: code = NotFound desc = could not find container \"0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006\": container with ID starting with 0fde5adefe41970705d32286b950f156fe22f09045763776fad7f74c45529006 not found: ID does not exist" Jul 06 19:10:05.029874 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.029856 2559 scope.go:117] "RemoveContainer" containerID="48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a" Jul 06 19:10:05.030045 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:05.030029 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a\": container with ID starting with 48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a not found: ID does not exist" containerID="48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a" Jul 06 19:10:05.030109 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.030051 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a"} err="failed to get container status \"48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a\": rpc error: code = NotFound desc = could not find container \"48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a\": container with ID starting with 48d8b31c281b8530069e13275a583e339c33a764e4060a48f4c89fb90c6a8f1a not found: ID does not exist" Jul 06 19:10:05.030109 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.030070 2559 scope.go:117] "RemoveContainer" containerID="0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1" Jul 06 19:10:05.030297 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:05.030281 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1\": container with ID starting with 0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1 not found: ID does not exist" containerID="0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1" Jul 06 19:10:05.030333 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.030300 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1"} err="failed to get container status \"0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1\": rpc error: code = NotFound desc = could not find container \"0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1\": container with ID starting with 0fc70bc7b0d188669a8d9afe158a66c84cda7a6af6dc199484299cbdc8e3cff1 not found: ID does not exist" Jul 06 19:10:05.048598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048566 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:05.048916 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048899 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="config-reloader" Jul 06 19:10:05.048975 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048918 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="config-reloader" Jul 06 19:10:05.048975 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048936 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy" Jul 06 19:10:05.048975 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048945 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy" Jul 06 19:10:05.048975 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048960 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81d8baa7-7587-4b15-a25c-785b6a7cc16a" containerName="console" Jul 06 19:10:05.048975 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048967 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="81d8baa7-7587-4b15-a25c-785b6a7cc16a" containerName="console" Jul 06 19:10:05.048975 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048975 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy-web" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048982 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy-web" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048991 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="571dfc0f-615f-4a8f-a87a-deed6f0a802d" containerName="registry" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.048997 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="571dfc0f-615f-4a8f-a87a-deed6f0a802d" containerName="registry" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049002 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf456197-1f57-4063-9831-56018437b74b" containerName="console" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049007 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf456197-1f57-4063-9831-56018437b74b" containerName="console" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049014 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="init-config-reloader" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049020 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="init-config-reloader" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049030 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="alertmanager" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049035 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="alertmanager" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049042 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="prom-label-proxy" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049046 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="prom-label-proxy" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049053 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy-metric" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049058 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy-metric" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049117 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049127 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="alertmanager" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049133 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="81d8baa7-7587-4b15-a25c-785b6a7cc16a" containerName="console" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049138 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="571dfc0f-615f-4a8f-a87a-deed6f0a802d" containerName="registry" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049145 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="prom-label-proxy" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049150 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy-web" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049155 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="config-reloader" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049160 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf456197-1f57-4063-9831-56018437b74b" containerName="console" Jul 06 19:10:05.049191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.049166 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="90cfe660-436f-4469-8432-aef67113ecf9" containerName="kube-rbac-proxy-metric" Jul 06 19:10:05.053654 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.053632 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.056810 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.056784 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 06 19:10:05.056810 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.056793 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 06 19:10:05.056978 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.056820 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 06 19:10:05.056978 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.056853 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 06 19:10:05.056978 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.056880 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 06 19:10:05.057164 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.057143 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 06 19:10:05.057164 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.057161 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 06 19:10:05.057321 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.057252 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-l9mjg\"" Jul 06 19:10:05.057375 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.057329 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 06 19:10:05.059594 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.059569 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90cfe660-436f-4469-8432-aef67113ecf9" path="/var/lib/kubelet/pods/90cfe660-436f-4469-8432-aef67113ecf9/volumes" Jul 06 19:10:05.063376 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.063350 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 06 19:10:05.075008 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.074975 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:05.161442 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161404 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-web-config\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161442 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161439 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/710160dd-5dc7-402e-bb64-414b9ba07ff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161505 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/710160dd-5dc7-402e-bb64-414b9ba07ff1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/710160dd-5dc7-402e-bb64-414b9ba07ff1-config-out\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161689 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161639 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/710160dd-5dc7-402e-bb64-414b9ba07ff1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161896 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161896 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161756 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/710160dd-5dc7-402e-bb64-414b9ba07ff1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161896 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161896 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161817 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-config-volume\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.161896 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.161838 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz7q9\" (UniqueName: \"kubernetes.io/projected/710160dd-5dc7-402e-bb64-414b9ba07ff1-kube-api-access-zz7q9\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.262712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262629 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.262712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/710160dd-5dc7-402e-bb64-414b9ba07ff1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.262712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/710160dd-5dc7-402e-bb64-414b9ba07ff1-config-out\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.262712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/710160dd-5dc7-402e-bb64-414b9ba07ff1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262764 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/710160dd-5dc7-402e-bb64-414b9ba07ff1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-config-volume\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262844 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz7q9\" (UniqueName: \"kubernetes.io/projected/710160dd-5dc7-402e-bb64-414b9ba07ff1-kube-api-access-zz7q9\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262884 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-web-config\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262952 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/710160dd-5dc7-402e-bb64-414b9ba07ff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.262981 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263313 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.263181 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/710160dd-5dc7-402e-bb64-414b9ba07ff1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.263849 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.263659 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/710160dd-5dc7-402e-bb64-414b9ba07ff1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.265783 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.265749 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/710160dd-5dc7-402e-bb64-414b9ba07ff1-config-out\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.266055 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.265919 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.266164 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.266120 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-web-config\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.266289 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.266264 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/710160dd-5dc7-402e-bb64-414b9ba07ff1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.266371 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.266356 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.266437 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.266424 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.266619 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.266591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.266704 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.266632 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-config-volume\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.266858 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.266841 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/710160dd-5dc7-402e-bb64-414b9ba07ff1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.267669 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.267656 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/710160dd-5dc7-402e-bb64-414b9ba07ff1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.274819 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.274799 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz7q9\" (UniqueName: \"kubernetes.io/projected/710160dd-5dc7-402e-bb64-414b9ba07ff1-kube-api-access-zz7q9\") pod \"alertmanager-main-0\" (UID: \"710160dd-5dc7-402e-bb64-414b9ba07ff1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.364052 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.364017 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 06 19:10:05.513144 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.513059 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 06 19:10:05.515671 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:10:05.515644 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710160dd_5dc7_402e_bb64_414b9ba07ff1.slice/crio-416e7c3d085fa6310bde66019b3a4437daa21f2874444ccc819e110635fc97b2 WatchSource:0}: Error finding container 416e7c3d085fa6310bde66019b3a4437daa21f2874444ccc819e110635fc97b2: Status 404 returned error can't find the container with id 416e7c3d085fa6310bde66019b3a4437daa21f2874444ccc819e110635fc97b2 Jul 06 19:10:05.983459 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.983426 2559 generic.go:356] "Generic (PLEG): container finished" podID="710160dd-5dc7-402e-bb64-414b9ba07ff1" containerID="79ed4faa89ed908b515d037a6966046033c9aeb0741a027284e40e50b5fb5bfd" exitCode=0 Jul 06 19:10:05.983912 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.983513 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"710160dd-5dc7-402e-bb64-414b9ba07ff1","Type":"ContainerDied","Data":"79ed4faa89ed908b515d037a6966046033c9aeb0741a027284e40e50b5fb5bfd"} Jul 06 19:10:05.983912 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:05.983620 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"710160dd-5dc7-402e-bb64-414b9ba07ff1","Type":"ContainerStarted","Data":"416e7c3d085fa6310bde66019b3a4437daa21f2874444ccc819e110635fc97b2"} Jul 06 19:10:06.996579 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:06.996539 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"710160dd-5dc7-402e-bb64-414b9ba07ff1","Type":"ContainerStarted","Data":"eaac32bf64eca08ab226cea89ffed5d8c4faf06f0d81f485e58a50f997256f00"} Jul 06 19:10:06.996955 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:06.996639 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"710160dd-5dc7-402e-bb64-414b9ba07ff1","Type":"ContainerStarted","Data":"bed36a9b5e3aed1868a1355dec667004ce27b7ab563a406982f177877fea148c"} Jul 06 19:10:06.996955 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:06.996666 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"710160dd-5dc7-402e-bb64-414b9ba07ff1","Type":"ContainerStarted","Data":"48dd0e25508e72a47e9277d5b516d4628457ca20029ea00eaf1aa08214d6e228"} Jul 06 19:10:06.996955 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:06.996690 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"710160dd-5dc7-402e-bb64-414b9ba07ff1","Type":"ContainerStarted","Data":"3cd35b8b2ab7e2607950058aeca00cd2f4cddebc3246dfbb9e6809cab09dfd4c"} Jul 06 19:10:06.996955 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:06.996712 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"710160dd-5dc7-402e-bb64-414b9ba07ff1","Type":"ContainerStarted","Data":"37235729415cac9559b42a1ba915915cc5053f1bfa920f846df6051b21845089"} Jul 06 19:10:06.996955 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:06.996734 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"710160dd-5dc7-402e-bb64-414b9ba07ff1","Type":"ContainerStarted","Data":"55dd6fa1731bd3d8c9904a7732fbb576014832e3bee628dcf11e7082eefe8a85"} Jul 06 19:10:07.034410 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.034359 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.018319823 podStartE2EDuration="2.034339382s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.019559ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:07.032996275 +0000 UTC m=+196.461751366" watchObservedRunningTime="2026-07-06 19:10:07.034339382 +0000 UTC m=+196.463094471" Jul 06 19:10:07.219046 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.219007 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:07.219416 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.219375 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="prometheus" containerID="cri-o://50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" gracePeriod=600 Jul 06 19:10:07.219574 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.219413 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="config-reloader" containerID="cri-o://6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" gracePeriod=600 Jul 06 19:10:07.219574 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.219424 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy-web" containerID="cri-o://39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" gracePeriod=600 Jul 06 19:10:07.219574 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.219438 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy-thanos" containerID="cri-o://db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" gracePeriod=600 Jul 06 19:10:07.219574 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.219390 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="thanos-sidecar" containerID="cri-o://ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" gracePeriod=600 Jul 06 19:10:07.219574 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.219384 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy" containerID="cri-o://62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" gracePeriod=600 Jul 06 19:10:07.464332 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.464307 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:07.479803 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.479782 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-kube-rbac-proxy\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.479889 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.479817 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-kubelet-serving-ca-bundle\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.479889 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.479845 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-web-config\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.479889 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.479866 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-tls\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480036 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.479978 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-serving-certs-ca-bundle\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480036 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480028 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w8xsc\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-kube-api-access-w8xsc\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480136 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480059 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-config-out\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480136 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480086 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-trusted-ca-bundle\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480136 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480122 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-2\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480292 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480166 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-tls-assets\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480292 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480196 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-db\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480292 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480232 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480292 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480258 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480292 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480204 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:07.480292 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480285 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-metrics-client-certs\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480321 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-0\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480358 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-1\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480383 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-thanos-prometheus-http-client-file\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480388 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:07.480598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480426 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-metrics-client-ca\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480455 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-grpc-tls\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480598 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480486 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-config\") pod \"4843834c-0324-4982-af17-af9472805cff\" (UID: \"4843834c-0324-4982-af17-af9472805cff\") " Jul 06 19:10:07.480978 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480787 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.480978 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480795 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:07.480978 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480808 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.480978 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.480877 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:07.482363 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.482333 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:07.482696 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.482670 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:10:07.482796 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.482754 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.482796 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.482754 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:07.483247 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.483206 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 19:10:07.483902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.483367 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-config-out" (OuterVolumeSpecName: "config-out") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:10:07.483902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.483567 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-kube-api-access-w8xsc" (OuterVolumeSpecName: "kube-api-access-w8xsc") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "kube-api-access-w8xsc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:10:07.484075 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.483904 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.484256 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.484206 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.484736 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.484709 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.485154 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.485132 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.485398 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.485370 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-config" (OuterVolumeSpecName: "config") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.485398 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.485385 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.485514 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.485482 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:10:07.485640 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.485622 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.493326 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.493303 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-web-config" (OuterVolumeSpecName: "web-config") pod "4843834c-0324-4982-af17-af9472805cff" (UID: "4843834c-0324-4982-af17-af9472805cff"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581373 2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-kube-rbac-proxy\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581397 2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-web-config\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581406 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581415 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w8xsc\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-kube-api-access-w8xsc\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581423 2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-config-out\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581432 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581441 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581449 2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4843834c-0324-4982-af17-af9472805cff-tls-assets\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581457 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581457 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-db\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581466 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581475 2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581486 2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-metrics-client-certs\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581494 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581503 2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581511 2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581521 2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4843834c-0324-4982-af17-af9472805cff-configmap-metrics-client-ca\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581543 2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-secret-grpc-tls\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:07.581884 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:07.581551 2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4843834c-0324-4982-af17-af9472805cff-config\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:10:08.003660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003627 2559 generic.go:356] "Generic (PLEG): container finished" podID="4843834c-0324-4982-af17-af9472805cff" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" exitCode=0 Jul 06 19:10:08.003660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003653 2559 generic.go:356] "Generic (PLEG): container finished" podID="4843834c-0324-4982-af17-af9472805cff" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" exitCode=0 Jul 06 19:10:08.003660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003660 2559 generic.go:356] "Generic (PLEG): container finished" podID="4843834c-0324-4982-af17-af9472805cff" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" exitCode=0 Jul 06 19:10:08.003660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003666 2559 generic.go:356] "Generic (PLEG): container finished" podID="4843834c-0324-4982-af17-af9472805cff" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" exitCode=0 Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003673 2559 generic.go:356] "Generic (PLEG): container finished" podID="4843834c-0324-4982-af17-af9472805cff" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" exitCode=0 Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003679 2559 generic.go:356] "Generic (PLEG): container finished" podID="4843834c-0324-4982-af17-af9472805cff" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" exitCode=0 Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003713 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerDied","Data":"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c"} Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003857 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerDied","Data":"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc"} Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003904 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerDied","Data":"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe"} Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003918 2559 scope.go:117] "RemoveContainer" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003947 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerDied","Data":"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f"} Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.003990 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerDied","Data":"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5"} Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.004031 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerDied","Data":"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289"} Jul 06 19:10:08.004116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.004070 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4843834c-0324-4982-af17-af9472805cff","Type":"ContainerDied","Data":"7703120b78cf58039468528c1bceb8583840aa9bfdabfe61b6a1b1c8040e8ce2"} Jul 06 19:10:08.012206 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.012068 2559 scope.go:117] "RemoveContainer" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" Jul 06 19:10:08.019114 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.019101 2559 scope.go:117] "RemoveContainer" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" Jul 06 19:10:08.025653 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.025637 2559 scope.go:117] "RemoveContainer" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" Jul 06 19:10:08.032098 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.032082 2559 scope.go:117] "RemoveContainer" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" Jul 06 19:10:08.034266 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.034246 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:08.039634 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.039586 2559 scope.go:117] "RemoveContainer" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" Jul 06 19:10:08.041060 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.041042 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:08.049320 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.049295 2559 scope.go:117] "RemoveContainer" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" Jul 06 19:10:08.055877 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.055859 2559 scope.go:117] "RemoveContainer" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" Jul 06 19:10:08.056133 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:08.056115 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": container with ID starting with db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c not found: ID does not exist" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" Jul 06 19:10:08.056184 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.056141 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c"} err="failed to get container status \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": rpc error: code = NotFound desc = could not find container \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": container with ID starting with db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c not found: ID does not exist" Jul 06 19:10:08.056184 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.056158 2559 scope.go:117] "RemoveContainer" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" Jul 06 19:10:08.056415 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:08.056396 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": container with ID starting with 62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc not found: ID does not exist" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" Jul 06 19:10:08.056476 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.056427 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc"} err="failed to get container status \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": rpc error: code = NotFound desc = could not find container \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": container with ID starting with 62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc not found: ID does not exist" Jul 06 19:10:08.056476 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.056451 2559 scope.go:117] "RemoveContainer" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" Jul 06 19:10:08.056726 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:08.056706 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": container with ID starting with 39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe not found: ID does not exist" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" Jul 06 19:10:08.056764 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.056732 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe"} err="failed to get container status \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": rpc error: code = NotFound desc = could not find container \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": container with ID starting with 39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe not found: ID does not exist" Jul 06 19:10:08.056764 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.056747 2559 scope.go:117] "RemoveContainer" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" Jul 06 19:10:08.056962 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:08.056947 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": container with ID starting with ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f not found: ID does not exist" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" Jul 06 19:10:08.057004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.056965 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f"} err="failed to get container status \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": rpc error: code = NotFound desc = could not find container \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": container with ID starting with ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f not found: ID does not exist" Jul 06 19:10:08.057004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.056977 2559 scope.go:117] "RemoveContainer" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" Jul 06 19:10:08.057194 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:08.057177 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": container with ID starting with 6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5 not found: ID does not exist" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" Jul 06 19:10:08.057249 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.057200 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5"} err="failed to get container status \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": rpc error: code = NotFound desc = could not find container \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": container with ID starting with 6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5 not found: ID does not exist" Jul 06 19:10:08.057249 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.057223 2559 scope.go:117] "RemoveContainer" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" Jul 06 19:10:08.057464 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:08.057447 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": container with ID starting with 50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289 not found: ID does not exist" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" Jul 06 19:10:08.057503 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.057468 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289"} err="failed to get container status \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": rpc error: code = NotFound desc = could not find container \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": container with ID starting with 50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289 not found: ID does not exist" Jul 06 19:10:08.057503 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.057481 2559 scope.go:117] "RemoveContainer" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" Jul 06 19:10:08.057723 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:10:08.057707 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": container with ID starting with 8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477 not found: ID does not exist" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" Jul 06 19:10:08.057773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.057726 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477"} err="failed to get container status \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": rpc error: code = NotFound desc = could not find container \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": container with ID starting with 8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477 not found: ID does not exist" Jul 06 19:10:08.057773 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.057738 2559 scope.go:117] "RemoveContainer" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" Jul 06 19:10:08.057948 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.057929 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c"} err="failed to get container status \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": rpc error: code = NotFound desc = could not find container \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": container with ID starting with db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c not found: ID does not exist" Jul 06 19:10:08.057989 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.057949 2559 scope.go:117] "RemoveContainer" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" Jul 06 19:10:08.058147 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058129 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc"} err="failed to get container status \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": rpc error: code = NotFound desc = could not find container \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": container with ID starting with 62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc not found: ID does not exist" Jul 06 19:10:08.058215 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058150 2559 scope.go:117] "RemoveContainer" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" Jul 06 19:10:08.058352 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058334 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe"} err="failed to get container status \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": rpc error: code = NotFound desc = could not find container \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": container with ID starting with 39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe not found: ID does not exist" Jul 06 19:10:08.058400 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058352 2559 scope.go:117] "RemoveContainer" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" Jul 06 19:10:08.058546 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058511 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f"} err="failed to get container status \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": rpc error: code = NotFound desc = could not find container \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": container with ID starting with ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f not found: ID does not exist" Jul 06 19:10:08.058546 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058544 2559 scope.go:117] "RemoveContainer" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" Jul 06 19:10:08.058735 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058718 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5"} err="failed to get container status \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": rpc error: code = NotFound desc = could not find container \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": container with ID starting with 6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5 not found: ID does not exist" Jul 06 19:10:08.058795 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058736 2559 scope.go:117] "RemoveContainer" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" Jul 06 19:10:08.058930 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058914 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289"} err="failed to get container status \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": rpc error: code = NotFound desc = could not find container \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": container with ID starting with 50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289 not found: ID does not exist" Jul 06 19:10:08.059006 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.058930 2559 scope.go:117] "RemoveContainer" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" Jul 06 19:10:08.059144 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059128 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477"} err="failed to get container status \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": rpc error: code = NotFound desc = could not find container \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": container with ID starting with 8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477 not found: ID does not exist" Jul 06 19:10:08.059187 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059146 2559 scope.go:117] "RemoveContainer" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" Jul 06 19:10:08.059323 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059307 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c"} err="failed to get container status \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": rpc error: code = NotFound desc = could not find container \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": container with ID starting with db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c not found: ID does not exist" Jul 06 19:10:08.059365 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059324 2559 scope.go:117] "RemoveContainer" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" Jul 06 19:10:08.059515 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059496 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc"} err="failed to get container status \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": rpc error: code = NotFound desc = could not find container \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": container with ID starting with 62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc not found: ID does not exist" Jul 06 19:10:08.059597 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059515 2559 scope.go:117] "RemoveContainer" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" Jul 06 19:10:08.059721 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059706 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe"} err="failed to get container status \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": rpc error: code = NotFound desc = could not find container \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": container with ID starting with 39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe not found: ID does not exist" Jul 06 19:10:08.059766 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059722 2559 scope.go:117] "RemoveContainer" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" Jul 06 19:10:08.059876 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059861 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f"} err="failed to get container status \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": rpc error: code = NotFound desc = could not find container \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": container with ID starting with ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f not found: ID does not exist" Jul 06 19:10:08.059918 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.059877 2559 scope.go:117] "RemoveContainer" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" Jul 06 19:10:08.060069 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060056 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5"} err="failed to get container status \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": rpc error: code = NotFound desc = could not find container \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": container with ID starting with 6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5 not found: ID does not exist" Jul 06 19:10:08.060111 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060070 2559 scope.go:117] "RemoveContainer" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" Jul 06 19:10:08.060257 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060242 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289"} err="failed to get container status \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": rpc error: code = NotFound desc = could not find container \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": container with ID starting with 50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289 not found: ID does not exist" Jul 06 19:10:08.060294 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060258 2559 scope.go:117] "RemoveContainer" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" Jul 06 19:10:08.060432 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060416 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477"} err="failed to get container status \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": rpc error: code = NotFound desc = could not find container \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": container with ID starting with 8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477 not found: ID does not exist" Jul 06 19:10:08.060470 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060432 2559 scope.go:117] "RemoveContainer" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" Jul 06 19:10:08.060631 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060616 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c"} err="failed to get container status \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": rpc error: code = NotFound desc = could not find container \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": container with ID starting with db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c not found: ID does not exist" Jul 06 19:10:08.060681 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060631 2559 scope.go:117] "RemoveContainer" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" Jul 06 19:10:08.060811 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060797 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc"} err="failed to get container status \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": rpc error: code = NotFound desc = could not find container \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": container with ID starting with 62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc not found: ID does not exist" Jul 06 19:10:08.060853 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060811 2559 scope.go:117] "RemoveContainer" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" Jul 06 19:10:08.060977 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060961 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe"} err="failed to get container status \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": rpc error: code = NotFound desc = could not find container \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": container with ID starting with 39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe not found: ID does not exist" Jul 06 19:10:08.061015 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.060977 2559 scope.go:117] "RemoveContainer" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" Jul 06 19:10:08.061149 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.061132 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f"} err="failed to get container status \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": rpc error: code = NotFound desc = could not find container \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": container with ID starting with ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f not found: ID does not exist" Jul 06 19:10:08.061197 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.061149 2559 scope.go:117] "RemoveContainer" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" Jul 06 19:10:08.061320 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.061305 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5"} err="failed to get container status \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": rpc error: code = NotFound desc = could not find container \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": container with ID starting with 6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5 not found: ID does not exist" Jul 06 19:10:08.061371 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.061320 2559 scope.go:117] "RemoveContainer" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" Jul 06 19:10:08.061507 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.061493 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289"} err="failed to get container status \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": rpc error: code = NotFound desc = could not find container \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": container with ID starting with 50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289 not found: ID does not exist" Jul 06 19:10:08.061569 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.061508 2559 scope.go:117] "RemoveContainer" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" Jul 06 19:10:08.061825 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.061807 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477"} err="failed to get container status \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": rpc error: code = NotFound desc = could not find container \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": container with ID starting with 8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477 not found: ID does not exist" Jul 06 19:10:08.061825 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.061824 2559 scope.go:117] "RemoveContainer" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" Jul 06 19:10:08.062037 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062020 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c"} err="failed to get container status \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": rpc error: code = NotFound desc = could not find container \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": container with ID starting with db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c not found: ID does not exist" Jul 06 19:10:08.062088 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062037 2559 scope.go:117] "RemoveContainer" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" Jul 06 19:10:08.062249 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062226 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc"} err="failed to get container status \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": rpc error: code = NotFound desc = could not find container \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": container with ID starting with 62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc not found: ID does not exist" Jul 06 19:10:08.062294 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062249 2559 scope.go:117] "RemoveContainer" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" Jul 06 19:10:08.062453 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062438 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe"} err="failed to get container status \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": rpc error: code = NotFound desc = could not find container \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": container with ID starting with 39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe not found: ID does not exist" Jul 06 19:10:08.062492 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062455 2559 scope.go:117] "RemoveContainer" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" Jul 06 19:10:08.062660 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062642 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f"} err="failed to get container status \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": rpc error: code = NotFound desc = could not find container \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": container with ID starting with ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f not found: ID does not exist" Jul 06 19:10:08.062708 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062662 2559 scope.go:117] "RemoveContainer" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" Jul 06 19:10:08.062863 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062847 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5"} err="failed to get container status \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": rpc error: code = NotFound desc = could not find container \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": container with ID starting with 6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5 not found: ID does not exist" Jul 06 19:10:08.062930 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.062863 2559 scope.go:117] "RemoveContainer" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" Jul 06 19:10:08.063060 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063041 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289"} err="failed to get container status \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": rpc error: code = NotFound desc = could not find container \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": container with ID starting with 50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289 not found: ID does not exist" Jul 06 19:10:08.063104 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063060 2559 scope.go:117] "RemoveContainer" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" Jul 06 19:10:08.063278 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063261 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477"} err="failed to get container status \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": rpc error: code = NotFound desc = could not find container \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": container with ID starting with 8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477 not found: ID does not exist" Jul 06 19:10:08.063315 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063279 2559 scope.go:117] "RemoveContainer" containerID="db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c" Jul 06 19:10:08.063484 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063469 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c"} err="failed to get container status \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": rpc error: code = NotFound desc = could not find container \"db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c\": container with ID starting with db9a85c911db0da796701c98cb8b7f9b79abb0fb6daeac70172626d528e1016c not found: ID does not exist" Jul 06 19:10:08.063484 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063484 2559 scope.go:117] "RemoveContainer" containerID="62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc" Jul 06 19:10:08.063709 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063694 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc"} err="failed to get container status \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": rpc error: code = NotFound desc = could not find container \"62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc\": container with ID starting with 62875a9c94cae8b883e3e5bc52cfc136075de6b65dbd6e7d9fa1930a77497ddc not found: ID does not exist" Jul 06 19:10:08.063709 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063708 2559 scope.go:117] "RemoveContainer" containerID="39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe" Jul 06 19:10:08.063888 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063871 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe"} err="failed to get container status \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": rpc error: code = NotFound desc = could not find container \"39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe\": container with ID starting with 39de78de4d48d2162b6a5996796f5fd08254d9b434040db0b82185d16a8e76fe not found: ID does not exist" Jul 06 19:10:08.063934 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.063889 2559 scope.go:117] "RemoveContainer" containerID="ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f" Jul 06 19:10:08.064173 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.064120 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f"} err="failed to get container status \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": rpc error: code = NotFound desc = could not find container \"ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f\": container with ID starting with ef57a2070b43276de0e518bb855eb59008b6aeccea17293719f4a1084bd37b2f not found: ID does not exist" Jul 06 19:10:08.064236 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.064176 2559 scope.go:117] "RemoveContainer" containerID="6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5" Jul 06 19:10:08.064486 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.064437 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5"} err="failed to get container status \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": rpc error: code = NotFound desc = could not find container \"6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5\": container with ID starting with 6e88829da785233bb7b07a7fedb8be7b5647fd045a4e640827446eccbdb2c1a5 not found: ID does not exist" Jul 06 19:10:08.064486 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.064457 2559 scope.go:117] "RemoveContainer" containerID="50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289" Jul 06 19:10:08.064814 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.064795 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289"} err="failed to get container status \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": rpc error: code = NotFound desc = could not find container \"50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289\": container with ID starting with 50e393e99c82b91a2d33077bb296c218b922dd86216df390739980e45e8bc289 not found: ID does not exist" Jul 06 19:10:08.064814 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.064814 2559 scope.go:117] "RemoveContainer" containerID="8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477" Jul 06 19:10:08.065058 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.065039 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477"} err="failed to get container status \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": rpc error: code = NotFound desc = could not find container \"8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477\": container with ID starting with 8c252ada135c90e2c2c991dfd92f82216c71050f9dbc6fd6a488e85355c1b477 not found: ID does not exist" Jul 06 19:10:08.076078 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076054 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:08.076324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076312 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="prometheus" Jul 06 19:10:08.076371 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076326 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="prometheus" Jul 06 19:10:08.076371 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076337 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="config-reloader" Jul 06 19:10:08.076371 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076343 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="config-reloader" Jul 06 19:10:08.076371 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076350 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy" Jul 06 19:10:08.076371 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076355 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy" Jul 06 19:10:08.076371 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076368 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="thanos-sidecar" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076373 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="thanos-sidecar" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076383 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy-web" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076389 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy-web" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076396 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="init-config-reloader" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076401 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="init-config-reloader" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076408 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy-thanos" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076413 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy-thanos" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076458 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy-thanos" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076466 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="prometheus" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076471 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076476 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="kube-rbac-proxy-web" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076484 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="config-reloader" Jul 06 19:10:08.076551 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.076489 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4843834c-0324-4982-af17-af9472805cff" containerName="thanos-sidecar" Jul 06 19:10:08.080050 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.080035 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.082759 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.082737 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 06 19:10:08.082854 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.082813 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 06 19:10:08.082911 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.082897 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 06 19:10:08.083282 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.083260 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 06 19:10:08.083355 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.083283 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 06 19:10:08.083355 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.083285 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 06 19:10:08.083813 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.083797 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 06 19:10:08.083893 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.083827 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 06 19:10:08.084311 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084293 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084366 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084320 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084366 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084343 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084475 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084407 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084559 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084473 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084559 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084501 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084669 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084589 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084669 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084634 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-de6duf6vp4gun\"" Jul 06 19:10:08.084763 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084634 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084763 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084684 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kn2bz\"" Jul 06 19:10:08.084763 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084735 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb03123-9c68-427b-80d1-c1a42dd27131-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084913 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084761 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-config\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084913 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084797 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb03123-9c68-427b-80d1-c1a42dd27131-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.084913 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084879 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 06 19:10:08.084913 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085152 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084925 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 06 19:10:08.085152 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084937 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085152 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084969 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 06 19:10:08.085152 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.084983 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085152 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.085045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085152 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.085094 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.085160 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.085194 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.085224 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkvr\" (UniqueName: \"kubernetes.io/projected/deb03123-9c68-427b-80d1-c1a42dd27131-kube-api-access-nzkvr\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085436 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.085271 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.085849 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.085832 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 06 19:10:08.088667 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.088645 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 06 19:10:08.091576 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.091560 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 06 19:10:08.114335 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.114302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:08.186043 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186004 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186043 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186288 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186065 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb03123-9c68-427b-80d1-c1a42dd27131-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186288 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-config\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186288 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb03123-9c68-427b-80d1-c1a42dd27131-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186288 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186116 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186288 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186521 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186493 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186615 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186567 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186687 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186610 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186687 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186640 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186687 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186670 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186828 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186828 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186723 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkvr\" (UniqueName: \"kubernetes.io/projected/deb03123-9c68-427b-80d1-c1a42dd27131-kube-api-access-nzkvr\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186828 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186752 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186828 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186788 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.186828 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186813 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.187071 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186837 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.187071 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186892 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.187071 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186915 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.187071 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186929 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.187071 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.186947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.187308 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.187207 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.190337 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.189720 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.190337 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.190092 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.190594 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.190397 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.192492 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.191315 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.192492 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.191333 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.192492 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.191964 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deb03123-9c68-427b-80d1-c1a42dd27131-config-out\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.192492 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.192300 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deb03123-9c68-427b-80d1-c1a42dd27131-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.192766 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.192736 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-web-config\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.192952 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.192928 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.193614 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.193591 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.194218 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.194195 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.195394 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.195365 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deb03123-9c68-427b-80d1-c1a42dd27131-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.195486 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.195394 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.198322 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.197630 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-config\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.198593 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.198519 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.199624 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.199601 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deb03123-9c68-427b-80d1-c1a42dd27131-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.210849 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.210820 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkvr\" (UniqueName: \"kubernetes.io/projected/deb03123-9c68-427b-80d1-c1a42dd27131-kube-api-access-nzkvr\") pod \"prometheus-k8s-0\" (UID: \"deb03123-9c68-427b-80d1-c1a42dd27131\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.390240 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.390206 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:10:08.545309 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:08.545285 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 06 19:10:08.546800 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:10:08.546777 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeb03123_9c68_427b_80d1_c1a42dd27131.slice/crio-f1234e9674ce66ed7a7c3ab4c44890f79c2e8463f1646d3a1685c0b9d476031f WatchSource:0}: Error finding container f1234e9674ce66ed7a7c3ab4c44890f79c2e8463f1646d3a1685c0b9d476031f: Status 404 returned error can't find the container with id f1234e9674ce66ed7a7c3ab4c44890f79c2e8463f1646d3a1685c0b9d476031f Jul 06 19:10:09.009452 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:09.009417 2559 generic.go:356] "Generic (PLEG): container finished" podID="deb03123-9c68-427b-80d1-c1a42dd27131" containerID="a5471e9849f7cb9382de807f72ae0ba2dc31d69e57e9a0c0b34d5305fd5c875b" exitCode=0 Jul 06 19:10:09.009879 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:09.009503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb03123-9c68-427b-80d1-c1a42dd27131","Type":"ContainerDied","Data":"a5471e9849f7cb9382de807f72ae0ba2dc31d69e57e9a0c0b34d5305fd5c875b"} Jul 06 19:10:09.009879 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:09.009599 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb03123-9c68-427b-80d1-c1a42dd27131","Type":"ContainerStarted","Data":"f1234e9674ce66ed7a7c3ab4c44890f79c2e8463f1646d3a1685c0b9d476031f"} Jul 06 19:10:09.053791 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:09.053766 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4843834c-0324-4982-af17-af9472805cff" path="/var/lib/kubelet/pods/4843834c-0324-4982-af17-af9472805cff/volumes" Jul 06 19:10:10.017814 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:10.017781 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb03123-9c68-427b-80d1-c1a42dd27131","Type":"ContainerStarted","Data":"1613caab1854581ec456db9761855b000242d3e3196f3086a4ecd851eb5cc751"} Jul 06 19:10:10.018206 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:10.017851 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb03123-9c68-427b-80d1-c1a42dd27131","Type":"ContainerStarted","Data":"5d55965617525428e2fe65750bf2495ce4d53b507ffb5a46450329417d2743ce"} Jul 06 19:10:10.018206 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:10.017877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb03123-9c68-427b-80d1-c1a42dd27131","Type":"ContainerStarted","Data":"759cdc20b8e1d376cfe2da17eb636cb7285233de83efe7cdec9420d1c6e7fa43"} Jul 06 19:10:10.018206 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:10.017903 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb03123-9c68-427b-80d1-c1a42dd27131","Type":"ContainerStarted","Data":"392d664803a0c665835ca829b8fe83b1c52a65f358716291493f6b677ccb01bc"} Jul 06 19:10:10.018206 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:10.017929 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb03123-9c68-427b-80d1-c1a42dd27131","Type":"ContainerStarted","Data":"32068584faa5c3016e62e1dcd870d63fcbbdd72e660851549bf08e8f065cfe6f"} Jul 06 19:10:10.018206 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:10.017954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"deb03123-9c68-427b-80d1-c1a42dd27131","Type":"ContainerStarted","Data":"7f2d7cc902a0b3e0bc03675073ead3cfd05b2c4963923137e779d481e306f37e"} Jul 06 19:10:10.057920 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:10.057871 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.038916635 podStartE2EDuration="2.057853524s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.936889ms" isStatefulPod=false podCreationTimestamp="2026-07-06 19:10:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:10:10.055786467 +0000 UTC m=+199.484541580" watchObservedRunningTime="2026-07-06 19:10:10.057853524 +0000 UTC m=+199.486608613" Jul 06 19:10:13.391126 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:10:13.391074 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:08.391233 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:11:08.391184 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:08.406434 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:11:08.406403 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:09.260369 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:11:09.260345 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 06 19:11:50.930004 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:11:50.929972 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:11:50.933806 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:11:50.933783 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:11:50.936349 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:11:50.936331 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 19:14:01.886150 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.886117 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-lwrj4"] Jul 06 19:14:01.888469 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.888447 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:01.890992 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.890966 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 06 19:14:01.891099 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.891015 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 19:14:01.891855 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.891834 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-crd5j\"" Jul 06 19:14:01.891954 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.891843 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 19:14:01.902324 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.902302 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-lwrj4"] Jul 06 19:14:01.923325 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.923286 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hkvc\" (UniqueName: \"kubernetes.io/projected/4a04e398-835e-4008-8efd-ad034673b323-kube-api-access-6hkvc\") pod \"odh-model-controller-84b54b7f97-lwrj4\" (UID: \"4a04e398-835e-4008-8efd-ad034673b323\") " pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:01.923462 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:01.923363 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a04e398-835e-4008-8efd-ad034673b323-cert\") pod \"odh-model-controller-84b54b7f97-lwrj4\" (UID: \"4a04e398-835e-4008-8efd-ad034673b323\") " pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:02.024609 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:02.024571 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a04e398-835e-4008-8efd-ad034673b323-cert\") pod \"odh-model-controller-84b54b7f97-lwrj4\" (UID: \"4a04e398-835e-4008-8efd-ad034673b323\") " pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:02.024780 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:02.024649 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hkvc\" (UniqueName: \"kubernetes.io/projected/4a04e398-835e-4008-8efd-ad034673b323-kube-api-access-6hkvc\") pod \"odh-model-controller-84b54b7f97-lwrj4\" (UID: \"4a04e398-835e-4008-8efd-ad034673b323\") " pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:02.024780 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:14:02.024724 2559 secret.go:189] Couldn't get secret kserve/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 06 19:14:02.024780 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:14:02.024780 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a04e398-835e-4008-8efd-ad034673b323-cert podName:4a04e398-835e-4008-8efd-ad034673b323 nodeName:}" failed. No retries permitted until 2026-07-06 19:14:02.524764668 +0000 UTC m=+431.953519739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4a04e398-835e-4008-8efd-ad034673b323-cert") pod "odh-model-controller-84b54b7f97-lwrj4" (UID: "4a04e398-835e-4008-8efd-ad034673b323") : secret "odh-model-controller-webhook-cert" not found Jul 06 19:14:02.040006 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:02.039978 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hkvc\" (UniqueName: \"kubernetes.io/projected/4a04e398-835e-4008-8efd-ad034673b323-kube-api-access-6hkvc\") pod \"odh-model-controller-84b54b7f97-lwrj4\" (UID: \"4a04e398-835e-4008-8efd-ad034673b323\") " pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:02.529345 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:02.529315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a04e398-835e-4008-8efd-ad034673b323-cert\") pod \"odh-model-controller-84b54b7f97-lwrj4\" (UID: \"4a04e398-835e-4008-8efd-ad034673b323\") " pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:02.531832 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:02.531805 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a04e398-835e-4008-8efd-ad034673b323-cert\") pod \"odh-model-controller-84b54b7f97-lwrj4\" (UID: \"4a04e398-835e-4008-8efd-ad034673b323\") " pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:02.798941 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:02.798856 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:02.923439 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:02.923406 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-lwrj4"] Jul 06 19:14:02.926192 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:14:02.926166 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a04e398_835e_4008_8efd_ad034673b323.slice/crio-9462760e339a9f9beabc213e4810be24d211b510e23b6d41d3a6b231814b3139 WatchSource:0}: Error finding container 9462760e339a9f9beabc213e4810be24d211b510e23b6d41d3a6b231814b3139: Status 404 returned error can't find the container with id 9462760e339a9f9beabc213e4810be24d211b510e23b6d41d3a6b231814b3139 Jul 06 19:14:02.927470 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:02.927450 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 19:14:03.903520 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:03.903483 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-lwrj4" event={"ID":"4a04e398-835e-4008-8efd-ad034673b323","Type":"ContainerStarted","Data":"9462760e339a9f9beabc213e4810be24d211b510e23b6d41d3a6b231814b3139"} Jul 06 19:14:06.916648 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:06.916609 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-lwrj4" event={"ID":"4a04e398-835e-4008-8efd-ad034673b323","Type":"ContainerStarted","Data":"74e003a8d2477d13c371b7dac734938e6c70f8401d9d93ed62f13c011c778bd1"} Jul 06 19:14:06.917126 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:06.916730 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:06.937448 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:06.937392 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-lwrj4" podStartSLOduration=2.395739074 podStartE2EDuration="5.9373771s" totalImagesPullingTime="3.541638026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:06.93625533 +0000 UTC m=+436.365010421" watchObservedRunningTime="2026-07-06 19:14:06.9373771 +0000 UTC m=+436.366132194" Jul 06 19:14:17.923137 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:17.923054 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-lwrj4" Jul 06 19:14:18.822873 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:18.822840 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-vkqgf"] Jul 06 19:14:18.829564 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:18.829519 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-vkqgf" Jul 06 19:14:18.832101 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:18.832078 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 06 19:14:18.832208 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:18.832180 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-qj9lc\"" Jul 06 19:14:18.835472 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:18.835424 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-vkqgf"] Jul 06 19:14:18.964034 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:18.964005 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-model-cache\") pod \"s3-init-vkqgf\" (UID: \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\") " pod="kserve/s3-init-vkqgf" Jul 06 19:14:18.964444 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:18.964041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqjxt\" (UniqueName: \"kubernetes.io/projected/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-kube-api-access-kqjxt\") pod \"s3-init-vkqgf\" (UID: \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\") " pod="kserve/s3-init-vkqgf" Jul 06 19:14:19.064712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:19.064681 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-model-cache\") pod \"s3-init-vkqgf\" (UID: \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\") " pod="kserve/s3-init-vkqgf" Jul 06 19:14:19.064712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:19.064711 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqjxt\" (UniqueName: \"kubernetes.io/projected/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-kube-api-access-kqjxt\") pod \"s3-init-vkqgf\" (UID: \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\") " pod="kserve/s3-init-vkqgf" Jul 06 19:14:19.065054 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:19.065032 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-model-cache\") pod \"s3-init-vkqgf\" (UID: \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\") " pod="kserve/s3-init-vkqgf" Jul 06 19:14:19.080573 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:19.080502 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqjxt\" (UniqueName: \"kubernetes.io/projected/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-kube-api-access-kqjxt\") pod \"s3-init-vkqgf\" (UID: \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\") " pod="kserve/s3-init-vkqgf" Jul 06 19:14:19.139379 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:19.139332 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-vkqgf" Jul 06 19:14:19.275639 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:19.275606 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-vkqgf"] Jul 06 19:14:19.278652 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:14:19.278630 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeb7369a_e1e4_41ec_8e80_3cb3b85ebc67.slice/crio-1e75892758f97258e819f0077b53829c8e27979aaec1e7066d7155f0438df8c0 WatchSource:0}: Error finding container 1e75892758f97258e819f0077b53829c8e27979aaec1e7066d7155f0438df8c0: Status 404 returned error can't find the container with id 1e75892758f97258e819f0077b53829c8e27979aaec1e7066d7155f0438df8c0 Jul 06 19:14:19.968062 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:19.968021 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vkqgf" event={"ID":"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67","Type":"ContainerStarted","Data":"1e75892758f97258e819f0077b53829c8e27979aaec1e7066d7155f0438df8c0"} Jul 06 19:14:24.992709 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:24.992674 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vkqgf" event={"ID":"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67","Type":"ContainerStarted","Data":"243b36e75e3e6d526a944703ef1b5c91baf552b88a65a29e45439d81be5b00bd"} Jul 06 19:14:25.998370 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:25.998335 2559 generic.go:356] "Generic (PLEG): container finished" podID="beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" containerID="243b36e75e3e6d526a944703ef1b5c91baf552b88a65a29e45439d81be5b00bd" exitCode=0 Jul 06 19:14:25.998370 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:25.998374 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vkqgf" event={"ID":"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67","Type":"ContainerDied","Data":"243b36e75e3e6d526a944703ef1b5c91baf552b88a65a29e45439d81be5b00bd"} Jul 06 19:14:33.029717 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:33.029669 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vkqgf" event={"ID":"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67","Type":"ContainerStarted","Data":"5d9f8494b5b048a7806a4cb06426d69843ac48d72cf5f5da486cd02f14ec9280"} Jul 06 19:14:33.047188 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:14:33.047128 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-vkqgf" podStartSLOduration=2.051035938 podStartE2EDuration="15.047111206s" totalImagesPullingTime="11.354582581s" totalInitContainerRuntime="1.641492687s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:14:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:14:33.046125214 +0000 UTC m=+462.474880305" watchObservedRunningTime="2026-07-06 19:14:33.047111206 +0000 UTC m=+462.475866295" Jul 06 19:15:38.272192 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:38.272159 2559 generic.go:356] "Generic (PLEG): container finished" podID="beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" containerID="5d9f8494b5b048a7806a4cb06426d69843ac48d72cf5f5da486cd02f14ec9280" exitCode=0 Jul 06 19:15:38.272614 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:38.272222 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vkqgf" event={"ID":"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67","Type":"ContainerDied","Data":"5d9f8494b5b048a7806a4cb06426d69843ac48d72cf5f5da486cd02f14ec9280"} Jul 06 19:15:39.402699 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:39.402676 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-vkqgf" Jul 06 19:15:39.529346 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:39.529264 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-model-cache\") pod \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\" (UID: \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\") " Jul 06 19:15:39.529346 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:39.529340 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kqjxt\" (UniqueName: \"kubernetes.io/projected/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-kube-api-access-kqjxt\") pod \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\" (UID: \"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67\") " Jul 06 19:15:39.531554 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:39.531517 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-kube-api-access-kqjxt" (OuterVolumeSpecName: "kube-api-access-kqjxt") pod "beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" (UID: "beb7369a-e1e4-41ec-8e80-3cb3b85ebc67"). InnerVolumeSpecName "kube-api-access-kqjxt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:15:39.547574 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:39.547509 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-model-cache" (OuterVolumeSpecName: "model-cache") pod "beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" (UID: "beb7369a-e1e4-41ec-8e80-3cb3b85ebc67"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:15:39.629969 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:39.629932 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-model-cache\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:15:39.629969 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:39.629965 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kqjxt\" (UniqueName: \"kubernetes.io/projected/beb7369a-e1e4-41ec-8e80-3cb3b85ebc67-kube-api-access-kqjxt\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:15:40.280896 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:40.280871 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-vkqgf" Jul 06 19:15:40.280896 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:40.280881 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-vkqgf" event={"ID":"beb7369a-e1e4-41ec-8e80-3cb3b85ebc67","Type":"ContainerDied","Data":"1e75892758f97258e819f0077b53829c8e27979aaec1e7066d7155f0438df8c0"} Jul 06 19:15:40.281099 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:40.280917 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e75892758f97258e819f0077b53829c8e27979aaec1e7066d7155f0438df8c0" Jul 06 19:15:51.778882 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.778801 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-6nz49"] Jul 06 19:15:51.779317 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.779106 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" containerName="s3-init" Jul 06 19:15:51.779317 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.779117 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" containerName="s3-init" Jul 06 19:15:51.779317 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.779130 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" containerName="download-hf-model" Jul 06 19:15:51.779317 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.779136 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" containerName="download-hf-model" Jul 06 19:15:51.779317 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.779201 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb7369a-e1e4-41ec-8e80-3cb3b85ebc67" containerName="s3-init" Jul 06 19:15:51.782174 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.782157 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:15:51.784444 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.784417 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 06 19:15:51.784759 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.784744 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-qj9lc\"" Jul 06 19:15:51.791819 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.791799 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-6nz49"] Jul 06 19:15:51.812922 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.812893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l5jx\" (UniqueName: \"kubernetes.io/projected/5d4aab80-0452-42a8-ace0-f898deb2ff5a-kube-api-access-5l5jx\") pod \"s3-tls-init-custom-6nz49\" (UID: \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\") " pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:15:51.813036 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.812936 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4aab80-0452-42a8-ace0-f898deb2ff5a-model-cache\") pod \"s3-tls-init-custom-6nz49\" (UID: \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\") " pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:15:51.913471 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.913438 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l5jx\" (UniqueName: \"kubernetes.io/projected/5d4aab80-0452-42a8-ace0-f898deb2ff5a-kube-api-access-5l5jx\") pod \"s3-tls-init-custom-6nz49\" (UID: \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\") " pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:15:51.913656 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.913494 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4aab80-0452-42a8-ace0-f898deb2ff5a-model-cache\") pod \"s3-tls-init-custom-6nz49\" (UID: \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\") " pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:15:51.913852 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.913836 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4aab80-0452-42a8-ace0-f898deb2ff5a-model-cache\") pod \"s3-tls-init-custom-6nz49\" (UID: \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\") " pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:15:51.924521 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:51.924497 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l5jx\" (UniqueName: \"kubernetes.io/projected/5d4aab80-0452-42a8-ace0-f898deb2ff5a-kube-api-access-5l5jx\") pod \"s3-tls-init-custom-6nz49\" (UID: \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\") " pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:15:52.091161 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:52.091076 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:15:52.221202 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:52.221180 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-6nz49"] Jul 06 19:15:52.224086 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:15:52.224053 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d4aab80_0452_42a8_ace0_f898deb2ff5a.slice/crio-0d5b49dfaa49aa2cb7d946963242b269d9fefd7666f493a73be50d26aab2b7b5 WatchSource:0}: Error finding container 0d5b49dfaa49aa2cb7d946963242b269d9fefd7666f493a73be50d26aab2b7b5: Status 404 returned error can't find the container with id 0d5b49dfaa49aa2cb7d946963242b269d9fefd7666f493a73be50d26aab2b7b5 Jul 06 19:15:52.328609 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:52.328576 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-6nz49" event={"ID":"5d4aab80-0452-42a8-ace0-f898deb2ff5a","Type":"ContainerStarted","Data":"64bb242322d70b471304668b14287da0130c0caa6405f371c8b087fcf45096f0"} Jul 06 19:15:52.328763 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:52.328618 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-6nz49" event={"ID":"5d4aab80-0452-42a8-ace0-f898deb2ff5a","Type":"ContainerStarted","Data":"0d5b49dfaa49aa2cb7d946963242b269d9fefd7666f493a73be50d26aab2b7b5"} Jul 06 19:15:54.339333 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:54.339247 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d4aab80-0452-42a8-ace0-f898deb2ff5a" containerID="64bb242322d70b471304668b14287da0130c0caa6405f371c8b087fcf45096f0" exitCode=0 Jul 06 19:15:54.339333 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:54.339318 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-6nz49" event={"ID":"5d4aab80-0452-42a8-ace0-f898deb2ff5a","Type":"ContainerDied","Data":"64bb242322d70b471304668b14287da0130c0caa6405f371c8b087fcf45096f0"} Jul 06 19:15:55.345862 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:55.345826 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-6nz49" event={"ID":"5d4aab80-0452-42a8-ace0-f898deb2ff5a","Type":"ContainerStarted","Data":"d1ef34674cda7a9662f8201b5ca7660227f1cf8e81660f543ed5f5ba4c432e23"} Jul 06 19:15:55.366869 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:15:55.366824 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-custom-6nz49" podStartSLOduration=2.73249451 podStartE2EDuration="4.366810424s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.634315914s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:15:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:15:55.36572952 +0000 UTC m=+544.794484611" watchObservedRunningTime="2026-07-06 19:15:55.366810424 +0000 UTC m=+544.795565554" Jul 06 19:16:01.371713 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:01.371680 2559 generic.go:356] "Generic (PLEG): container finished" podID="5d4aab80-0452-42a8-ace0-f898deb2ff5a" containerID="d1ef34674cda7a9662f8201b5ca7660227f1cf8e81660f543ed5f5ba4c432e23" exitCode=0 Jul 06 19:16:01.372096 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:01.371752 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-6nz49" event={"ID":"5d4aab80-0452-42a8-ace0-f898deb2ff5a","Type":"ContainerDied","Data":"d1ef34674cda7a9662f8201b5ca7660227f1cf8e81660f543ed5f5ba4c432e23"} Jul 06 19:16:02.534115 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:02.534091 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:16:02.607956 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:02.607928 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l5jx\" (UniqueName: \"kubernetes.io/projected/5d4aab80-0452-42a8-ace0-f898deb2ff5a-kube-api-access-5l5jx\") pod \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\" (UID: \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\") " Jul 06 19:16:02.608133 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:02.607990 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4aab80-0452-42a8-ace0-f898deb2ff5a-model-cache\") pod \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\" (UID: \"5d4aab80-0452-42a8-ace0-f898deb2ff5a\") " Jul 06 19:16:02.609931 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:02.609898 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4aab80-0452-42a8-ace0-f898deb2ff5a-kube-api-access-5l5jx" (OuterVolumeSpecName: "kube-api-access-5l5jx") pod "5d4aab80-0452-42a8-ace0-f898deb2ff5a" (UID: "5d4aab80-0452-42a8-ace0-f898deb2ff5a"). InnerVolumeSpecName "kube-api-access-5l5jx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:16:02.632788 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:02.632725 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d4aab80-0452-42a8-ace0-f898deb2ff5a-model-cache" (OuterVolumeSpecName: "model-cache") pod "5d4aab80-0452-42a8-ace0-f898deb2ff5a" (UID: "5d4aab80-0452-42a8-ace0-f898deb2ff5a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:16:02.709116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:02.709086 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5d4aab80-0452-42a8-ace0-f898deb2ff5a-model-cache\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:16:02.709116 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:02.709113 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l5jx\" (UniqueName: \"kubernetes.io/projected/5d4aab80-0452-42a8-ace0-f898deb2ff5a-kube-api-access-5l5jx\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:16:03.380724 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:03.380693 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-6nz49" event={"ID":"5d4aab80-0452-42a8-ace0-f898deb2ff5a","Type":"ContainerDied","Data":"0d5b49dfaa49aa2cb7d946963242b269d9fefd7666f493a73be50d26aab2b7b5"} Jul 06 19:16:03.380724 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:03.380715 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-6nz49" Jul 06 19:16:03.380724 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:03.380730 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d5b49dfaa49aa2cb7d946963242b269d9fefd7666f493a73be50d26aab2b7b5" Jul 06 19:16:05.872157 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.872119 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-bnbng"] Jul 06 19:16:05.872568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.872445 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4aab80-0452-42a8-ace0-f898deb2ff5a" containerName="download-hf-model" Jul 06 19:16:05.872568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.872456 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4aab80-0452-42a8-ace0-f898deb2ff5a" containerName="download-hf-model" Jul 06 19:16:05.872568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.872472 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4aab80-0452-42a8-ace0-f898deb2ff5a" containerName="s3-tls-init-custom" Jul 06 19:16:05.872568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.872479 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4aab80-0452-42a8-ace0-f898deb2ff5a" containerName="s3-tls-init-custom" Jul 06 19:16:05.872568 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.872544 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4aab80-0452-42a8-ace0-f898deb2ff5a" containerName="s3-tls-init-custom" Jul 06 19:16:05.875767 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.875750 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:05.877941 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.877918 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 06 19:16:05.877941 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.877935 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-qj9lc\"" Jul 06 19:16:05.886838 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.886816 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-bnbng"] Jul 06 19:16:05.936453 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.936418 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv4q4\" (UniqueName: \"kubernetes.io/projected/fc64e4be-9aae-4275-be21-43be4b52b94a-kube-api-access-hv4q4\") pod \"s3-tls-init-serving-bnbng\" (UID: \"fc64e4be-9aae-4275-be21-43be4b52b94a\") " pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:05.936453 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:05.936459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc64e4be-9aae-4275-be21-43be4b52b94a-model-cache\") pod \"s3-tls-init-serving-bnbng\" (UID: \"fc64e4be-9aae-4275-be21-43be4b52b94a\") " pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:06.036848 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:06.036809 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv4q4\" (UniqueName: \"kubernetes.io/projected/fc64e4be-9aae-4275-be21-43be4b52b94a-kube-api-access-hv4q4\") pod \"s3-tls-init-serving-bnbng\" (UID: \"fc64e4be-9aae-4275-be21-43be4b52b94a\") " pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:06.037034 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:06.036858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc64e4be-9aae-4275-be21-43be4b52b94a-model-cache\") pod \"s3-tls-init-serving-bnbng\" (UID: \"fc64e4be-9aae-4275-be21-43be4b52b94a\") " pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:06.037277 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:06.037255 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc64e4be-9aae-4275-be21-43be4b52b94a-model-cache\") pod \"s3-tls-init-serving-bnbng\" (UID: \"fc64e4be-9aae-4275-be21-43be4b52b94a\") " pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:06.048442 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:06.048418 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv4q4\" (UniqueName: \"kubernetes.io/projected/fc64e4be-9aae-4275-be21-43be4b52b94a-kube-api-access-hv4q4\") pod \"s3-tls-init-serving-bnbng\" (UID: \"fc64e4be-9aae-4275-be21-43be4b52b94a\") " pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:06.184317 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:06.184231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:06.317984 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:06.317952 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-bnbng"] Jul 06 19:16:06.321078 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:16:06.321056 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc64e4be_9aae_4275_be21_43be4b52b94a.slice/crio-203f3ff178302147379d1640d10cba19fb5f5ed2c7c0a555f46a642aff342c85 WatchSource:0}: Error finding container 203f3ff178302147379d1640d10cba19fb5f5ed2c7c0a555f46a642aff342c85: Status 404 returned error can't find the container with id 203f3ff178302147379d1640d10cba19fb5f5ed2c7c0a555f46a642aff342c85 Jul 06 19:16:06.394617 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:06.394583 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-bnbng" event={"ID":"fc64e4be-9aae-4275-be21-43be4b52b94a","Type":"ContainerStarted","Data":"b8a12e186a02f5d1a86ba44546cc045f64eaeaa7ec3dc648d6de1e2f728cfbeb"} Jul 06 19:16:06.394735 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:06.394624 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-bnbng" event={"ID":"fc64e4be-9aae-4275-be21-43be4b52b94a","Type":"ContainerStarted","Data":"203f3ff178302147379d1640d10cba19fb5f5ed2c7c0a555f46a642aff342c85"} Jul 06 19:16:09.407793 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:09.407759 2559 generic.go:356] "Generic (PLEG): container finished" podID="fc64e4be-9aae-4275-be21-43be4b52b94a" containerID="b8a12e186a02f5d1a86ba44546cc045f64eaeaa7ec3dc648d6de1e2f728cfbeb" exitCode=0 Jul 06 19:16:09.408265 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:09.407831 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-bnbng" event={"ID":"fc64e4be-9aae-4275-be21-43be4b52b94a","Type":"ContainerDied","Data":"b8a12e186a02f5d1a86ba44546cc045f64eaeaa7ec3dc648d6de1e2f728cfbeb"} Jul 06 19:16:10.412907 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:10.412876 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-bnbng" event={"ID":"fc64e4be-9aae-4275-be21-43be4b52b94a","Type":"ContainerStarted","Data":"fe2b34e82a7a95cf7d281362528c8accbdbe987863009d1419f02b6b80ab10fe"} Jul 06 19:16:10.434197 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:10.434144 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-bnbng" podStartSLOduration=3.1737100050000002 podStartE2EDuration="5.434128373s" totalImagesPullingTime="0s" totalInitContainerRuntime="2.260418368s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:16:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:16:10.432698002 +0000 UTC m=+559.861453094" watchObservedRunningTime="2026-07-06 19:16:10.434128373 +0000 UTC m=+559.862883463" Jul 06 19:16:16.440179 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:16.440142 2559 generic.go:356] "Generic (PLEG): container finished" podID="fc64e4be-9aae-4275-be21-43be4b52b94a" containerID="fe2b34e82a7a95cf7d281362528c8accbdbe987863009d1419f02b6b80ab10fe" exitCode=0 Jul 06 19:16:16.440579 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:16.440197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-bnbng" event={"ID":"fc64e4be-9aae-4275-be21-43be4b52b94a","Type":"ContainerDied","Data":"fe2b34e82a7a95cf7d281362528c8accbdbe987863009d1419f02b6b80ab10fe"} Jul 06 19:16:17.584455 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:17.584434 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:17.740756 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:17.740671 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv4q4\" (UniqueName: \"kubernetes.io/projected/fc64e4be-9aae-4275-be21-43be4b52b94a-kube-api-access-hv4q4\") pod \"fc64e4be-9aae-4275-be21-43be4b52b94a\" (UID: \"fc64e4be-9aae-4275-be21-43be4b52b94a\") " Jul 06 19:16:17.740913 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:17.740760 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc64e4be-9aae-4275-be21-43be4b52b94a-model-cache\") pod \"fc64e4be-9aae-4275-be21-43be4b52b94a\" (UID: \"fc64e4be-9aae-4275-be21-43be4b52b94a\") " Jul 06 19:16:17.742783 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:17.742758 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc64e4be-9aae-4275-be21-43be4b52b94a-kube-api-access-hv4q4" (OuterVolumeSpecName: "kube-api-access-hv4q4") pod "fc64e4be-9aae-4275-be21-43be4b52b94a" (UID: "fc64e4be-9aae-4275-be21-43be4b52b94a"). InnerVolumeSpecName "kube-api-access-hv4q4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:16:17.764563 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:17.764520 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc64e4be-9aae-4275-be21-43be4b52b94a-model-cache" (OuterVolumeSpecName: "model-cache") pod "fc64e4be-9aae-4275-be21-43be4b52b94a" (UID: "fc64e4be-9aae-4275-be21-43be4b52b94a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:16:17.842003 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:17.841962 2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fc64e4be-9aae-4275-be21-43be4b52b94a-model-cache\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:16:17.842003 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:17.841996 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv4q4\" (UniqueName: \"kubernetes.io/projected/fc64e4be-9aae-4275-be21-43be4b52b94a-kube-api-access-hv4q4\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:16:18.449955 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:18.449930 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-bnbng" Jul 06 19:16:18.449955 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:18.449939 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-bnbng" event={"ID":"fc64e4be-9aae-4275-be21-43be4b52b94a","Type":"ContainerDied","Data":"203f3ff178302147379d1640d10cba19fb5f5ed2c7c0a555f46a642aff342c85"} Jul 06 19:16:18.450153 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:18.449971 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="203f3ff178302147379d1640d10cba19fb5f5ed2c7c0a555f46a642aff342c85" Jul 06 19:16:31.817056 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.817015 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wbf2t/must-gather-6l9lk"] Jul 06 19:16:31.817450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.817312 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc64e4be-9aae-4275-be21-43be4b52b94a" containerName="s3-tls-init-serving" Jul 06 19:16:31.817450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.817323 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc64e4be-9aae-4275-be21-43be4b52b94a" containerName="s3-tls-init-serving" Jul 06 19:16:31.817450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.817332 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc64e4be-9aae-4275-be21-43be4b52b94a" containerName="download-hf-model" Jul 06 19:16:31.817450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.817337 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc64e4be-9aae-4275-be21-43be4b52b94a" containerName="download-hf-model" Jul 06 19:16:31.817450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.817395 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc64e4be-9aae-4275-be21-43be4b52b94a" containerName="s3-tls-init-serving" Jul 06 19:16:31.820431 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.820408 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:16:31.822981 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.822954 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wbf2t\"/\"default-dockercfg-tksqs\"" Jul 06 19:16:31.823102 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.823009 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wbf2t\"/\"openshift-service-ca.crt\"" Jul 06 19:16:31.823102 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.823031 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wbf2t\"/\"kube-root-ca.crt\"" Jul 06 19:16:31.829841 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.829817 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbf2t/must-gather-6l9lk"] Jul 06 19:16:31.964731 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.964691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w25bd\" (UniqueName: \"kubernetes.io/projected/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-kube-api-access-w25bd\") pod \"must-gather-6l9lk\" (UID: \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\") " pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:16:31.964731 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:31.964730 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-must-gather-output\") pod \"must-gather-6l9lk\" (UID: \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\") " pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:16:32.065922 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:32.065885 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w25bd\" (UniqueName: \"kubernetes.io/projected/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-kube-api-access-w25bd\") pod \"must-gather-6l9lk\" (UID: \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\") " pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:16:32.065922 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:32.065919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-must-gather-output\") pod \"must-gather-6l9lk\" (UID: \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\") " pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:16:32.066236 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:32.066221 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-must-gather-output\") pod \"must-gather-6l9lk\" (UID: \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\") " pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:16:32.077836 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:32.077769 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w25bd\" (UniqueName: \"kubernetes.io/projected/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-kube-api-access-w25bd\") pod \"must-gather-6l9lk\" (UID: \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\") " pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:16:32.129666 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:32.129639 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:16:32.263803 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:32.263770 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wbf2t/must-gather-6l9lk"] Jul 06 19:16:32.266777 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:16:32.266736 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40f7f418_1b8a_4cb6_977c_dc5b7c831e65.slice/crio-a0a2ce8635ee3cfe495e6014a78367197a0d49edf7810050f0ed1b42d4461d17 WatchSource:0}: Error finding container a0a2ce8635ee3cfe495e6014a78367197a0d49edf7810050f0ed1b42d4461d17: Status 404 returned error can't find the container with id a0a2ce8635ee3cfe495e6014a78367197a0d49edf7810050f0ed1b42d4461d17 Jul 06 19:16:32.514399 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:32.514362 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" event={"ID":"40f7f418-1b8a-4cb6-977c-dc5b7c831e65","Type":"ContainerStarted","Data":"a0a2ce8635ee3cfe495e6014a78367197a0d49edf7810050f0ed1b42d4461d17"} Jul 06 19:16:39.553307 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:39.553274 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" event={"ID":"40f7f418-1b8a-4cb6-977c-dc5b7c831e65","Type":"ContainerStarted","Data":"97f455cfb566f00c5dad3d3eb1898e0ca7606810422bc56945d29caa0a0ec8ce"} Jul 06 19:16:39.553823 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:39.553315 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" event={"ID":"40f7f418-1b8a-4cb6-977c-dc5b7c831e65","Type":"ContainerStarted","Data":"d99f4c27969755a37e983769ec090142c264b5a7bd2969c306651df80424ed54"} Jul 06 19:16:50.970321 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:50.970290 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:16:50.970819 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:50.970328 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:16:59.643410 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:59.643376 2559 generic.go:356] "Generic (PLEG): container finished" podID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerID="d99f4c27969755a37e983769ec090142c264b5a7bd2969c306651df80424ed54" exitCode=0 Jul 06 19:16:59.643841 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:59.643449 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" event={"ID":"40f7f418-1b8a-4cb6-977c-dc5b7c831e65","Type":"ContainerDied","Data":"d99f4c27969755a37e983769ec090142c264b5a7bd2969c306651df80424ed54"} Jul 06 19:16:59.643841 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:16:59.643751 2559 scope.go:117] "RemoveContainer" containerID="d99f4c27969755a37e983769ec090142c264b5a7bd2969c306651df80424ed54" Jul 06 19:17:00.175006 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.174964 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wbf2t_must-gather-6l9lk_40f7f418-1b8a-4cb6-977c-dc5b7c831e65/gather/0.log" Jul 06 19:17:00.755738 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.755708 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fsbbr/must-gather-wf6kt"] Jul 06 19:17:00.758301 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.758285 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fsbbr/must-gather-wf6kt" Jul 06 19:17:00.785748 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.785718 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fsbbr\"/\"kube-root-ca.crt\"" Jul 06 19:17:00.785847 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.785734 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fsbbr\"/\"default-dockercfg-n88sc\"" Jul 06 19:17:00.790054 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.790035 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fsbbr\"/\"openshift-service-ca.crt\"" Jul 06 19:17:00.805147 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.805123 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fsbbr/must-gather-wf6kt"] Jul 06 19:17:00.830712 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.830686 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a-must-gather-output\") pod \"must-gather-wf6kt\" (UID: \"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a\") " pod="openshift-must-gather-fsbbr/must-gather-wf6kt" Jul 06 19:17:00.830826 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.830731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnc6j\" (UniqueName: \"kubernetes.io/projected/6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a-kube-api-access-wnc6j\") pod \"must-gather-wf6kt\" (UID: \"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a\") " pod="openshift-must-gather-fsbbr/must-gather-wf6kt" Jul 06 19:17:00.931636 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.931601 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a-must-gather-output\") pod \"must-gather-wf6kt\" (UID: \"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a\") " pod="openshift-must-gather-fsbbr/must-gather-wf6kt" Jul 06 19:17:00.931778 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.931649 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnc6j\" (UniqueName: \"kubernetes.io/projected/6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a-kube-api-access-wnc6j\") pod \"must-gather-wf6kt\" (UID: \"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a\") " pod="openshift-must-gather-fsbbr/must-gather-wf6kt" Jul 06 19:17:00.931945 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.931926 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a-must-gather-output\") pod \"must-gather-wf6kt\" (UID: \"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a\") " pod="openshift-must-gather-fsbbr/must-gather-wf6kt" Jul 06 19:17:00.945880 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:00.945859 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnc6j\" (UniqueName: \"kubernetes.io/projected/6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a-kube-api-access-wnc6j\") pod \"must-gather-wf6kt\" (UID: \"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a\") " pod="openshift-must-gather-fsbbr/must-gather-wf6kt" Jul 06 19:17:01.067073 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:01.066982 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fsbbr/must-gather-wf6kt" Jul 06 19:17:01.205693 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:01.205669 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fsbbr/must-gather-wf6kt"] Jul 06 19:17:01.208209 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:17:01.208181 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a56b2bf_3c4e_4825_b8ed_e0dfbc90ff6a.slice/crio-f35fafc44dc0bbfd92fb83b2b2812e44cb6a77738b0c113469857ba2042ffeb3 WatchSource:0}: Error finding container f35fafc44dc0bbfd92fb83b2b2812e44cb6a77738b0c113469857ba2042ffeb3: Status 404 returned error can't find the container with id f35fafc44dc0bbfd92fb83b2b2812e44cb6a77738b0c113469857ba2042ffeb3 Jul 06 19:17:01.659027 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:01.658993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fsbbr/must-gather-wf6kt" event={"ID":"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a","Type":"ContainerStarted","Data":"f35fafc44dc0bbfd92fb83b2b2812e44cb6a77738b0c113469857ba2042ffeb3"} Jul 06 19:17:02.667219 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:02.667169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fsbbr/must-gather-wf6kt" event={"ID":"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a","Type":"ContainerStarted","Data":"2a1353d850da80c6605d83165c14f8d8ab9c02b71fd7399e10713b6551399f86"} Jul 06 19:17:02.667718 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:02.667239 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fsbbr/must-gather-wf6kt" event={"ID":"6a56b2bf-3c4e-4825-b8ed-e0dfbc90ff6a","Type":"ContainerStarted","Data":"8f86b7820177d0a5a9da7b0db815522adf23e5ff95e261f807c624d7af906533"} Jul 06 19:17:02.689981 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:02.689918 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fsbbr/must-gather-wf6kt" podStartSLOduration=1.9311906410000002 podStartE2EDuration="2.68989439s" totalImagesPullingTime="758.703749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 19:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:02.688842203 +0000 UTC m=+612.117597294" watchObservedRunningTime="2026-07-06 19:17:02.68989439 +0000 UTC m=+612.118649473" Jul 06 19:17:03.658444 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:03.658414 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v6rr5_77e12c0d-3c8f-451c-a52f-e9d5fc2c16ae/global-pull-secret-syncer/0.log" Jul 06 19:17:03.780490 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:03.780462 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vxk4f_b1c4173c-c47b-43ac-88b3-3df615495517/konnectivity-agent/0.log" Jul 06 19:17:03.931381 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:03.931301 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-163.ec2.internal_2b8c2ecc0c280c7d443a14ca82ee9438/haproxy/0.log" Jul 06 19:17:05.533639 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:05.533568 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-wbf2t/must-gather-6l9lk"] Jul 06 19:17:05.534399 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:05.533892 2559 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerName="copy" containerID="cri-o://97f455cfb566f00c5dad3d3eb1898e0ca7606810422bc56945d29caa0a0ec8ce" gracePeriod=2 Jul 06 19:17:05.544151 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:05.544121 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-wbf2t/must-gather-6l9lk"] Jul 06 19:17:05.559547 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:17:05.557794 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-wbf2t\"/\"must-gather-6l9lk\": pods \"must-gather-6l9lk\" not found" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:17:05.694547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:05.688998 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wbf2t_must-gather-6l9lk_40f7f418-1b8a-4cb6-977c-dc5b7c831e65/copy/0.log" Jul 06 19:17:05.694547 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:05.689387 2559 generic.go:356] "Generic (PLEG): container finished" podID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerID="97f455cfb566f00c5dad3d3eb1898e0ca7606810422bc56945d29caa0a0ec8ce" exitCode=143 Jul 06 19:17:05.923061 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:05.922317 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wbf2t_must-gather-6l9lk_40f7f418-1b8a-4cb6-977c-dc5b7c831e65/copy/0.log" Jul 06 19:17:05.928548 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:05.928121 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:17:05.936160 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:17:05.933768 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6l9lk\" is forbidden: User \"system:node:ip-10-0-133-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wbf2t\": no relationship found between node 'ip-10-0-133-163.ec2.internal' and this object" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:17:06.093218 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.093177 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-must-gather-output\") pod \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\" (UID: \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\") " Jul 06 19:17:06.093409 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.093231 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w25bd\" (UniqueName: \"kubernetes.io/projected/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-kube-api-access-w25bd\") pod \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\" (UID: \"40f7f418-1b8a-4cb6-977c-dc5b7c831e65\") " Jul 06 19:17:06.094873 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.094834 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "40f7f418-1b8a-4cb6-977c-dc5b7c831e65" (UID: "40f7f418-1b8a-4cb6-977c-dc5b7c831e65"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 19:17:06.096706 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.096277 2559 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-kube-api-access-w25bd" (OuterVolumeSpecName: "kube-api-access-w25bd") pod "40f7f418-1b8a-4cb6-977c-dc5b7c831e65" (UID: "40f7f418-1b8a-4cb6-977c-dc5b7c831e65"). InnerVolumeSpecName "kube-api-access-w25bd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 19:17:06.195067 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.194936 2559 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-must-gather-output\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:17:06.195067 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.194969 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w25bd\" (UniqueName: \"kubernetes.io/projected/40f7f418-1b8a-4cb6-977c-dc5b7c831e65-kube-api-access-w25bd\") on node \"ip-10-0-133-163.ec2.internal\" DevicePath \"\"" Jul 06 19:17:06.698819 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.698746 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wbf2t_must-gather-6l9lk_40f7f418-1b8a-4cb6-977c-dc5b7c831e65/copy/0.log" Jul 06 19:17:06.700555 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.700372 2559 scope.go:117] "RemoveContainer" containerID="97f455cfb566f00c5dad3d3eb1898e0ca7606810422bc56945d29caa0a0ec8ce" Jul 06 19:17:06.703552 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.700726 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:17:06.718740 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:17:06.718207 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6l9lk\" is forbidden: User \"system:node:ip-10-0-133-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wbf2t\": no relationship found between node 'ip-10-0-133-163.ec2.internal' and this object" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:17:06.722199 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:06.722104 2559 scope.go:117] "RemoveContainer" containerID="d99f4c27969755a37e983769ec090142c264b5a7bd2969c306651df80424ed54" Jul 06 19:17:06.753753 ip-10-0-133-163 kubenswrapper[2559]: E0706 19:17:06.753704 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-6l9lk\" is forbidden: User \"system:node:ip-10-0-133-163.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wbf2t\": no relationship found between node 'ip-10-0-133-163.ec2.internal' and this object" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" pod="openshift-must-gather-wbf2t/must-gather-6l9lk" Jul 06 19:17:07.056543 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:07.056489 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" path="/var/lib/kubelet/pods/40f7f418-1b8a-4cb6-977c-dc5b7c831e65/volumes" Jul 06 19:17:07.724833 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:07.724792 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_710160dd-5dc7-402e-bb64-414b9ba07ff1/alertmanager/0.log" Jul 06 19:17:07.756997 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:07.756961 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_710160dd-5dc7-402e-bb64-414b9ba07ff1/config-reloader/0.log" Jul 06 19:17:07.797601 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:07.797577 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_710160dd-5dc7-402e-bb64-414b9ba07ff1/kube-rbac-proxy-web/0.log" Jul 06 19:17:07.832194 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:07.832168 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_710160dd-5dc7-402e-bb64-414b9ba07ff1/kube-rbac-proxy/0.log" Jul 06 19:17:07.865476 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:07.865444 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_710160dd-5dc7-402e-bb64-414b9ba07ff1/kube-rbac-proxy-metric/0.log" Jul 06 19:17:07.895806 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:07.895773 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_710160dd-5dc7-402e-bb64-414b9ba07ff1/prom-label-proxy/0.log" Jul 06 19:17:07.943237 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:07.943209 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_710160dd-5dc7-402e-bb64-414b9ba07ff1/init-config-reloader/0.log" Jul 06 19:17:08.056013 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.055909 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z4nnp_62edf2c2-e23c-4fdb-afd2-19b9ccd04b73/kube-state-metrics/0.log" Jul 06 19:17:08.090704 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.090666 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z4nnp_62edf2c2-e23c-4fdb-afd2-19b9ccd04b73/kube-rbac-proxy-main/0.log" Jul 06 19:17:08.130106 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.130074 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z4nnp_62edf2c2-e23c-4fdb-afd2-19b9ccd04b73/kube-rbac-proxy-self/0.log" Jul 06 19:17:08.190381 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.190354 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b5cbcb456-tckx2_f6700403-6ed1-4cf1-b260-e6384ee3d9cc/metrics-server/0.log" Jul 06 19:17:08.294211 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.294176 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z92x_6279987f-d922-47d0-b537-bb89db633b84/node-exporter/0.log" Jul 06 19:17:08.335801 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.335725 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z92x_6279987f-d922-47d0-b537-bb89db633b84/kube-rbac-proxy/0.log" Jul 06 19:17:08.371978 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.371942 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8z92x_6279987f-d922-47d0-b537-bb89db633b84/init-textfile/0.log" Jul 06 19:17:08.875416 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.875382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb03123-9c68-427b-80d1-c1a42dd27131/prometheus/0.log" Jul 06 19:17:08.906363 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.906328 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb03123-9c68-427b-80d1-c1a42dd27131/config-reloader/0.log" Jul 06 19:17:08.936745 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.936717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb03123-9c68-427b-80d1-c1a42dd27131/thanos-sidecar/0.log" Jul 06 19:17:08.976855 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:08.976816 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb03123-9c68-427b-80d1-c1a42dd27131/kube-rbac-proxy-web/0.log" Jul 06 19:17:09.032284 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:09.032254 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb03123-9c68-427b-80d1-c1a42dd27131/kube-rbac-proxy/0.log" Jul 06 19:17:09.062902 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:09.062818 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb03123-9c68-427b-80d1-c1a42dd27131/kube-rbac-proxy-thanos/0.log" Jul 06 19:17:09.094146 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:09.094116 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_deb03123-9c68-427b-80d1-c1a42dd27131/init-config-reloader/0.log" Jul 06 19:17:09.232495 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:09.232453 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-fnjcl_406157e3-78f6-40ed-b2b0-942b294ecf7f/prometheus-operator-admission-webhook/0.log" Jul 06 19:17:11.627284 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.627239 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj"] Jul 06 19:17:11.627890 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.627720 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerName="gather" Jul 06 19:17:11.627890 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.627738 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerName="gather" Jul 06 19:17:11.627890 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.627749 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerName="copy" Jul 06 19:17:11.627890 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.627757 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerName="copy" Jul 06 19:17:11.627890 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.627854 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerName="gather" Jul 06 19:17:11.627890 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.627868 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="40f7f418-1b8a-4cb6-977c-dc5b7c831e65" containerName="copy" Jul 06 19:17:11.633111 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.633089 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.643941 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.643918 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj"] Jul 06 19:17:11.748432 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.748398 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-podres\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.748630 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.748453 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-sys\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.748630 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.748473 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-proc\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.748630 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.748541 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-lib-modules\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.748630 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.748620 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnzv2\" (UniqueName: \"kubernetes.io/projected/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-kube-api-access-bnzv2\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.849716 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.849674 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnzv2\" (UniqueName: \"kubernetes.io/projected/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-kube-api-access-bnzv2\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.850018 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.849995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-podres\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.850356 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.850340 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-sys\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.850502 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.850485 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-proc\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.850643 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.850627 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-lib-modules\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.850715 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.850433 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-sys\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.850715 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.850253 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-podres\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.850715 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.850576 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-proc\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.850817 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.850778 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-lib-modules\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.859675 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.859652 2559 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnzv2\" (UniqueName: \"kubernetes.io/projected/2799ebda-bbff-4b61-af9b-ca8e3a3cc10d-kube-api-access-bnzv2\") pod \"perf-node-gather-daemonset-s8wbj\" (UID: \"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d\") " pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.943661 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.943572 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:11.959287 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:11.959246 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-b5rgq_4616f553-cc08-46ab-bef1-0a5c60d0180c/download-server/0.log" Jul 06 19:17:12.119903 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:12.119879 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj"] Jul 06 19:17:12.122422 ip-10-0-133-163 kubenswrapper[2559]: W0706 19:17:12.122394 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2799ebda_bbff_4b61_af9b_ca8e3a3cc10d.slice/crio-12c6feb57a7da3026efd9a31ad1f8c6246538dbab00d8b7fcc0f355ebbf8f830 WatchSource:0}: Error finding container 12c6feb57a7da3026efd9a31ad1f8c6246538dbab00d8b7fcc0f355ebbf8f830: Status 404 returned error can't find the container with id 12c6feb57a7da3026efd9a31ad1f8c6246538dbab00d8b7fcc0f355ebbf8f830 Jul 06 19:17:12.735448 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:12.735410 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" event={"ID":"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d","Type":"ContainerStarted","Data":"bf96f4e258857cfa55fc9dcf47eeda5ac2fe4e1debcb32c479b2984af71e3967"} Jul 06 19:17:12.735930 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:12.735472 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" event={"ID":"2799ebda-bbff-4b61-af9b-ca8e3a3cc10d","Type":"ContainerStarted","Data":"12c6feb57a7da3026efd9a31ad1f8c6246538dbab00d8b7fcc0f355ebbf8f830"} Jul 06 19:17:12.735930 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:12.735503 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:12.758226 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:12.758163 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" podStartSLOduration=1.758142185 podStartE2EDuration="1.758142185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 19:17:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 19:17:12.756972335 +0000 UTC m=+622.185727425" watchObservedRunningTime="2026-07-06 19:17:12.758142185 +0000 UTC m=+622.186897280" Jul 06 19:17:13.634500 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:13.634411 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b2ffv_f5a778b2-3edb-4fb2-a305-b847e04a3b8c/dns/0.log" Jul 06 19:17:13.658450 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:13.658418 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-b2ffv_f5a778b2-3edb-4fb2-a305-b847e04a3b8c/kube-rbac-proxy/0.log" Jul 06 19:17:13.794934 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:13.794890 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hzcts_cd460de7-89f7-4c87-ae92-8e9d778c342d/dns-node-resolver/0.log" Jul 06 19:17:14.428536 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:14.428502 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w4fv5_52923da4-c1f8-4898-88d7-e29b5a1a0233/node-ca/0.log" Jul 06 19:17:15.720231 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:15.720200 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7p69l_fbfedbd0-94f2-496b-a82a-e1e90fe0cea0/serve-healthcheck-canary/0.log" Jul 06 19:17:16.247417 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:16.247382 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpdvc_1df8adcf-496c-47dc-a699-0b8e5dd1bd67/kube-rbac-proxy/0.log" Jul 06 19:17:16.272865 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:16.272841 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpdvc_1df8adcf-496c-47dc-a699-0b8e5dd1bd67/exporter/0.log" Jul 06 19:17:16.299191 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:16.299166 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rpdvc_1df8adcf-496c-47dc-a699-0b8e5dd1bd67/extractor/0.log" Jul 06 19:17:18.662704 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:18.662675 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-lwrj4_4a04e398-835e-4008-8efd-ad034673b323/manager/0.log" Jul 06 19:17:18.708123 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:18.708091 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-vkqgf_beb7369a-e1e4-41ec-8e80-3cb3b85ebc67/s3-init/0.log" Jul 06 19:17:18.727254 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:18.727229 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-vkqgf_beb7369a-e1e4-41ec-8e80-3cb3b85ebc67/download-hf-model/0.log" Jul 06 19:17:18.750953 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:18.750924 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fsbbr/perf-node-gather-daemonset-s8wbj" Jul 06 19:17:18.764256 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:18.764232 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-6nz49_5d4aab80-0452-42a8-ace0-f898deb2ff5a/s3-tls-init-custom/0.log" Jul 06 19:17:18.786314 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:18.786289 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-6nz49_5d4aab80-0452-42a8-ace0-f898deb2ff5a/download-hf-model/0.log" Jul 06 19:17:18.821182 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:18.821151 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-bnbng_fc64e4be-9aae-4275-be21-43be4b52b94a/s3-tls-init-serving/0.log" Jul 06 19:17:18.838844 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:18.838817 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-bnbng_fc64e4be-9aae-4275-be21-43be4b52b94a/download-hf-model/0.log" Jul 06 19:17:23.769468 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:23.769437 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-kkw6g_a1cad0dd-89e4-4176-b225-f29d2a08db9d/migrator/0.log" Jul 06 19:17:23.800057 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:23.800023 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-kkw6g_a1cad0dd-89e4-4176-b225-f29d2a08db9d/graceful-termination/0.log" Jul 06 19:17:24.202595 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:24.202563 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-qvpqp_d05a83c2-2366-47f6-8f84-94f66c7a5499/kube-storage-version-migrator-operator/1.log" Jul 06 19:17:24.204162 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:24.204128 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-qvpqp_d05a83c2-2366-47f6-8f84-94f66c7a5499/kube-storage-version-migrator-operator/0.log" Jul 06 19:17:25.174769 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.174717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6q5j2_8707e886-cb93-4af3-be01-1c78a6c52b5f/kube-multus/0.log" Jul 06 19:17:25.465645 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.465554 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l624c_e5534e2f-a7cc-451f-947a-6072a500c589/kube-multus-additional-cni-plugins/0.log" Jul 06 19:17:25.493730 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.493690 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l624c_e5534e2f-a7cc-451f-947a-6072a500c589/egress-router-binary-copy/0.log" Jul 06 19:17:25.532601 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.532574 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l624c_e5534e2f-a7cc-451f-947a-6072a500c589/cni-plugins/0.log" Jul 06 19:17:25.560220 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.560195 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l624c_e5534e2f-a7cc-451f-947a-6072a500c589/bond-cni-plugin/0.log" Jul 06 19:17:25.593303 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.593269 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l624c_e5534e2f-a7cc-451f-947a-6072a500c589/routeoverride-cni/0.log" Jul 06 19:17:25.622032 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.622003 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l624c_e5534e2f-a7cc-451f-947a-6072a500c589/whereabouts-cni-bincopy/0.log" Jul 06 19:17:25.650908 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.650885 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l624c_e5534e2f-a7cc-451f-947a-6072a500c589/whereabouts-cni/0.log" Jul 06 19:17:25.955462 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.955433 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-grwxz_3678ac19-302c-49e3-adbd-cc07629c9bdd/network-metrics-daemon/0.log" Jul 06 19:17:25.981819 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:25.981783 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-grwxz_3678ac19-302c-49e3-adbd-cc07629c9bdd/kube-rbac-proxy/0.log" Jul 06 19:17:26.987988 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:26.987959 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-controller/0.log" Jul 06 19:17:27.020839 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:27.020811 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/0.log" Jul 06 19:17:27.021054 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:27.020856 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovn-acl-logging/1.log" Jul 06 19:17:27.050968 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:27.050937 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/kube-rbac-proxy-node/0.log" Jul 06 19:17:27.091164 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:27.091127 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/kube-rbac-proxy-ovn-metrics/0.log" Jul 06 19:17:27.128487 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:27.128461 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/northd/0.log" Jul 06 19:17:27.163410 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:27.163383 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/nbdb/0.log" Jul 06 19:17:27.201124 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:27.201093 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/sbdb/0.log" Jul 06 19:17:27.271706 ip-10-0-133-163 kubenswrapper[2559]: I0706 19:17:27.271632 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bnqhk_b01c382f-b95c-4d16-8805-d85d910cabc2/ovnkube-controller/0.log"