Jul 02 13:45:11.493201 ip-10-0-133-48 systemd[1]: Starting Kubernetes Kubelet... Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.871592 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876300 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876310 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876314 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876317 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876320 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876323 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876326 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:45:11.940591 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876328 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:45:11.940512 ip-10-0-133-48 systemd[1]: Started Kubernetes Kubelet. Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876331 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876334 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876336 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876339 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876341 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876344 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876347 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876350 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876353 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876356 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876358 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876361 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876363 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876366 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876368 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876370 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876374 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876376 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876379 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:45:11.943994 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876382 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876384 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876387 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876390 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876393 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876396 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876398 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876401 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876403 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876408 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876412 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876415 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876418 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876421 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876424 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876427 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876429 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876432 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876434 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876437 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:45:11.946082 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876439 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876442 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876445 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876448 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876450 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876453 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876456 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876458 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876461 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876463 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876466 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876468 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876471 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876474 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876476 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876481 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876483 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876486 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876489 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876491 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:45:11.948869 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876494 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876497 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876499 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876502 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876509 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876512 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876514 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876517 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876519 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876522 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876525 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876527 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876530 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876532 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876534 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876537 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876539 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876544 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876547 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876550 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:45:11.951372 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876553 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876555 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876558 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876561 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876564 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876566 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876570 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876574 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876576 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876579 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876581 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.876584 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877265 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877272 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877275 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877278 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877281 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877285 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877288 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:45:11.954536 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877291 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877293 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877296 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877300 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877303 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877307 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877310 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877313 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877317 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877320 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877323 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877326 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877330 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877332 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877335 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877338 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877341 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877343 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877346 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:45:11.956526 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877349 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877352 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877355 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877357 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877360 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877362 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877365 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877368 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877372 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877375 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877377 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877381 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877385 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877390 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877393 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877396 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877399 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877401 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877404 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:45:11.959280 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877407 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877409 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877413 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877415 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877418 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877420 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877423 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877425 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877428 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877430 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877433 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877436 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877438 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877441 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877443 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877446 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877449 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877452 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877455 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877458 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:45:11.963318 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877460 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877463 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877465 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877468 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877470 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877473 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877475 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877478 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877481 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877483 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877486 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877488 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877491 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877494 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877496 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877499 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877501 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877503 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877506 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:45:11.965322 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877508 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877512 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877515 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877517 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877520 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877523 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877526 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877529 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877531 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877534 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877537 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877539 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877542 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877544 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877546 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877912 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877917 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877920 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877923 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877927 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:45:11.969142 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877930 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877932 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877935 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877945 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877949 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877951 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877954 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877957 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877959 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877962 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877966 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877970 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877973 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877976 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877979 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877981 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877984 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877989 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877991 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877994 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:45:11.970060 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.877997 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878000 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878002 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878005 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878007 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878010 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878013 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878015 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878018 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878020 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878024 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878026 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878030 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878032 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878035 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878037 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878040 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878042 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878045 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878047 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:45:11.977153 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878050 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878054 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878057 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878059 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878062 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878064 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878068 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878071 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878074 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878078 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878080 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878083 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878085 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878088 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878091 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878093 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878096 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878098 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878101 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:45:11.978061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878103 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878106 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878108 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878111 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878113 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878116 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878120 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878122 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878125 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878127 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878130 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878133 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878135 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878138 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878142 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878145 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878147 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878150 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878152 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:45:11.979165 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878155 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878157 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878160 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878163 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878166 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878168 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878171 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878174 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878176 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878178 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878181 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878183 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878186 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878188 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878191 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878194 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878260 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878267 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878273 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878277 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 13:45:11.980061 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878287 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878290 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878302 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878305 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878308 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878311 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878315 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878319 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878322 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878325 2558 flags.go:64] FLAG: --cgroup-root="" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878328 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878331 2558 flags.go:64] FLAG: --client-ca-file="" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878334 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878337 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878340 2558 flags.go:64] FLAG: --cluster-domain="" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878345 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878348 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878352 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878355 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878358 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878361 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878364 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878368 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878370 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 02 13:45:11.981151 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878373 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878376 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878379 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878382 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878386 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878389 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878391 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878394 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878397 2558 flags.go:64] FLAG: --enable-server="true" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878401 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878405 2558 flags.go:64] FLAG: --event-burst="100" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878408 2558 flags.go:64] FLAG: --event-qps="50" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878411 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878414 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878417 2558 flags.go:64] FLAG: --eviction-hard="" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878421 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878424 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878427 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878430 2558 flags.go:64] FLAG: --eviction-soft="" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878433 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878436 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878439 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878442 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878446 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878449 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 13:45:11.982264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878452 2558 flags.go:64] FLAG: --feature-gates="" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878455 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878458 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878461 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878464 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878467 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878470 2558 flags.go:64] FLAG: --help="false" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878473 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-133-48.ec2.internal" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878476 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878479 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878482 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878485 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878488 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878491 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878493 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878496 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878499 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878502 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878505 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878508 2558 flags.go:64] FLAG: --kube-reserved="" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878511 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878514 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878518 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878521 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 13:45:11.983393 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878524 2558 flags.go:64] FLAG: --lock-file="" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878526 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878529 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878532 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878537 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878539 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878543 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878546 2558 flags.go:64] FLAG: --logging-format="text" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878549 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878552 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878555 2558 flags.go:64] FLAG: --manifest-url="" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878557 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878561 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878564 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878568 2558 flags.go:64] FLAG: --max-pods="110" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878571 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878574 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878577 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878580 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878583 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878586 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878589 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878595 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878598 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878601 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 13:45:11.984507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878604 2558 flags.go:64] FLAG: --pod-cidr="" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878608 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878613 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878616 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878619 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878623 2558 flags.go:64] FLAG: --port="10250" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878626 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878629 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cd1361bd1fbb8977" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878632 2558 flags.go:64] FLAG: --qos-reserved="" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878635 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878638 2558 flags.go:64] FLAG: --register-node="true" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878641 2558 flags.go:64] FLAG: --register-with-taints="" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878644 2558 flags.go:64] FLAG: --registry-burst="10" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878647 2558 flags.go:64] FLAG: --registry-qps="5" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878652 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878655 2558 flags.go:64] FLAG: --reserved-memory="" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878658 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878661 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878664 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878667 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878670 2558 flags.go:64] FLAG: --runonce="false" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878672 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878675 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878678 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878681 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 13:45:11.985621 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878684 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878687 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878690 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878692 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878695 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878698 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878701 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878703 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878706 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878710 2558 flags.go:64] FLAG: --system-cgroups="" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878713 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878718 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878722 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878725 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878729 2558 flags.go:64] FLAG: --tls-min-version="" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878731 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878734 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878736 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878739 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878742 2558 flags.go:64] FLAG: --v="2" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878746 2558 flags.go:64] FLAG: --version="false" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878750 2558 flags.go:64] FLAG: --vmodule="" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878754 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.878757 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878881 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:45:11.986723 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878886 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878889 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878892 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878894 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878898 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878901 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878903 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878905 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878908 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878910 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878913 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878916 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878918 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878921 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878924 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878927 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878930 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878933 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878936 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878940 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:45:11.987827 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878943 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878945 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878948 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878950 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878953 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878956 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878958 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878960 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878964 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878967 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878969 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878972 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878974 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878977 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878979 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878981 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878984 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878986 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878989 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878991 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:45:11.988716 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878994 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878996 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.878999 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879001 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879003 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879006 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879008 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879011 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879013 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879016 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879019 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879023 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879026 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879030 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879033 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879036 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879038 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879041 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879043 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879046 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:45:11.989599 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879050 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879052 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879055 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879058 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879060 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879063 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879065 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879068 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879072 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879075 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879078 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879081 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879083 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879086 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879089 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879093 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879095 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879098 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879101 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:45:11.990495 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879104 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879106 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879109 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879111 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879117 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879119 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879122 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879124 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879127 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879129 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879132 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879134 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879137 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879140 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879143 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879145 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879148 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879150 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:45:11.991396 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.879153 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.879158 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.886141 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.886155 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.886174 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.886182 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886246 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886250 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886254 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886256 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886260 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886262 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886265 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886268 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:45:11.992294 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886271 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886274 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886278 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886281 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886290 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886292 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886295 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886298 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886300 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886303 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886306 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886309 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886311 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886314 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886316 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886319 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886321 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886324 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886330 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886333 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:45:11.993174 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886335 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886338 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886341 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886343 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886346 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886348 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886351 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886354 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886356 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886358 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886361 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886363 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886366 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886368 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886371 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886373 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886376 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886388 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886391 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886395 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:45:11.994086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886397 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886400 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886402 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886405 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886408 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886410 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886413 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886415 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886418 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886420 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886425 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886427 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886430 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886432 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886434 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886437 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886440 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886442 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886444 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:45:11.994986 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886447 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886450 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886452 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886456 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886460 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886463 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886465 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886468 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886471 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886474 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886476 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886491 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886496 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886498 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886501 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886504 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886507 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886509 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886512 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:45:11.996086 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886514 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886517 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886519 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886522 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886526 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886532 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886535 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886537 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886539 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886542 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886545 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886547 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886549 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.886554 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886724 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 13:45:12.137289 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886729 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886732 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886735 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886738 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886741 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886743 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886746 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886749 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886751 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886754 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886762 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886767 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886769 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886772 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886774 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886777 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886779 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886782 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886784 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886787 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 13:45:12.160891 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886789 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886793 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886796 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886798 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886801 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886803 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886806 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886809 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886811 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886814 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886816 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886819 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886822 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886824 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886827 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886829 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886832 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886851 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886854 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886857 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886859 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 13:45:12.168560 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886862 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886865 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886875 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886878 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886881 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886883 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886887 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886891 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886894 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886897 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886900 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886902 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886906 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886909 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886911 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886913 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886916 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886919 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886921 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 13:45:12.169675 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886924 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886926 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886929 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886931 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886934 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886936 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886939 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886941 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886944 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886946 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886949 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886951 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886954 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886957 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886959 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886964 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886973 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886976 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886980 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 13:45:12.170562 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886983 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886986 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886989 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886992 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886995 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.886997 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887002 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887004 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887007 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887010 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887012 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887015 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887018 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887020 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887023 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887025 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887028 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887030 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 13:45:12.171455 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:11.887033 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.887037 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.887133 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.892257 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.893435 2558 server.go:1019] "Starting client certificate rotation" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.893535 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.893577 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.895586 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.898321 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.908882 2558 log.go:25] "Validated CRI v1 runtime API" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.911666 2558 log.go:25] "Validated CRI v1 image API" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.912422 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 13:45:12.172320 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.915450 2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7fc5721e-fcb9-4d09-a58d-72171f7edbda:/dev/nvme0n1p4 8d968e17-3ed6-46a7-902a-9d18eb760534:/dev/nvme0n1p3] Jul 02 13:45:12.172984 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.915466 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 13:45:12.173245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.920523 2558 manager.go:216] Machine: {Timestamp:2026-07-02 13:45:11.920059397 +0000 UTC m=+0.315347431 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101055 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a7ed13b416f0f4a78fbddc312806b SystemUUID:ec2a7ed1-3b41-6f0f-4a78-fbddc312806b BootID:1ebf6339-220d-4ed3-8bf3-1bf07edb2b7d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:84:d5:c0:e9:e5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:84:d5:c0:e9:e5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:d0:f8:73:5e:6f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 13:45:12.173245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.920651 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 13:45:12.173245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.920753 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 13:45:12.173245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.922623 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 13:45:12.173245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.923554 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 13:45:12.173245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.923587 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-48.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 13:45:12.173245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.924179 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.924189 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.924197 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.924910 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.925559 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.929737 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.929872 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.929908 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.929920 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.929936 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.929952 2558 kubelet.go:398] "Adding apiserver pod source" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.929960 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.930290 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.930305 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.933662 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.934824 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.934863 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935562 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935575 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935581 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935586 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935594 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935600 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935607 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935612 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935618 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935624 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935631 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.935639 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.936382 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.936394 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.939738 2558 server.go:1268] "Started kubelet" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.939823 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.939966 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.940018 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.941167 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.943193 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:11.944428 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.946423 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-48.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:11.946452 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 13:45:12.173871 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:11.946516 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:11.946431 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-48.ec2.internal.18be7cf921b828c4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-48.ec2.internal,UID:ip-10-0-133-48.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-48.ec2.internal,},FirstTimestamp:2026-07-02 13:45:11.93971322 +0000 UTC m=+0.335001253,LastTimestamp:2026-07-02 13:45:11.93971322 +0000 UTC m=+0.335001253,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-48.ec2.internal,}" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.948909 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.948918 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:11.949023 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.949782 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.949831 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.949868 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.949998 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.950005 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.950541 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.950554 2558 factory.go:55] Registering systemd factory Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.950564 2558 factory.go:223] Registration of the systemd container factory successfully Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.950946 2558 factory.go:153] Registering CRI-O factory Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.950958 2558 factory.go:223] Registration of the crio container factory successfully Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.950979 2558 factory.go:103] Registering Raw factory Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.950990 2558 manager.go:1196] Started watching for new ooms in manager Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.953391 2558 manager.go:349] Starting recovery of all containers Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.957191 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mrpff" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:11.965414 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:11.965544 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mrpff" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:11.967332 2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-48.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.008939 2558 manager.go:354] Recovery completed Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.013490 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.015409 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.015434 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.015444 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.015949 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.015958 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.015972 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.015958 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.016585 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.016617 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:45:12.175639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.016633 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.018043 2558 policy_none.go:49] "None policy: Start" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.018055 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.018065 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.019997 2558 policy_none.go:47] "Start" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.049196 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.053366 2558 manager.go:337] "Starting Device Plugin manager" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.053398 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.053408 2558 server.go:87] "Starting device plugin registration server" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.053633 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.053643 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.053747 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.053822 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.053833 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.054291 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.054333 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.067007 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.068124 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.068155 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.068174 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.068201 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.070885 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.154150 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.155034 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.155064 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.155075 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:45:12.177171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.155097 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.187132 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal"] Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.187228 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.187940 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.187959 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-48.ec2.internal\": node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.188453 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.188478 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.188488 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.195465 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.195589 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.195611 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.196142 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.196163 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.196173 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.196187 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.196217 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.196237 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.198458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.198479 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.199108 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientMemory" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.199128 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.199141 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeHasSufficientPID" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.218250 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.227810 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-48.ec2.internal\" not found" node="ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.231164 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-48.ec2.internal\" not found" node="ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.251404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f3af09ff95337a8d907ef00f73c36b6-config\") pod \"kube-apiserver-proxy-ip-10-0-133-48.ec2.internal\" (UID: \"2f3af09ff95337a8d907ef00f73c36b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.251428 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c18dd260749aee98147f5c6857beec9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"5c18dd260749aee98147f5c6857beec9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.336527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.251445 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c18dd260749aee98147f5c6857beec9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"5c18dd260749aee98147f5c6857beec9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.337849 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.319331 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.474284 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.352502 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c18dd260749aee98147f5c6857beec9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"5c18dd260749aee98147f5c6857beec9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.474284 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.352523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c18dd260749aee98147f5c6857beec9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"5c18dd260749aee98147f5c6857beec9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.474284 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.352540 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f3af09ff95337a8d907ef00f73c36b6-config\") pod \"kube-apiserver-proxy-ip-10-0-133-48.ec2.internal\" (UID: \"2f3af09ff95337a8d907ef00f73c36b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.474284 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.352563 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2f3af09ff95337a8d907ef00f73c36b6-config\") pod \"kube-apiserver-proxy-ip-10-0-133-48.ec2.internal\" (UID: \"2f3af09ff95337a8d907ef00f73c36b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.474284 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.352591 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5c18dd260749aee98147f5c6857beec9-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"5c18dd260749aee98147f5c6857beec9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.474284 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.352607 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c18dd260749aee98147f5c6857beec9-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal\" (UID: \"5c18dd260749aee98147f5c6857beec9\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.474284 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.419778 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.644276 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.522134 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.644276 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.530965 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.644276 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.533266 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Jul 02 13:45:12.644276 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.628887 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.803629 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.731405 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.875181 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.832771 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:12.875181 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.874070 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:45:13.055490 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.892968 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 13:45:13.055490 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.893087 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:45:13.055490 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.893123 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 13:45:13.055490 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:12.933882 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:13.055490 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.970945 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 13:40:12 +0000 UTC" deadline="2027-12-29 19:51:30.973351232 +0000 UTC" Jul 02 13:45:13.055490 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:12.970977 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13086h6m18.002377375s" Jul 02 13:45:13.055490 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:13.034068 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-48.ec2.internal\" not found" Jul 02 13:45:13.167397 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.095966 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:45:13.167397 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.149972 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" Jul 02 13:45:13.171212 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.168692 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:45:13.171212 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.170458 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" Jul 02 13:45:13.315358 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.188531 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:45:13.315358 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.188900 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 13:45:13.315358 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:13.230901 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3af09ff95337a8d907ef00f73c36b6.slice/crio-0aa357aa8b027877e2614af6d440e338b409339af6b6cba61d0622babee8e0fe WatchSource:0}: Error finding container 0aa357aa8b027877e2614af6d440e338b409339af6b6cba61d0622babee8e0fe: Status 404 returned error can't find the container with id 0aa357aa8b027877e2614af6d440e338b409339af6b6cba61d0622babee8e0fe Jul 02 13:45:13.315358 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.235880 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:45:13.315358 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:13.238594 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c18dd260749aee98147f5c6857beec9.slice/crio-762e550380923b71c569b4054ff229fe916979ec61be64cfa31729545117109e WatchSource:0}: Error finding container 762e550380923b71c569b4054ff229fe916979ec61be64cfa31729545117109e: Status 404 returned error can't find the container with id 762e550380923b71c569b4054ff229fe916979ec61be64cfa31729545117109e Jul 02 13:45:13.884854 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.884806 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:45:13.930991 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.930957 2558 apiserver.go:52] "Watching apiserver" Jul 02 13:45:13.942084 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.942052 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 13:45:13.942529 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.942503 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal","openshift-cluster-node-tuning-operator/tuned-d2fr9","openshift-dns/node-resolver-znnmt","openshift-multus/multus-2j2fk","openshift-multus/multus-additional-cni-plugins-fxjtn","openshift-multus/network-metrics-daemon-nbqdb","openshift-ovn-kubernetes/ovnkube-node-825xg","kube-system/global-pull-secret-syncer-5mb6x","kube-system/konnectivity-agent-95jv6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn","openshift-image-registry/node-ca-7rlc8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal","openshift-network-diagnostics/network-check-target-pdqvz","openshift-network-operator/iptables-alerter-8g9k2"] Jul 02 13:45:13.945236 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.945212 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.947679 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.947654 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:13.948664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.948479 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:45:13.948829 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.948813 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6bc72\"" Jul 02 13:45:13.949886 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.949864 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 13:45:13.950018 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.949943 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.952939 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.952916 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.955407 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.955185 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:13.955407 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:13.955267 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:13.958450 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.958427 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:13.959096 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342fc046-6e79-413e-8076-a93a39f23cc2-tmp\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.959196 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959106 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cnibin\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.959196 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959136 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.959196 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959163 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.959196 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959192 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f515a57-205a-4764-b435-fcdecd75ffdc-cni-binary-copy\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.959410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-system-cni-dir\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.959410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959243 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-modprobe-d\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.959410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959268 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-os-release\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.959410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959295 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-k8s-cni-cncf-io\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.959410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959379 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-multus-certs\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.959662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n55kh\" (UniqueName: \"kubernetes.io/projected/2f515a57-205a-4764-b435-fcdecd75ffdc-kube-api-access-n55kh\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.959662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-sys\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.959662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959496 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-host\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.959662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959537 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59sjq\" (UniqueName: \"kubernetes.io/projected/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-kube-api-access-59sjq\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:13.959662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959566 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-cnibin\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.959662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-conf-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.959662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959661 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysconfig\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959692 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-systemd\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959721 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-run\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959752 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-cni-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959808 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-cni-bin\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959870 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-hostroot\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959898 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-etc-kubernetes\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959924 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959963 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysctl-d\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.959988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-var-lib-kubelet\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960012 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-hosts-file\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:13.960039 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-daemon-config\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960062 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jzmp\" (UniqueName: \"kubernetes.io/projected/5fa98ade-4a63-473a-a09f-6f54d3df0d25-kube-api-access-7jzmp\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960087 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-lib-modules\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960110 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-tmp-dir\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960133 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-system-cni-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-socket-dir-parent\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960182 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-cni-multus\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960230 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-os-release\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cni-binary-copy\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960346 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysctl-conf\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960374 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r286\" (UniqueName: \"kubernetes.io/projected/342fc046-6e79-413e-8076-a93a39f23cc2-kube-api-access-9r286\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960400 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-netns\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960437 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-kubelet\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-kubernetes\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.960568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342fc046-6e79-413e-8076-a93a39f23cc2-etc-tuned\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:13.961240 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.960871 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:13.961240 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:13.960935 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:13.963225 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.963195 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:13.965957 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.965933 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:13.967991 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.967570 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 13:45:13.967991 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.967825 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 13:45:13.969598 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.969571 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:13.969707 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.969630 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 13:45:13.969707 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.969697 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 13:45:13.970149 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.970130 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 13:45:13.970392 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.970289 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 13:45:13.970392 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.970201 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nhxgh\"" Jul 02 13:45:13.970559 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.970209 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 13:45:13.970788 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.970750 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dhs4w\"" Jul 02 13:45:13.972400 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.972377 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:13.972502 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:13.972445 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:13.974953 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.974929 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:13.991038 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.991012 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 13:45:13.991156 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.991105 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 13:45:13.994002 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.993907 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 13:45:13.994112 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.994020 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 13:45:13.994112 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.994054 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 13:45:13.994228 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.994127 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 13:45:13.994228 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.994193 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 13:45:13.994508 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.994489 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 13:45:13.994589 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.994547 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-66zx7\"" Jul 02 13:45:13.994730 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.994707 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 13:45:13.994794 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.994749 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 13:45:13.995060 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995040 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kx89g\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995241 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-76s8s\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995275 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995303 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995250 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995377 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995476 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995504 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995537 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tf7js\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995550 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6dxrd\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995700 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 13:45:13.995804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.995775 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-v77np\"" Jul 02 13:45:13.996491 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.996021 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 13:45:13.996491 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:13.996212 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 13:45:14.051664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.051444 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061664 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-run-ovn-kubernetes\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061705 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-cni-netd\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061733 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvsz\" (UniqueName: \"kubernetes.io/projected/5de12f9a-dfde-4118-b292-a9d0555206ea-kube-api-access-8wvsz\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jzmp\" (UniqueName: \"kubernetes.io/projected/5fa98ade-4a63-473a-a09f-6f54d3df0d25-kube-api-access-7jzmp\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061795 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-systemd\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-cni-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061845 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-hostroot\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-etc-kubernetes\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061915 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061944 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysctl-d\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-var-lib-kubelet\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.061993 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-daemon-config\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5de12f9a-dfde-4118-b292-a9d0555206ea-host\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.063733 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062051 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-lib-modules\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cni-binary-copy\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062115 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysctl-conf\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062142 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r286\" (UniqueName: \"kubernetes.io/projected/342fc046-6e79-413e-8076-a93a39f23cc2-kube-api-access-9r286\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-netns\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-ovnkube-script-lib\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062251 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-kubernetes\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342fc046-6e79-413e-8076-a93a39f23cc2-tmp\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cnibin\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062336 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-socket-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062360 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-var-lib-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062385 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-ovn\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062411 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f54bf60-0685-4668-8fd6-2cf589af983f-ovn-node-metrics-cert\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.064815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062436 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f515a57-205a-4764-b435-fcdecd75ffdc-cni-binary-copy\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062487 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-registration-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062519 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-systemd\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062579 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-ovnkube-config\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-modprobe-d\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062631 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-multus-certs\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062666 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n55kh\" (UniqueName: \"kubernetes.io/projected/2f515a57-205a-4764-b435-fcdecd75ffdc-kube-api-access-n55kh\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26jqm\" (UniqueName: \"kubernetes.io/projected/ba4897bc-da40-4c75-be21-0c624f676e8a-kube-api-access-26jqm\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062700 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062723 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-sys\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062744 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-cnibin\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-conf-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.065519 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062806 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a308d647-b99e-4fb7-b747-32e534eb8617-iptables-alerter-script\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062829 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63919b3f-cf3a-4123-8c08-f8523c0cffa1-kubelet-config\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/351f0159-6a82-4ea3-a98a-bfd340dd2d77-agent-certs\") pod \"konnectivity-agent-95jv6\" (UID: \"351f0159-6a82-4ea3-a98a-bfd340dd2d77\") " pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062879 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-device-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062911 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysconfig\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062942 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-run\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.062970 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-kubernetes\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-run\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063061 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-modprobe-d\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063094 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-multus-certs\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063148 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-cni-bin\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063146 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-systemd\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcjf5\" (UniqueName: \"kubernetes.io/projected/0f54bf60-0685-4668-8fd6-2cf589af983f-kube-api-access-rcjf5\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-hosts-file\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:14.066260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063257 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63919b3f-cf3a-4123-8c08-f8523c0cffa1-dbus\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063285 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-systemd-units\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-env-overrides\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063377 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-sys\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cnibin\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-lib-modules\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063502 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-hostroot\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063503 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-etc-kubernetes\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063554 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysconfig\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-tmp-dir\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063623 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-cnibin\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-system-cni-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063665 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-socket-dir-parent\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063678 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-system-cni-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.066987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-cni-multus\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-os-release\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063754 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-run-netns\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063788 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063795 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-socket-dir-parent\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-kubelet\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/351f0159-6a82-4ea3-a98a-bfd340dd2d77-konnectivity-ca\") pod \"konnectivity-agent-95jv6\" (UID: \"351f0159-6a82-4ea3-a98a-bfd340dd2d77\") " pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063866 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-os-release\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063878 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-sys-fs\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063902 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063911 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-cni-multus\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063947 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-kubelet\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.063975 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-slash\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-node-log\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.067755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064026 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-log-socket\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064045 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysctl-d\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342fc046-6e79-413e-8076-a93a39f23cc2-etc-tuned\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064096 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-var-lib-kubelet\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064101 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064131 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064155 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-kubelet\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t52m6\" (UniqueName: \"kubernetes.io/projected/0395b743-f6bf-424d-8ae2-c471c9e4c65b-kube-api-access-t52m6\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064183 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-daemon-config\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5de12f9a-dfde-4118-b292-a9d0555206ea-serviceca\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064264 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5t29\" (UniqueName: \"kubernetes.io/projected/a308d647-b99e-4fb7-b747-32e534eb8617-kube-api-access-q5t29\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-system-cni-dir\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064328 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-etc-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.068578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064347 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-var-lib-cni-bin\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064372 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064420 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5fa98ade-4a63-473a-a09f-6f54d3df0d25-system-cni-dir\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064433 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-netns\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064470 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-conf-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064501 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a308d647-b99e-4fb7-b747-32e534eb8617-host-slash\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064546 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-etc-sysctl-conf\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-os-release\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064600 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-k8s-cni-cncf-io\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064635 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-cni-bin\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064646 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-hosts-file\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064673 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-multus-cni-dir\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064676 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-tmp-dir\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064694 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-host-run-k8s-cni-cncf-io\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.069334 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064720 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-host\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.070072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59sjq\" (UniqueName: \"kubernetes.io/projected/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-kube-api-access-59sjq\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:14.070072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064799 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f515a57-205a-4764-b435-fcdecd75ffdc-os-release\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.070072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.064861 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/342fc046-6e79-413e-8076-a93a39f23cc2-host\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.070072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.065276 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f515a57-205a-4764-b435-fcdecd75ffdc-cni-binary-copy\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.070072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.065567 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.070072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.065607 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5fa98ade-4a63-473a-a09f-6f54d3df0d25-cni-binary-copy\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.070072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.069836 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/342fc046-6e79-413e-8076-a93a39f23cc2-etc-tuned\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.071458 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.070988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/342fc046-6e79-413e-8076-a93a39f23cc2-tmp\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.074386 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.074279 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" event={"ID":"5c18dd260749aee98147f5c6857beec9","Type":"ContainerStarted","Data":"762e550380923b71c569b4054ff229fe916979ec61be64cfa31729545117109e"} Jul 02 13:45:14.076256 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.076187 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" event={"ID":"2f3af09ff95337a8d907ef00f73c36b6","Type":"ContainerStarted","Data":"0aa357aa8b027877e2614af6d440e338b409339af6b6cba61d0622babee8e0fe"} Jul 02 13:45:14.082486 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.082445 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 13:45:14.099481 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.099393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n55kh\" (UniqueName: \"kubernetes.io/projected/2f515a57-205a-4764-b435-fcdecd75ffdc-kube-api-access-n55kh\") pod \"multus-2j2fk\" (UID: \"2f515a57-205a-4764-b435-fcdecd75ffdc\") " pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.106476 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.106445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59sjq\" (UniqueName: \"kubernetes.io/projected/cbcd4a1e-b369-4587-9a15-c87a6d1121ee-kube-api-access-59sjq\") pod \"node-resolver-znnmt\" (UID: \"cbcd4a1e-b369-4587-9a15-c87a6d1121ee\") " pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:14.129475 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.129415 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jzmp\" (UniqueName: \"kubernetes.io/projected/5fa98ade-4a63-473a-a09f-6f54d3df0d25-kube-api-access-7jzmp\") pod \"multus-additional-cni-plugins-fxjtn\" (UID: \"5fa98ade-4a63-473a-a09f-6f54d3df0d25\") " pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.129746 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.129720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r286\" (UniqueName: \"kubernetes.io/projected/342fc046-6e79-413e-8076-a93a39f23cc2-kube-api-access-9r286\") pod \"tuned-d2fr9\" (UID: \"342fc046-6e79-413e-8076-a93a39f23cc2\") " pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.159154 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.159122 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnlz8" Jul 02 13:45:14.165603 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-node-log\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.165761 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165614 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-log-socket\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.165761 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165705 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-node-log\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.165906 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165758 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t52m6\" (UniqueName: \"kubernetes.io/projected/0395b743-f6bf-424d-8ae2-c471c9e4c65b-kube-api-access-t52m6\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.165906 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5de12f9a-dfde-4118-b292-a9d0555206ea-serviceca\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.165906 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5t29\" (UniqueName: \"kubernetes.io/projected/a308d647-b99e-4fb7-b747-32e534eb8617-kube-api-access-q5t29\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.165906 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165863 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-etc-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.165906 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a308d647-b99e-4fb7-b747-32e534eb8617-host-slash\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-cni-bin\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165983 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-run-ovn-kubernetes\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-cni-netd\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a308d647-b99e-4fb7-b747-32e534eb8617-host-slash\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-cni-netd\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166101 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-cni-bin\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166123 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-etc-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.165864 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-log-socket\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvsz\" (UniqueName: \"kubernetes.io/projected/5de12f9a-dfde-4118-b292-a9d0555206ea-kube-api-access-8wvsz\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166181 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-run-ovn-kubernetes\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166196 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5de12f9a-dfde-4118-b292-a9d0555206ea-host\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166250 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5de12f9a-dfde-4118-b292-a9d0555206ea-host\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166258 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-ovnkube-script-lib\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-socket-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166299 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5de12f9a-dfde-4118-b292-a9d0555206ea-serviceca\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166318 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-var-lib-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.166337 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166383 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-ovn\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.166414 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret podName:63919b3f-cf3a-4123-8c08-f8523c0cffa1 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:14.666388558 +0000 UTC m=+3.061676601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret") pod "global-pull-secret-syncer-5mb6x" (UID: "63919b3f-cf3a-4123-8c08-f8523c0cffa1") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166428 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-ovn\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.166664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166443 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-socket-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166456 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f54bf60-0685-4668-8fd6-2cf589af983f-ovn-node-metrics-cert\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166470 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-var-lib-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166492 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-registration-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166626 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-systemd\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166866 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166906 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-ovnkube-config\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166950 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26jqm\" (UniqueName: \"kubernetes.io/projected/ba4897bc-da40-4c75-be21-0c624f676e8a-kube-api-access-26jqm\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.166981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167035 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a308d647-b99e-4fb7-b747-32e534eb8617-iptables-alerter-script\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167062 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63919b3f-cf3a-4123-8c08-f8523c0cffa1-kubelet-config\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/351f0159-6a82-4ea3-a98a-bfd340dd2d77-agent-certs\") pod \"konnectivity-agent-95jv6\" (UID: \"351f0159-6a82-4ea3-a98a-bfd340dd2d77\") " pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:14.167410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-device-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcjf5\" (UniqueName: \"kubernetes.io/projected/0f54bf60-0685-4668-8fd6-2cf589af983f-kube-api-access-rcjf5\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167177 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63919b3f-cf3a-4123-8c08-f8523c0cffa1-dbus\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-systemd-units\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-env-overrides\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167253 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-systemd\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167258 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-run-netns\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167300 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-registration-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167333 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167358 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-ovnkube-script-lib\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/351f0159-6a82-4ea3-a98a-bfd340dd2d77-konnectivity-ca\") pod \"konnectivity-agent-95jv6\" (UID: \"351f0159-6a82-4ea3-a98a-bfd340dd2d77\") " pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167374 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-device-dir\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167393 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-sys-fs\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167458 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-systemd-units\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168166 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167493 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-etc-selinux\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167520 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-kubelet\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167560 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-run-openvswitch\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-slash\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-env-overrides\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167813 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-run-netns\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167825 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-slash\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167864 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63919b3f-cf3a-4123-8c08-f8523c0cffa1-kubelet-config\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167892 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0395b743-f6bf-424d-8ae2-c471c9e4c65b-sys-fs\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.167909 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0f54bf60-0685-4668-8fd6-2cf589af983f-host-kubelet\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.167997 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.168051 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs podName:ba4897bc-da40-4c75-be21-0c624f676e8a nodeName:}" failed. No retries permitted until 2026-07-02 13:45:14.668032455 +0000 UTC m=+3.063320495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs") pod "network-metrics-daemon-nbqdb" (UID: "ba4897bc-da40-4c75-be21-0c624f676e8a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.168061 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a308d647-b99e-4fb7-b747-32e534eb8617-iptables-alerter-script\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.168851 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.168423 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/351f0159-6a82-4ea3-a98a-bfd340dd2d77-konnectivity-ca\") pod \"konnectivity-agent-95jv6\" (UID: \"351f0159-6a82-4ea3-a98a-bfd340dd2d77\") " pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:14.169596 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.168426 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63919b3f-cf3a-4123-8c08-f8523c0cffa1-dbus\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.169596 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.168620 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0f54bf60-0685-4668-8fd6-2cf589af983f-ovnkube-config\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.169596 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.169552 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f54bf60-0685-4668-8fd6-2cf589af983f-ovn-node-metrics-cert\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.171763 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.171739 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/351f0159-6a82-4ea3-a98a-bfd340dd2d77-agent-certs\") pod \"konnectivity-agent-95jv6\" (UID: \"351f0159-6a82-4ea3-a98a-bfd340dd2d77\") " pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:14.189409 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.189346 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bnlz8" Jul 02 13:45:14.192312 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.192262 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcjf5\" (UniqueName: \"kubernetes.io/projected/0f54bf60-0685-4668-8fd6-2cf589af983f-kube-api-access-rcjf5\") pod \"ovnkube-node-825xg\" (UID: \"0f54bf60-0685-4668-8fd6-2cf589af983f\") " pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.193771 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.193745 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvsz\" (UniqueName: \"kubernetes.io/projected/5de12f9a-dfde-4118-b292-a9d0555206ea-kube-api-access-8wvsz\") pod \"node-ca-7rlc8\" (UID: \"5de12f9a-dfde-4118-b292-a9d0555206ea\") " pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.195024 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.195001 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5t29\" (UniqueName: \"kubernetes.io/projected/a308d647-b99e-4fb7-b747-32e534eb8617-kube-api-access-q5t29\") pod \"iptables-alerter-8g9k2\" (UID: \"a308d647-b99e-4fb7-b747-32e534eb8617\") " pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.199088 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.198985 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t52m6\" (UniqueName: \"kubernetes.io/projected/0395b743-f6bf-424d-8ae2-c471c9e4c65b-kube-api-access-t52m6\") pod \"aws-ebs-csi-driver-node-mv8jn\" (UID: \"0395b743-f6bf-424d-8ae2-c471c9e4c65b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.201868 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.201823 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26jqm\" (UniqueName: \"kubernetes.io/projected/ba4897bc-da40-4c75-be21-0c624f676e8a-kube-api-access-26jqm\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:14.209523 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.209263 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:14.209523 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.209287 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:14.209523 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.209299 2558 projected.go:196] Error preparing data for projected volume kube-api-access-skj9c for pod openshift-network-diagnostics/network-check-target-pdqvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:14.209523 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.209361 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c podName:3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd nodeName:}" failed. No retries permitted until 2026-07-02 13:45:14.709341578 +0000 UTC m=+3.104629607 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-skj9c" (UniqueName: "kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c") pod "network-check-target-pdqvz" (UID: "3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:14.260632 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.260416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" Jul 02 13:45:14.269029 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.268835 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2j2fk" Jul 02 13:45:14.277705 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.277670 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-znnmt" Jul 02 13:45:14.292712 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.292530 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" Jul 02 13:45:14.300893 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.300704 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:14.310912 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.310728 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:14.318478 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.318456 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" Jul 02 13:45:14.328428 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.328406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7rlc8" Jul 02 13:45:14.335526 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.335505 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8g9k2" Jul 02 13:45:14.671930 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.671891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:14.672094 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.671946 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:14.672094 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.672063 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:14.672232 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.672063 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:14.672232 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.672123 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret podName:63919b3f-cf3a-4123-8c08-f8523c0cffa1 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:15.672106883 +0000 UTC m=+4.067394911 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret") pod "global-pull-secret-syncer-5mb6x" (UID: "63919b3f-cf3a-4123-8c08-f8523c0cffa1") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:14.672232 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.672158 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs podName:ba4897bc-da40-4c75-be21-0c624f676e8a nodeName:}" failed. No retries permitted until 2026-07-02 13:45:15.672137817 +0000 UTC m=+4.067425844 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs") pod "network-metrics-daemon-nbqdb" (UID: "ba4897bc-da40-4c75-be21-0c624f676e8a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:14.772555 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:14.772516 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:14.772729 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.772663 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:14.772729 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.772679 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:14.772729 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.772688 2558 projected.go:196] Error preparing data for projected volume kube-api-access-skj9c for pod openshift-network-diagnostics/network-check-target-pdqvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:14.772902 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:14.772742 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c podName:3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd nodeName:}" failed. No retries permitted until 2026-07-02 13:45:15.77272535 +0000 UTC m=+4.168013391 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-skj9c" (UniqueName: "kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c") pod "network-check-target-pdqvz" (UID: "3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:15.194470 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:15.194432 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:40:14 +0000 UTC" deadline="2027-11-30 21:20:10.470545334 +0000 UTC" Jul 02 13:45:15.194470 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:15.194462 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12391h34m55.27608681s" Jul 02 13:45:15.349685 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:15.349658 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod351f0159_6a82_4ea3_a98a_bfd340dd2d77.slice/crio-46d6a94e6f08ee3feb9e4c2da05b7bd698944fedad670232d74e764414de2bc0 WatchSource:0}: Error finding container 46d6a94e6f08ee3feb9e4c2da05b7bd698944fedad670232d74e764414de2bc0: Status 404 returned error can't find the container with id 46d6a94e6f08ee3feb9e4c2da05b7bd698944fedad670232d74e764414de2bc0 Jul 02 13:45:15.371140 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:15.371117 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0395b743_f6bf_424d_8ae2_c471c9e4c65b.slice/crio-6b48c7776f0832d60926f97d99efe22312756534600fd35f590745f29e17528b WatchSource:0}: Error finding container 6b48c7776f0832d60926f97d99efe22312756534600fd35f590745f29e17528b: Status 404 returned error can't find the container with id 6b48c7776f0832d60926f97d99efe22312756534600fd35f590745f29e17528b Jul 02 13:45:15.372575 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:15.372543 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342fc046_6e79_413e_8076_a93a39f23cc2.slice/crio-1a0b69b0feff664c0171e3b8f77f29ba55db9875b383f957e006bbf47f3bbb6f WatchSource:0}: Error finding container 1a0b69b0feff664c0171e3b8f77f29ba55db9875b383f957e006bbf47f3bbb6f: Status 404 returned error can't find the container with id 1a0b69b0feff664c0171e3b8f77f29ba55db9875b383f957e006bbf47f3bbb6f Jul 02 13:45:15.373749 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:15.373718 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fa98ade_4a63_473a_a09f_6f54d3df0d25.slice/crio-2e549241eb0dffb7e783613373aadc40d425c1419f055604f94cd88aac648159 WatchSource:0}: Error finding container 2e549241eb0dffb7e783613373aadc40d425c1419f055604f94cd88aac648159: Status 404 returned error can't find the container with id 2e549241eb0dffb7e783613373aadc40d425c1419f055604f94cd88aac648159 Jul 02 13:45:15.376047 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:15.376022 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de12f9a_dfde_4118_b292_a9d0555206ea.slice/crio-9b9b9bd71e7c35398f46fc4aae3dda6302e5327bf4b9a51de518c8735fa37663 WatchSource:0}: Error finding container 9b9b9bd71e7c35398f46fc4aae3dda6302e5327bf4b9a51de518c8735fa37663: Status 404 returned error can't find the container with id 9b9b9bd71e7c35398f46fc4aae3dda6302e5327bf4b9a51de518c8735fa37663 Jul 02 13:45:15.377056 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:15.377023 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f54bf60_0685_4668_8fd6_2cf589af983f.slice/crio-4f869ec0f362465bb6dcc69abb5a6b46ae25872b691b7f9808560c735b855048 WatchSource:0}: Error finding container 4f869ec0f362465bb6dcc69abb5a6b46ae25872b691b7f9808560c735b855048: Status 404 returned error can't find the container with id 4f869ec0f362465bb6dcc69abb5a6b46ae25872b691b7f9808560c735b855048 Jul 02 13:45:15.378233 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:15.378207 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbcd4a1e_b369_4587_9a15_c87a6d1121ee.slice/crio-d2b869a4c2373c0a7cbd34d37f5371d0422c9d65adfadae302dbc658b5dc3e22 WatchSource:0}: Error finding container d2b869a4c2373c0a7cbd34d37f5371d0422c9d65adfadae302dbc658b5dc3e22: Status 404 returned error can't find the container with id d2b869a4c2373c0a7cbd34d37f5371d0422c9d65adfadae302dbc658b5dc3e22 Jul 02 13:45:15.384241 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:15.380325 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f515a57_205a_4764_b435_fcdecd75ffdc.slice/crio-ff23abdffe43b6b35322186531126182086d706a4e0732e3681cc6768a672370 WatchSource:0}: Error finding container ff23abdffe43b6b35322186531126182086d706a4e0732e3681cc6768a672370: Status 404 returned error can't find the container with id ff23abdffe43b6b35322186531126182086d706a4e0732e3681cc6768a672370 Jul 02 13:45:15.435891 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:15.435858 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 13:45:15.678083 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:15.678053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:15.678221 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:15.678115 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:15.678285 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:15.678222 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:15.678285 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:15.678223 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:15.678285 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:15.678275 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs podName:ba4897bc-da40-4c75-be21-0c624f676e8a nodeName:}" failed. No retries permitted until 2026-07-02 13:45:17.678258899 +0000 UTC m=+6.073546927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs") pod "network-metrics-daemon-nbqdb" (UID: "ba4897bc-da40-4c75-be21-0c624f676e8a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:15.678406 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:15.678293 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret podName:63919b3f-cf3a-4123-8c08-f8523c0cffa1 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:17.678283715 +0000 UTC m=+6.073571751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret") pod "global-pull-secret-syncer-5mb6x" (UID: "63919b3f-cf3a-4123-8c08-f8523c0cffa1") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:15.779094 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:15.779020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:15.779201 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:15.779143 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:15.779201 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:15.779158 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:15.779201 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:15.779166 2558 projected.go:196] Error preparing data for projected volume kube-api-access-skj9c for pod openshift-network-diagnostics/network-check-target-pdqvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:15.779305 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:15.779215 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c podName:3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd nodeName:}" failed. No retries permitted until 2026-07-02 13:45:17.779201654 +0000 UTC m=+6.174489677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-skj9c" (UniqueName: "kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c") pod "network-check-target-pdqvz" (UID: "3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:16.071816 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.071733 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:16.071991 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:16.071875 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:16.072339 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.072316 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:16.072463 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:16.072442 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:16.072550 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.072524 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:16.072618 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:16.072599 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:16.088369 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.088338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8g9k2" event={"ID":"a308d647-b99e-4fb7-b747-32e534eb8617","Type":"ContainerStarted","Data":"fed73b3b8cad3b3a6abd9f9c642f3490db4d0b21e1a02bd10dc50216c0a71b20"} Jul 02 13:45:16.097139 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.097110 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2j2fk" event={"ID":"2f515a57-205a-4764-b435-fcdecd75ffdc","Type":"ContainerStarted","Data":"ff23abdffe43b6b35322186531126182086d706a4e0732e3681cc6768a672370"} Jul 02 13:45:16.102926 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.102883 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" event={"ID":"5fa98ade-4a63-473a-a09f-6f54d3df0d25","Type":"ContainerStarted","Data":"2e549241eb0dffb7e783613373aadc40d425c1419f055604f94cd88aac648159"} Jul 02 13:45:16.110872 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.110833 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" event={"ID":"342fc046-6e79-413e-8076-a93a39f23cc2","Type":"ContainerStarted","Data":"1a0b69b0feff664c0171e3b8f77f29ba55db9875b383f957e006bbf47f3bbb6f"} Jul 02 13:45:16.120210 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.120183 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" event={"ID":"0395b743-f6bf-424d-8ae2-c471c9e4c65b","Type":"ContainerStarted","Data":"6b48c7776f0832d60926f97d99efe22312756534600fd35f590745f29e17528b"} Jul 02 13:45:16.129406 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.129375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-95jv6" event={"ID":"351f0159-6a82-4ea3-a98a-bfd340dd2d77","Type":"ContainerStarted","Data":"46d6a94e6f08ee3feb9e4c2da05b7bd698944fedad670232d74e764414de2bc0"} Jul 02 13:45:16.133603 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.133577 2558 generic.go:356] "Generic (PLEG): container finished" podID="5c18dd260749aee98147f5c6857beec9" containerID="a970168fd680039d1a7f9d3045c0f3263fb405e6055865871decc7c02e13ad78" exitCode=0 Jul 02 13:45:16.133691 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.133671 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" event={"ID":"5c18dd260749aee98147f5c6857beec9","Type":"ContainerDied","Data":"a970168fd680039d1a7f9d3045c0f3263fb405e6055865871decc7c02e13ad78"} Jul 02 13:45:16.144322 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.144296 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znnmt" event={"ID":"cbcd4a1e-b369-4587-9a15-c87a6d1121ee","Type":"ContainerStarted","Data":"d2b869a4c2373c0a7cbd34d37f5371d0422c9d65adfadae302dbc658b5dc3e22"} Jul 02 13:45:16.150081 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.149811 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"4f869ec0f362465bb6dcc69abb5a6b46ae25872b691b7f9808560c735b855048"} Jul 02 13:45:16.159058 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.159030 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7rlc8" event={"ID":"5de12f9a-dfde-4118-b292-a9d0555206ea","Type":"ContainerStarted","Data":"9b9b9bd71e7c35398f46fc4aae3dda6302e5327bf4b9a51de518c8735fa37663"} Jul 02 13:45:16.169988 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.169964 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" event={"ID":"2f3af09ff95337a8d907ef00f73c36b6","Type":"ContainerStarted","Data":"13a67fedf4fde5a50b6ce14b4dc187f0c9f706166bbcdd78c5cf35aeb925b810"} Jul 02 13:45:16.190136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.190082 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-48.ec2.internal" podStartSLOduration=3.1900629719999998 podStartE2EDuration="3.190062972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:16.189644637 +0000 UTC m=+4.584932685" watchObservedRunningTime="2026-07-02 13:45:16.190062972 +0000 UTC m=+4.585351019" Jul 02 13:45:16.195113 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.195063 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 13:40:14 +0000 UTC" deadline="2028-01-02 22:50:44.212154658 +0000 UTC" Jul 02 13:45:16.195113 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:16.195113 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13185h5m28.017045654s" Jul 02 13:45:17.192371 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:17.192333 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" event={"ID":"5c18dd260749aee98147f5c6857beec9","Type":"ContainerStarted","Data":"28ca3831df1413bd496654d4443cf2573255d3f8ac99e03f45659fdf8ebcb763"} Jul 02 13:45:17.697287 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:17.696387 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:17.697287 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:17.696478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:17.697287 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:17.696648 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:17.697287 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:17.696716 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret podName:63919b3f-cf3a-4123-8c08-f8523c0cffa1 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:21.696698148 +0000 UTC m=+10.091986175 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret") pod "global-pull-secret-syncer-5mb6x" (UID: "63919b3f-cf3a-4123-8c08-f8523c0cffa1") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:17.697287 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:17.697157 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:17.697287 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:17.697210 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs podName:ba4897bc-da40-4c75-be21-0c624f676e8a nodeName:}" failed. No retries permitted until 2026-07-02 13:45:21.697194053 +0000 UTC m=+10.092482081 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs") pod "network-metrics-daemon-nbqdb" (UID: "ba4897bc-da40-4c75-be21-0c624f676e8a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:17.798546 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:17.797824 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:17.798546 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:17.798063 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:17.798546 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:17.798086 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:17.798546 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:17.798101 2558 projected.go:196] Error preparing data for projected volume kube-api-access-skj9c for pod openshift-network-diagnostics/network-check-target-pdqvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:17.798546 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:17.798160 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c podName:3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd nodeName:}" failed. No retries permitted until 2026-07-02 13:45:21.798141458 +0000 UTC m=+10.193429485 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-skj9c" (UniqueName: "kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c") pod "network-check-target-pdqvz" (UID: "3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:18.069086 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:18.068987 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:18.069259 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:18.069114 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:18.069541 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:18.069517 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:18.069684 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:18.069631 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:18.069759 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:18.069690 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:18.069874 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:18.069760 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:20.069759 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:20.069219 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:20.069759 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:20.069371 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:20.069759 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:20.069449 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:20.069759 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:20.069531 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:20.069759 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:20.069591 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:20.069759 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:20.069712 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:21.734144 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:21.733308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:21.734144 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:21.733390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:21.734144 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:21.733545 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:21.734144 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:21.733615 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret podName:63919b3f-cf3a-4123-8c08-f8523c0cffa1 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:29.733594766 +0000 UTC m=+18.128882791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret") pod "global-pull-secret-syncer-5mb6x" (UID: "63919b3f-cf3a-4123-8c08-f8523c0cffa1") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:21.734144 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:21.734059 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:21.734144 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:21.734118 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs podName:ba4897bc-da40-4c75-be21-0c624f676e8a nodeName:}" failed. No retries permitted until 2026-07-02 13:45:29.734100749 +0000 UTC m=+18.129388776 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs") pod "network-metrics-daemon-nbqdb" (UID: "ba4897bc-da40-4c75-be21-0c624f676e8a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:21.834303 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:21.834060 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:21.834303 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:21.834302 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:21.834561 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:21.834325 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:21.834561 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:21.834339 2558 projected.go:196] Error preparing data for projected volume kube-api-access-skj9c for pod openshift-network-diagnostics/network-check-target-pdqvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:21.834561 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:21.834413 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c podName:3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd nodeName:}" failed. No retries permitted until 2026-07-02 13:45:29.834391015 +0000 UTC m=+18.229679053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-skj9c" (UniqueName: "kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c") pod "network-check-target-pdqvz" (UID: "3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:22.070653 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:22.069084 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:22.070653 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:22.069223 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:22.070653 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:22.069257 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:22.070653 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:22.070431 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:22.070653 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:22.070481 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:22.070653 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:22.070564 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:24.069351 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:24.069315 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:24.069797 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:24.069359 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:24.069797 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:24.069315 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:24.069797 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:24.069465 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:24.069797 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:24.069561 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:24.069797 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:24.069629 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:26.069253 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:26.069215 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:26.069253 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:26.069247 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:26.069692 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:26.069216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:26.069692 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:26.069351 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:26.069692 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:26.069455 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:26.069692 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:26.069480 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:28.068741 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:28.068703 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:28.069216 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:28.068711 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:28.069216 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:28.068821 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:28.069216 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:28.068903 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:28.069216 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:28.068719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:28.069216 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:28.068993 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:29.805681 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:29.805652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:29.806140 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:29.805716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:29.806140 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:29.805784 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:29.806140 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:29.805822 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:29.806140 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:29.805873 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret podName:63919b3f-cf3a-4123-8c08-f8523c0cffa1 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:45.80585238 +0000 UTC m=+34.201140406 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret") pod "global-pull-secret-syncer-5mb6x" (UID: "63919b3f-cf3a-4123-8c08-f8523c0cffa1") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:29.806140 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:29.805895 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs podName:ba4897bc-da40-4c75-be21-0c624f676e8a nodeName:}" failed. No retries permitted until 2026-07-02 13:45:45.805885053 +0000 UTC m=+34.201173079 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs") pod "network-metrics-daemon-nbqdb" (UID: "ba4897bc-da40-4c75-be21-0c624f676e8a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:29.906913 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:29.906881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:29.907046 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:29.907023 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:29.907046 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:29.907038 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:29.907046 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:29.907047 2558 projected.go:196] Error preparing data for projected volume kube-api-access-skj9c for pod openshift-network-diagnostics/network-check-target-pdqvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:29.907171 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:29.907108 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c podName:3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd nodeName:}" failed. No retries permitted until 2026-07-02 13:45:45.907090892 +0000 UTC m=+34.302378926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-skj9c" (UniqueName: "kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c") pod "network-check-target-pdqvz" (UID: "3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:30.069010 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:30.068928 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:30.069010 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:30.068966 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:30.069244 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:30.068929 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:30.069244 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:30.069055 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:30.069244 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:30.069137 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:30.069244 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:30.069209 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:32.069702 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:32.069665 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:32.070188 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:32.069783 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:32.070188 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:32.069938 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:32.070188 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:32.069975 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:32.070188 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:32.070067 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:32.070188 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:32.070149 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:34.069042 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:34.069003 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:34.069042 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:34.069022 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:34.069494 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:34.069128 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:34.069494 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:34.069180 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:34.069494 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:34.069220 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:34.069494 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:34.069284 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:35.232477 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.232073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-znnmt" event={"ID":"cbcd4a1e-b369-4587-9a15-c87a6d1121ee","Type":"ContainerStarted","Data":"d386e65bf32f2afd5527df9fd35d0f789ede0799a30e749dfd4c469231a82944"} Jul 02 13:45:35.235072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.235047 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:45:35.235476 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.235449 2558 generic.go:356] "Generic (PLEG): container finished" podID="0f54bf60-0685-4668-8fd6-2cf589af983f" containerID="cbcc018a8a81f47e0eef64d1c2fd48f034a67ee6f1829bd22a4097c67a5758fc" exitCode=1 Jul 02 13:45:35.235580 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.235511 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"8635d798879e2914ccbbe5983151f847a0214fabca74e06062f26b5e29f7cc62"} Jul 02 13:45:35.235622 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.235590 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"77e88b3ea55d47a65a5d7f3e9f86d0cb9a642608aeae8adcc10564fa480e2724"} Jul 02 13:45:35.235655 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.235643 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerDied","Data":"cbcc018a8a81f47e0eef64d1c2fd48f034a67ee6f1829bd22a4097c67a5758fc"} Jul 02 13:45:35.235707 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.235694 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"97f46539bff52d6bffeff95d67790c39c9f1d98e5f56f651092f0dbb6d8fce14"} Jul 02 13:45:35.237059 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.237037 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7rlc8" event={"ID":"5de12f9a-dfde-4118-b292-a9d0555206ea","Type":"ContainerStarted","Data":"2ca8732204d7214bbcb034ef6c5eba09fc91a53fdffbadd6bf2d3ac751474f81"} Jul 02 13:45:35.238489 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.238444 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2j2fk" event={"ID":"2f515a57-205a-4764-b435-fcdecd75ffdc","Type":"ContainerStarted","Data":"9f7a945c58c88267a55c893acdba90e1f47bba02ce18247f33371323b69c112f"} Jul 02 13:45:35.240594 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.240566 2558 generic.go:356] "Generic (PLEG): container finished" podID="5fa98ade-4a63-473a-a09f-6f54d3df0d25" containerID="3e272b3496b30e797c5e756a92010c9cf610b054af9b3640d9eaced8144b9cf6" exitCode=0 Jul 02 13:45:35.240698 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.240645 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" event={"ID":"5fa98ade-4a63-473a-a09f-6f54d3df0d25","Type":"ContainerDied","Data":"3e272b3496b30e797c5e756a92010c9cf610b054af9b3640d9eaced8144b9cf6"} Jul 02 13:45:35.243669 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.242966 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" event={"ID":"342fc046-6e79-413e-8076-a93a39f23cc2","Type":"ContainerStarted","Data":"78c1657c96636c41cd5cc2b8d6d4349ca81b26b9dd4af8c05d95b6ee7c9047d8"} Jul 02 13:45:35.246090 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.245253 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" event={"ID":"0395b743-f6bf-424d-8ae2-c471c9e4c65b","Type":"ContainerStarted","Data":"a2a985104050e7d83ad4de89e47f01a8f135f90bbec71dc4e92a4f91948b5bd7"} Jul 02 13:45:35.251045 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.250995 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-95jv6" event={"ID":"351f0159-6a82-4ea3-a98a-bfd340dd2d77","Type":"ContainerStarted","Data":"a54ea771f2a62ff7fecd0c7accb25d287de6424ad7d400f6cb6621ffcd9307c8"} Jul 02 13:45:35.254751 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.254705 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-znnmt" podStartSLOduration=3.108908366 podStartE2EDuration="22.254693771s" totalImagesPullingTime="19.145785405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:35.254573472 +0000 UTC m=+23.649861515" watchObservedRunningTime="2026-07-02 13:45:35.254693771 +0000 UTC m=+23.649981815" Jul 02 13:45:35.255559 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.255523 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-48.ec2.internal" podStartSLOduration=22.255508587 podStartE2EDuration="22.255508587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:17.217818195 +0000 UTC m=+5.613106243" watchObservedRunningTime="2026-07-02 13:45:35.255508587 +0000 UTC m=+23.650796631" Jul 02 13:45:35.301694 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.301647 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-95jv6" podStartSLOduration=3.144739784 podStartE2EDuration="22.301627167s" totalImagesPullingTime="19.156887383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:35.301198752 +0000 UTC m=+23.696486789" watchObservedRunningTime="2026-07-02 13:45:35.301627167 +0000 UTC m=+23.696915201" Jul 02 13:45:35.319598 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.319549 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7rlc8" podStartSLOduration=3.164056573 podStartE2EDuration="22.319530493s" totalImagesPullingTime="19.15547392s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:35.318766476 +0000 UTC m=+23.714054522" watchObservedRunningTime="2026-07-02 13:45:35.319530493 +0000 UTC m=+23.714818537" Jul 02 13:45:35.344681 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.344617 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d2fr9" podStartSLOduration=3.168306029 podStartE2EDuration="22.344605164s" totalImagesPullingTime="19.176299135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:35.343487 +0000 UTC m=+23.738775044" watchObservedRunningTime="2026-07-02 13:45:35.344605164 +0000 UTC m=+23.739893208" Jul 02 13:45:35.370927 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.370896 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2j2fk" podStartSLOduration=3.148351209 podStartE2EDuration="22.370884033s" totalImagesPullingTime="19.222532824s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:35.369935547 +0000 UTC m=+23.765223590" watchObservedRunningTime="2026-07-02 13:45:35.370884033 +0000 UTC m=+23.766172075" Jul 02 13:45:35.531072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.531030 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-95jv6_351f0159-6a82-4ea3-a98a-bfd340dd2d77/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:35.613266 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.613180 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-95jv6_351f0159-6a82-4ea3-a98a-bfd340dd2d77/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:35.687179 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:35.687129 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-95jv6_351f0159-6a82-4ea3-a98a-bfd340dd2d77/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:36.069426 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.069390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:36.069537 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.069512 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:36.069600 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:36.069526 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:36.069600 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.069582 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:36.069701 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:36.069681 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:36.069806 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:36.069776 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:36.102689 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.102665 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 13:45:36.255412 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.255333 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8g9k2" event={"ID":"a308d647-b99e-4fb7-b747-32e534eb8617","Type":"ContainerStarted","Data":"0ea205f483aa823a5acbb14dd5d3e5f4130050c1d3d1b3b050007e69a30e125d"} Jul 02 13:45:36.257251 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.257216 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" event={"ID":"0395b743-f6bf-424d-8ae2-c471c9e4c65b","Type":"ContainerStarted","Data":"38bf99c9b4c103527864f84c28a7dd69a4b26915dfadd005faece405e15a5fa9"} Jul 02 13:45:36.260352 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.260327 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:45:36.260790 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.260763 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"fee240a18c686cd439fd57f4a8890a14fc74770703dc52b40c070bdbe75add8f"} Jul 02 13:45:36.260938 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.260853 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"bd38b8ae51c24e662005814c4bc9a2bd266ef56087b6fa1dcd7661206f0eaf6d"} Jul 02 13:45:36.271639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.271601 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8g9k2" podStartSLOduration=4.119507609 podStartE2EDuration="23.271583555s" totalImagesPullingTime="19.152075946s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:36.271215414 +0000 UTC m=+24.666503459" watchObservedRunningTime="2026-07-02 13:45:36.271583555 +0000 UTC m=+24.666871599" Jul 02 13:45:36.391021 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.390988 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-95jv6_351f0159-6a82-4ea3-a98a-bfd340dd2d77/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:36.493682 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.492379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-95jv6_351f0159-6a82-4ea3-a98a-bfd340dd2d77/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:36.601194 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.601004 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-95jv6_351f0159-6a82-4ea3-a98a-bfd340dd2d77/konnectivity-agent/0.log" limit=1024 Jul 02 13:45:36.899898 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.899811 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:36.901013 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:36.900988 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:37.068089 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:37.067992 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T13:45:36.102684219Z","UUID":"0d16d87a-4d57-4c4c-a2a6-f24b691be57d","Handler":null,"Name":"","Endpoint":""} Jul 02 13:45:37.069587 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:37.069567 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 13:45:37.069719 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:37.069609 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 13:45:37.265269 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:37.265225 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" event={"ID":"0395b743-f6bf-424d-8ae2-c471c9e4c65b","Type":"ContainerStarted","Data":"d5fcf3312ad2bb9d7b3e2136eef1636c18cd4ebc1938e37d448762eada766dcf"} Jul 02 13:45:37.265825 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:37.265800 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:37.266125 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:37.266107 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-95jv6" Jul 02 13:45:37.346974 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:37.346916 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mv8jn" podStartSLOduration=2.994610828 podStartE2EDuration="24.346893411s" totalImagesPullingTime="21.352282583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:37.302611851 +0000 UTC m=+25.697899895" watchObservedRunningTime="2026-07-02 13:45:37.346893411 +0000 UTC m=+25.742181457" Jul 02 13:45:38.069464 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:38.069268 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:38.069639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:38.069277 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:38.069639 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:38.069540 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:38.069639 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:38.069325 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:38.069766 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:38.069662 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:38.069766 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:38.069751 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:38.270875 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:38.270828 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:45:38.271664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:38.271625 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"885e2aa73652ef64db9419a020bc3cdcceff62944cf6014c19564707a2423a2a"} Jul 02 13:45:40.068874 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.068678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:40.069531 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.068678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:40.069531 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:40.068982 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:40.069531 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.068681 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:40.069531 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:40.069052 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:40.069531 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:40.069110 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:40.282278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.282210 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:45:40.282617 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.282591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"3f55f26a7cb1ae37bb0760d832a5bd171ded700e37025611cceb7314fc8a8306"} Jul 02 13:45:40.282952 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.282921 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:40.283046 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.282994 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:40.283093 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.283045 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:40.283093 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.283045 2558 scope.go:117] "RemoveContainer" containerID="cbcc018a8a81f47e0eef64d1c2fd48f034a67ee6f1829bd22a4097c67a5758fc" Jul 02 13:45:40.284566 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.284542 2558 generic.go:356] "Generic (PLEG): container finished" podID="5fa98ade-4a63-473a-a09f-6f54d3df0d25" containerID="c6d68dc403020f76d2b1a241a7fea1caba3e789b5927b52ddab638c9478a52fa" exitCode=0 Jul 02 13:45:40.284662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.284580 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" event={"ID":"5fa98ade-4a63-473a-a09f-6f54d3df0d25","Type":"ContainerDied","Data":"c6d68dc403020f76d2b1a241a7fea1caba3e789b5927b52ddab638c9478a52fa"} Jul 02 13:45:40.299635 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.299613 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:40.304250 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:40.304228 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:45:41.290300 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.290277 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:45:41.290714 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.290607 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" event={"ID":"0f54bf60-0685-4668-8fd6-2cf589af983f","Type":"ContainerStarted","Data":"6697a2849ec1e378037f2b4ed3065cda78705138dcd470a753302b845e3cf9e0"} Jul 02 13:45:41.321709 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.321662 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" podStartSLOduration=9.088989113 podStartE2EDuration="28.321646413s" totalImagesPullingTime="19.2326573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:41.320172902 +0000 UTC m=+29.715460947" watchObservedRunningTime="2026-07-02 13:45:41.321646413 +0000 UTC m=+29.716934455" Jul 02 13:45:41.712278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.712248 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pdqvz"] Jul 02 13:45:41.712444 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.712360 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:41.712504 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:41.712453 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:41.712913 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.712890 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5mb6x"] Jul 02 13:45:41.713016 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.712991 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:41.713109 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:41.713087 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:41.714097 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.714079 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nbqdb"] Jul 02 13:45:41.714180 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:41.714160 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:41.714245 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:41.714230 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:42.294957 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:42.294924 2558 generic.go:356] "Generic (PLEG): container finished" podID="5fa98ade-4a63-473a-a09f-6f54d3df0d25" containerID="578deff12c659076369850565953f12b771aa7839b3de78e1b3ab10739354de6" exitCode=0 Jul 02 13:45:42.295381 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:42.294986 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" event={"ID":"5fa98ade-4a63-473a-a09f-6f54d3df0d25","Type":"ContainerDied","Data":"578deff12c659076369850565953f12b771aa7839b3de78e1b3ab10739354de6"} Jul 02 13:45:43.068648 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:43.068466 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:43.068825 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:43.068519 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:43.068825 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:43.068754 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:43.068825 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:43.068813 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:44.069121 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:44.069032 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:44.069563 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:44.069143 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:44.302072 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:44.302034 2558 generic.go:356] "Generic (PLEG): container finished" podID="5fa98ade-4a63-473a-a09f-6f54d3df0d25" containerID="8b7c0dc6fb7ed3fe956c73fbf4d9a902a19e50bc7f9a536e03e6095e9f38dfef" exitCode=0 Jul 02 13:45:44.302211 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:44.302089 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" event={"ID":"5fa98ade-4a63-473a-a09f-6f54d3df0d25","Type":"ContainerDied","Data":"8b7c0dc6fb7ed3fe956c73fbf4d9a902a19e50bc7f9a536e03e6095e9f38dfef"} Jul 02 13:45:45.068819 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:45.068783 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:45.068819 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:45.068824 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:45.069070 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.068938 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:45.069134 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.069092 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:45.816025 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:45.815989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:45.816161 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:45.816048 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:45.816235 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.816179 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:45.816235 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.816181 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:45.816322 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.816238 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret podName:63919b3f-cf3a-4123-8c08-f8523c0cffa1 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:17.81621911 +0000 UTC m=+66.211507135 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret") pod "global-pull-secret-syncer-5mb6x" (UID: "63919b3f-cf3a-4123-8c08-f8523c0cffa1") : object "kube-system"/"original-pull-secret" not registered Jul 02 13:45:45.816322 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.816256 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs podName:ba4897bc-da40-4c75-be21-0c624f676e8a nodeName:}" failed. No retries permitted until 2026-07-02 13:46:17.816246352 +0000 UTC m=+66.211534378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs") pod "network-metrics-daemon-nbqdb" (UID: "ba4897bc-da40-4c75-be21-0c624f676e8a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 13:45:45.917028 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:45.916976 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:45.917217 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.917109 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 13:45:45.917217 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.917135 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 13:45:45.917217 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.917147 2558 projected.go:196] Error preparing data for projected volume kube-api-access-skj9c for pod openshift-network-diagnostics/network-check-target-pdqvz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:45.917217 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:45.917209 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c podName:3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd nodeName:}" failed. No retries permitted until 2026-07-02 13:46:17.917189584 +0000 UTC m=+66.312477620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-skj9c" (UniqueName: "kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c") pod "network-check-target-pdqvz" (UID: "3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 13:45:46.068759 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:46.068661 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:46.068935 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:46.068828 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pdqvz" podUID="3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd" Jul 02 13:45:47.068679 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:47.068644 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:47.069222 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:47.068644 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:47.069222 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:47.068793 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nbqdb" podUID="ba4897bc-da40-4c75-be21-0c624f676e8a" Jul 02 13:45:47.069222 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:47.068856 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5mb6x" podUID="63919b3f-cf3a-4123-8c08-f8523c0cffa1" Jul 02 13:45:47.947534 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:47.947503 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-48.ec2.internal" event="NodeReady" Jul 02 13:45:47.947704 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:47.947648 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 13:45:47.996105 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:47.996072 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6hcdg"] Jul 02 13:45:48.022786 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.022760 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-v7rkx"] Jul 02 13:45:48.022966 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.022914 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.025486 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.025467 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 13:45:48.025610 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.025522 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 13:45:48.025610 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.025468 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pnc7w\"" Jul 02 13:45:48.044791 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.044771 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hcdg"] Jul 02 13:45:48.044936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.044803 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v7rkx"] Jul 02 13:45:48.044936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.044899 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v7rkx" Jul 02 13:45:48.047447 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.047424 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 13:45:48.047575 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.047476 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 13:45:48.047575 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.047546 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 13:45:48.047696 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.047552 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mrnkk\"" Jul 02 13:45:48.069291 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.069269 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:45:48.071954 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.071763 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 13:45:48.071954 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.071774 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7vs28\"" Jul 02 13:45:48.071954 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.071814 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 13:45:48.131105 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.131073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-config-volume\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.131267 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.131130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkp54\" (UniqueName: \"kubernetes.io/projected/8ae65fdd-c373-4d88-8021-474f004b21a1-kube-api-access-fkp54\") pod \"ingress-canary-v7rkx\" (UID: \"8ae65fdd-c373-4d88-8021-474f004b21a1\") " pod="openshift-ingress-canary/ingress-canary-v7rkx" Jul 02 13:45:48.131267 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.131196 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.131267 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.131223 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ae65fdd-c373-4d88-8021-474f004b21a1-cert\") pod \"ingress-canary-v7rkx\" (UID: \"8ae65fdd-c373-4d88-8021-474f004b21a1\") " pod="openshift-ingress-canary/ingress-canary-v7rkx" Jul 02 13:45:48.131267 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.131244 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpm2b\" (UniqueName: \"kubernetes.io/projected/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-kube-api-access-bpm2b\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.131424 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.131278 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-tmp-dir\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.232538 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.232458 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-config-volume\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.232538 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.232503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkp54\" (UniqueName: \"kubernetes.io/projected/8ae65fdd-c373-4d88-8021-474f004b21a1-kube-api-access-fkp54\") pod \"ingress-canary-v7rkx\" (UID: \"8ae65fdd-c373-4d88-8021-474f004b21a1\") " pod="openshift-ingress-canary/ingress-canary-v7rkx" Jul 02 13:45:48.232743 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.232550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.232743 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.232580 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ae65fdd-c373-4d88-8021-474f004b21a1-cert\") pod \"ingress-canary-v7rkx\" (UID: \"8ae65fdd-c373-4d88-8021-474f004b21a1\") " pod="openshift-ingress-canary/ingress-canary-v7rkx" Jul 02 13:45:48.232743 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.232602 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpm2b\" (UniqueName: \"kubernetes.io/projected/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-kube-api-access-bpm2b\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.232743 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.232640 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-tmp-dir\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.232743 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:48.232690 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:48.233019 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:48.232757 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls podName:2d7721b5-b5a0-47d5-915b-60e4dfa052c7 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:48.732739964 +0000 UTC m=+37.128027986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls") pod "dns-default-6hcdg" (UID: "2d7721b5-b5a0-47d5-915b-60e4dfa052c7") : secret "dns-default-metrics-tls" not found Jul 02 13:45:48.233111 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.233094 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-config-volume\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.237383 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.237361 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8ae65fdd-c373-4d88-8021-474f004b21a1-cert\") pod \"ingress-canary-v7rkx\" (UID: \"8ae65fdd-c373-4d88-8021-474f004b21a1\") " pod="openshift-ingress-canary/ingress-canary-v7rkx" Jul 02 13:45:48.241341 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.241305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkp54\" (UniqueName: \"kubernetes.io/projected/8ae65fdd-c373-4d88-8021-474f004b21a1-kube-api-access-fkp54\") pod \"ingress-canary-v7rkx\" (UID: \"8ae65fdd-c373-4d88-8021-474f004b21a1\") " pod="openshift-ingress-canary/ingress-canary-v7rkx" Jul 02 13:45:48.241452 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.241310 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpm2b\" (UniqueName: \"kubernetes.io/projected/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-kube-api-access-bpm2b\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.242649 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.242623 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-tmp-dir\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.353511 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.353478 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-v7rkx" Jul 02 13:45:48.587953 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.587763 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-v7rkx"] Jul 02 13:45:48.671464 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:45:48.671435 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae65fdd_c373_4d88_8021_474f004b21a1.slice/crio-b7343ee31a281bd5d7b14a43d6949385d4cc325e5c50ce2779c1d923631a12ac WatchSource:0}: Error finding container b7343ee31a281bd5d7b14a43d6949385d4cc325e5c50ce2779c1d923631a12ac: Status 404 returned error can't find the container with id b7343ee31a281bd5d7b14a43d6949385d4cc325e5c50ce2779c1d923631a12ac Jul 02 13:45:48.738772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:48.738734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:48.738929 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:48.738911 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:48.738995 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:48.738976 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls podName:2d7721b5-b5a0-47d5-915b-60e4dfa052c7 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:49.738957476 +0000 UTC m=+38.134245514 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls") pod "dns-default-6hcdg" (UID: "2d7721b5-b5a0-47d5-915b-60e4dfa052c7") : secret "dns-default-metrics-tls" not found Jul 02 13:45:49.069014 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.068942 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:45:49.069134 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.068952 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:45:49.073469 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.073449 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 13:45:49.073469 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.073464 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4vzgw\"" Jul 02 13:45:49.074158 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.074143 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 13:45:49.317578 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.317543 2558 generic.go:356] "Generic (PLEG): container finished" podID="5fa98ade-4a63-473a-a09f-6f54d3df0d25" containerID="99f4c65fc105e4a62632d9b58a7a1884f6f570d044289ce92b446d80572fc94c" exitCode=0 Jul 02 13:45:49.317740 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.317635 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" event={"ID":"5fa98ade-4a63-473a-a09f-6f54d3df0d25","Type":"ContainerDied","Data":"99f4c65fc105e4a62632d9b58a7a1884f6f570d044289ce92b446d80572fc94c"} Jul 02 13:45:49.319112 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.319051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v7rkx" event={"ID":"8ae65fdd-c373-4d88-8021-474f004b21a1","Type":"ContainerStarted","Data":"b7343ee31a281bd5d7b14a43d6949385d4cc325e5c50ce2779c1d923631a12ac"} Jul 02 13:45:49.745517 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:49.745475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:49.745694 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:49.745609 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:49.745694 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:49.745675 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls podName:2d7721b5-b5a0-47d5-915b-60e4dfa052c7 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:51.745656349 +0000 UTC m=+40.140944384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls") pod "dns-default-6hcdg" (UID: "2d7721b5-b5a0-47d5-915b-60e4dfa052c7") : secret "dns-default-metrics-tls" not found Jul 02 13:45:50.324271 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:50.324240 2558 generic.go:356] "Generic (PLEG): container finished" podID="5fa98ade-4a63-473a-a09f-6f54d3df0d25" containerID="1810175e0d6dbc521490a328c952f59c85cdbc97db57f9559c507624e899b2dc" exitCode=0 Jul 02 13:45:50.324622 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:50.324306 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" event={"ID":"5fa98ade-4a63-473a-a09f-6f54d3df0d25","Type":"ContainerDied","Data":"1810175e0d6dbc521490a328c952f59c85cdbc97db57f9559c507624e899b2dc"} Jul 02 13:45:51.331083 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:51.330781 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" event={"ID":"5fa98ade-4a63-473a-a09f-6f54d3df0d25","Type":"ContainerStarted","Data":"39d992a80998a74a66b9a243b64921d54696f471c16c15e8203da78d25e0c9f1"} Jul 02 13:45:51.336218 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:51.335688 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-v7rkx" event={"ID":"8ae65fdd-c373-4d88-8021-474f004b21a1","Type":"ContainerStarted","Data":"35a04697a865334c98973ba11b447bcd64db452f3a888526d994a972652b7787"} Jul 02 13:45:51.359019 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:51.358974 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fxjtn" podStartSLOduration=8.15446023 podStartE2EDuration="38.358961269s" totalImagesPullingTime="30.204501039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:51.358726099 +0000 UTC m=+39.754014142" watchObservedRunningTime="2026-07-02 13:45:51.358961269 +0000 UTC m=+39.754249311" Jul 02 13:45:51.377688 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:51.377641 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-v7rkx" podStartSLOduration=1.887574877 podStartE2EDuration="4.377631699s" totalImagesPullingTime="2.490056822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:45:51.377027182 +0000 UTC m=+39.772315228" watchObservedRunningTime="2026-07-02 13:45:51.377631699 +0000 UTC m=+39.772919720" Jul 02 13:45:51.760058 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:51.760027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:51.760227 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:51.760144 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:51.760227 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:51.760198 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls podName:2d7721b5-b5a0-47d5-915b-60e4dfa052c7 nodeName:}" failed. No retries permitted until 2026-07-02 13:45:55.76018379 +0000 UTC m=+44.155471814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls") pod "dns-default-6hcdg" (UID: "2d7721b5-b5a0-47d5-915b-60e4dfa052c7") : secret "dns-default-metrics-tls" not found Jul 02 13:45:55.787575 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:45:55.787541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:45:55.788045 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:55.787692 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:45:55.788045 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:45:55.787766 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls podName:2d7721b5-b5a0-47d5-915b-60e4dfa052c7 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:03.78774983 +0000 UTC m=+52.183037850 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls") pod "dns-default-6hcdg" (UID: "2d7721b5-b5a0-47d5-915b-60e4dfa052c7") : secret "dns-default-metrics-tls" not found Jul 02 13:46:03.846196 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:03.846161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:46:03.846626 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:03.846315 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:46:03.846626 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:03.846381 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls podName:2d7721b5-b5a0-47d5-915b-60e4dfa052c7 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:19.846362725 +0000 UTC m=+68.241650747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls") pod "dns-default-6hcdg" (UID: "2d7721b5-b5a0-47d5-915b-60e4dfa052c7") : secret "dns-default-metrics-tls" not found Jul 02 13:46:12.305544 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:12.305517 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-825xg" Jul 02 13:46:17.839946 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.839905 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:46:17.840308 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.839970 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:46:17.842595 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.842574 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 13:46:17.842797 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.842783 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 13:46:17.850704 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:17.850688 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 13:46:17.850758 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:17.850748 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs podName:ba4897bc-da40-4c75-be21-0c624f676e8a nodeName:}" failed. No retries permitted until 2026-07-02 13:47:21.850731694 +0000 UTC m=+130.246019715 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs") pod "network-metrics-daemon-nbqdb" (UID: "ba4897bc-da40-4c75-be21-0c624f676e8a") : secret "metrics-daemon-secret" not found Jul 02 13:46:17.854271 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.854251 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63919b3f-cf3a-4123-8c08-f8523c0cffa1-original-pull-secret\") pod \"global-pull-secret-syncer-5mb6x\" (UID: \"63919b3f-cf3a-4123-8c08-f8523c0cffa1\") " pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:46:17.882435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.882406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5mb6x" Jul 02 13:46:17.941398 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.941360 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:46:17.944544 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.944378 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 13:46:17.953976 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.953951 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 13:46:17.964517 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:17.964488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skj9c\" (UniqueName: \"kubernetes.io/projected/3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd-kube-api-access-skj9c\") pod \"network-check-target-pdqvz\" (UID: \"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd\") " pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:46:18.000876 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:18.000604 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5mb6x"] Jul 02 13:46:18.005677 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:46:18.005654 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63919b3f_cf3a_4123_8c08_f8523c0cffa1.slice/crio-c582002d8579104096ae731f4580594b539389057b500811fa46c9cdd51fe983 WatchSource:0}: Error finding container c582002d8579104096ae731f4580594b539389057b500811fa46c9cdd51fe983: Status 404 returned error can't find the container with id c582002d8579104096ae731f4580594b539389057b500811fa46c9cdd51fe983 Jul 02 13:46:18.081224 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:18.081200 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7vs28\"" Jul 02 13:46:18.089465 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:18.089445 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:46:18.210740 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:18.210706 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pdqvz"] Jul 02 13:46:18.213795 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:46:18.213774 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1fe649_41e5_4a6f_b042_6c1ac5fd52fd.slice/crio-0bee954618ae175b9433d7a853f9e511c2ff4449403eb67769ca232a7b67433f WatchSource:0}: Error finding container 0bee954618ae175b9433d7a853f9e511c2ff4449403eb67769ca232a7b67433f: Status 404 returned error can't find the container with id 0bee954618ae175b9433d7a853f9e511c2ff4449403eb67769ca232a7b67433f Jul 02 13:46:18.397276 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:18.397200 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pdqvz" event={"ID":"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd","Type":"ContainerStarted","Data":"0bee954618ae175b9433d7a853f9e511c2ff4449403eb67769ca232a7b67433f"} Jul 02 13:46:18.398252 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:18.398231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5mb6x" event={"ID":"63919b3f-cf3a-4123-8c08-f8523c0cffa1","Type":"ContainerStarted","Data":"c582002d8579104096ae731f4580594b539389057b500811fa46c9cdd51fe983"} Jul 02 13:46:19.855528 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:19.855487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:46:19.855945 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:19.855603 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:46:19.855945 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:19.855672 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls podName:2d7721b5-b5a0-47d5-915b-60e4dfa052c7 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:51.855649731 +0000 UTC m=+100.250937769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls") pod "dns-default-6hcdg" (UID: "2d7721b5-b5a0-47d5-915b-60e4dfa052c7") : secret "dns-default-metrics-tls" not found Jul 02 13:46:23.411231 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:23.411195 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pdqvz" event={"ID":"3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd","Type":"ContainerStarted","Data":"111eebf89135f120be63bfcc8a47f16cdbc968c7770e6f499ceb80bbdf18ae69"} Jul 02 13:46:23.411654 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:23.411289 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:46:23.412623 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:23.412599 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5mb6x" event={"ID":"63919b3f-cf3a-4123-8c08-f8523c0cffa1","Type":"ContainerStarted","Data":"183268522e00c261db919b6ca9a7952982594801f094678f1e0fc6ceaa83d94b"} Jul 02 13:46:23.431311 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:23.431269 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pdqvz" podStartSLOduration=65.77776438 podStartE2EDuration="1m10.431256246s" totalImagesPullingTime="4.653491866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:23.430812514 +0000 UTC m=+71.826100559" watchObservedRunningTime="2026-07-02 13:46:23.431256246 +0000 UTC m=+71.826544289" Jul 02 13:46:23.447577 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:23.447537 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5mb6x" podStartSLOduration=65.575146753 podStartE2EDuration="1m10.447523384s" totalImagesPullingTime="4.872376631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:23.446687759 +0000 UTC m=+71.841975803" watchObservedRunningTime="2026-07-02 13:46:23.447523384 +0000 UTC m=+71.842811428" Jul 02 13:46:41.105766 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.105643 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2"] Jul 02 13:46:41.109950 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.109925 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6"] Jul 02 13:46:41.110091 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.110058 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2" Jul 02 13:46:41.112505 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.112490 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.113042 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.113026 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 13:46:41.113121 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.113064 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 13:46:41.113771 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.113754 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-9gqx6\"" Jul 02 13:46:41.114963 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.114947 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z5r7g\"" Jul 02 13:46:41.115790 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.115770 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 13:46:41.115908 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.115809 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 13:46:41.115977 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.115910 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 13:46:41.117263 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.117247 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 13:46:41.121440 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.121420 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2"] Jul 02 13:46:41.127123 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.127104 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6"] Jul 02 13:46:41.194474 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.194450 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.194600 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.194492 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw6jl\" (UniqueName: \"kubernetes.io/projected/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-kube-api-access-xw6jl\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.194600 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.194528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.194695 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.194607 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvhvp\" (UniqueName: \"kubernetes.io/projected/3a51e800-2b2b-4aff-b610-127cd217a01d-kube-api-access-dvhvp\") pod \"volume-data-source-validator-69d9f679db-v29f2\" (UID: \"3a51e800-2b2b-4aff-b610-127cd217a01d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2" Jul 02 13:46:41.295613 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.295587 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvhvp\" (UniqueName: \"kubernetes.io/projected/3a51e800-2b2b-4aff-b610-127cd217a01d-kube-api-access-dvhvp\") pod \"volume-data-source-validator-69d9f679db-v29f2\" (UID: \"3a51e800-2b2b-4aff-b610-127cd217a01d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2" Jul 02 13:46:41.295736 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.295629 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.295736 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.295652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw6jl\" (UniqueName: \"kubernetes.io/projected/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-kube-api-access-xw6jl\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.295736 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.295675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.295992 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:41.295760 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:41.295992 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:41.295820 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls podName:903b4f1f-5f6e-46c1-9df1-d1adf2424f88 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:41.795801378 +0000 UTC m=+90.191089399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-khkj6" (UID: "903b4f1f-5f6e-46c1-9df1-d1adf2424f88") : secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:41.296299 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.296280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.308751 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.308731 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvhvp\" (UniqueName: \"kubernetes.io/projected/3a51e800-2b2b-4aff-b610-127cd217a01d-kube-api-access-dvhvp\") pod \"volume-data-source-validator-69d9f679db-v29f2\" (UID: \"3a51e800-2b2b-4aff-b610-127cd217a01d\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2" Jul 02 13:46:41.311117 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.311097 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw6jl\" (UniqueName: \"kubernetes.io/projected/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-kube-api-access-xw6jl\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.323971 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.323949 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7664884b94-c6xc8"] Jul 02 13:46:41.327649 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.327629 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.331217 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.331193 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 13:46:41.331556 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.331541 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 13:46:41.331625 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.331592 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dkwdr\"" Jul 02 13:46:41.331932 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.331916 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 13:46:41.337150 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.337134 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 13:46:41.349403 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.349380 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7664884b94-c6xc8"] Jul 02 13:46:41.396514 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.396465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6887\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-kube-api-access-c6887\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.396514 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.396494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-registry-certificates\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.396634 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.396524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/807f0b42-d175-448f-9116-a3e6e7836969-ca-trust-extracted\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.396634 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.396565 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-trusted-ca\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.396721 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.396647 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.396721 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.396669 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-image-registry-private-configuration\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.396721 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.396686 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-installation-pull-secrets\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.396721 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.396701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-bound-sa-token\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.420498 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.420476 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2" Jul 02 13:46:41.497363 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.497331 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.497478 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.497379 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-image-registry-private-configuration\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.497478 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.497413 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-installation-pull-secrets\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.497478 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.497439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-bound-sa-token\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.497635 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.497479 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6887\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-kube-api-access-c6887\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.497635 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:41.497500 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:46:41.497635 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.497512 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-registry-certificates\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.497635 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:41.497523 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7664884b94-c6xc8: secret "image-registry-tls" not found Jul 02 13:46:41.497635 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.497567 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/807f0b42-d175-448f-9116-a3e6e7836969-ca-trust-extracted\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.497635 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:41.497585 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls podName:807f0b42-d175-448f-9116-a3e6e7836969 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:41.997562748 +0000 UTC m=+90.392850787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls") pod "image-registry-7664884b94-c6xc8" (UID: "807f0b42-d175-448f-9116-a3e6e7836969") : secret "image-registry-tls" not found Jul 02 13:46:41.497635 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.497620 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-trusted-ca\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.498493 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.498429 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/807f0b42-d175-448f-9116-a3e6e7836969-ca-trust-extracted\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.498724 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.498701 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-registry-certificates\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.499201 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.499177 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-trusted-ca\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.500382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.500346 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-installation-pull-secrets\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.500477 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.500456 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-image-registry-private-configuration\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.506533 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.506506 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6887\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-kube-api-access-c6887\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.507279 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.507258 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-bound-sa-token\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:41.539742 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.539713 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2"] Jul 02 13:46:41.800483 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:41.800445 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:41.800657 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:41.800593 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:41.800710 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:41.800660 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls podName:903b4f1f-5f6e-46c1-9df1-d1adf2424f88 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:42.800644828 +0000 UTC m=+91.195932849 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-khkj6" (UID: "903b4f1f-5f6e-46c1-9df1-d1adf2424f88") : secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:42.001947 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:42.001916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:42.002143 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:42.002065 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:46:42.002143 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:42.002080 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7664884b94-c6xc8: secret "image-registry-tls" not found Jul 02 13:46:42.002143 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:42.002132 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls podName:807f0b42-d175-448f-9116-a3e6e7836969 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:43.002114412 +0000 UTC m=+91.397402440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls") pod "image-registry-7664884b94-c6xc8" (UID: "807f0b42-d175-448f-9116-a3e6e7836969") : secret "image-registry-tls" not found Jul 02 13:46:42.460373 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:42.460299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2" event={"ID":"3a51e800-2b2b-4aff-b610-127cd217a01d","Type":"ContainerStarted","Data":"82126b9dc3cdfa852a1e4b4c38877adb00bb9634ce2964aa979bc42391b3cce7"} Jul 02 13:46:42.808034 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:42.807934 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:42.808204 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:42.808091 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:42.808204 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:42.808160 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls podName:903b4f1f-5f6e-46c1-9df1-d1adf2424f88 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:44.808142602 +0000 UTC m=+93.203430632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-khkj6" (UID: "903b4f1f-5f6e-46c1-9df1-d1adf2424f88") : secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:43.009544 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:43.009509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:43.009692 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:43.009657 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:46:43.009692 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:43.009676 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7664884b94-c6xc8: secret "image-registry-tls" not found Jul 02 13:46:43.009761 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:43.009729 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls podName:807f0b42-d175-448f-9116-a3e6e7836969 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:45.009712899 +0000 UTC m=+93.405000920 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls") pod "image-registry-7664884b94-c6xc8" (UID: "807f0b42-d175-448f-9116-a3e6e7836969") : secret "image-registry-tls" not found Jul 02 13:46:43.464596 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:43.464557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2" event={"ID":"3a51e800-2b2b-4aff-b610-127cd217a01d","Type":"ContainerStarted","Data":"43a34b6c2d6d02d07b603bb9a7d86010094f4cf1c13673d72cedbeb2dd65409d"} Jul 02 13:46:43.488581 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:43.488531 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-v29f2" podStartSLOduration=1.157005343 podStartE2EDuration="2.488517816s" totalImagesPullingTime="1.331512473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:43.487970412 +0000 UTC m=+91.883258476" watchObservedRunningTime="2026-07-02 13:46:43.488517816 +0000 UTC m=+91.883805870" Jul 02 13:46:44.821415 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:44.821359 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:44.821810 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:44.821511 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:44.821810 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:44.821581 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls podName:903b4f1f-5f6e-46c1-9df1-d1adf2424f88 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:48.821564007 +0000 UTC m=+97.216852028 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-khkj6" (UID: "903b4f1f-5f6e-46c1-9df1-d1adf2424f88") : secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:45.022598 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.022550 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:45.022778 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.022704 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:46:45.022778 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.022727 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7664884b94-c6xc8: secret "image-registry-tls" not found Jul 02 13:46:45.022863 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.022782 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls podName:807f0b42-d175-448f-9116-a3e6e7836969 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:49.022766112 +0000 UTC m=+97.418054133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls") pod "image-registry-7664884b94-c6xc8" (UID: "807f0b42-d175-448f-9116-a3e6e7836969") : secret "image-registry-tls" not found Jul 02 13:46:45.267282 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.267247 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n7k8v"] Jul 02 13:46:45.270301 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.270285 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.288527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.288506 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 13:46:45.293383 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.293368 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 13:46:45.294406 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.294392 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 13:46:45.294406 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.294402 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 13:46:45.295206 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.295185 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmzxj\"" Jul 02 13:46:45.307513 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.307490 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n7k8v"] Jul 02 13:46:45.324724 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.324699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlgcr\" (UniqueName: \"kubernetes.io/projected/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-api-access-mlgcr\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.324824 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.324742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.324824 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.324763 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-crio-socket\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.324918 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.324888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-data-volume\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.324964 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.324930 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.426053 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.426015 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-data-volume\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.426171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.426083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.426171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.426114 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlgcr\" (UniqueName: \"kubernetes.io/projected/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-api-access-mlgcr\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.426171 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.426163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.426293 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.426193 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-crio-socket\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.426293 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.426218 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:45.426293 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.426287 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:45.926268378 +0000 UTC m=+94.321556418 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : configmap "kube-rbac-proxy" not found Jul 02 13:46:45.426408 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.426309 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-crio-socket\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.426408 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.426312 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:45.426408 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.426389 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:45.926374222 +0000 UTC m=+94.321662255 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:45.426408 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.426391 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-data-volume\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.435653 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.435629 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlgcr\" (UniqueName: \"kubernetes.io/projected/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-api-access-mlgcr\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.930354 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.930316 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.930747 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:45.930392 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:45.930747 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.930453 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:45.930747 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.930465 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:45.930747 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.930503 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:46.930489329 +0000 UTC m=+95.325777355 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : configmap "kube-rbac-proxy" not found Jul 02 13:46:45.930747 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:45.930528 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:46.930512648 +0000 UTC m=+95.325800668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:46.715672 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.715642 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb"] Jul 02 13:46:46.718509 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.718493 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" Jul 02 13:46:46.721086 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.721062 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-65b86\"" Jul 02 13:46:46.721572 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.721553 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 02 13:46:46.721656 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.721553 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 02 13:46:46.731290 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.731268 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb"] Jul 02 13:46:46.736593 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.736572 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b95vg\" (UniqueName: \"kubernetes.io/projected/1b55c20f-0a5d-4cbc-893b-6fba6b7ca618-kube-api-access-b95vg\") pod \"migrator-786f9fbc5-9zgbb\" (UID: \"1b55c20f-0a5d-4cbc-893b-6fba6b7ca618\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" Jul 02 13:46:46.837799 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.837768 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b95vg\" (UniqueName: \"kubernetes.io/projected/1b55c20f-0a5d-4cbc-893b-6fba6b7ca618-kube-api-access-b95vg\") pod \"migrator-786f9fbc5-9zgbb\" (UID: \"1b55c20f-0a5d-4cbc-893b-6fba6b7ca618\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" Jul 02 13:46:46.846630 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.846600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b95vg\" (UniqueName: \"kubernetes.io/projected/1b55c20f-0a5d-4cbc-893b-6fba6b7ca618-kube-api-access-b95vg\") pod \"migrator-786f9fbc5-9zgbb\" (UID: \"1b55c20f-0a5d-4cbc-893b-6fba6b7ca618\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" Jul 02 13:46:46.938926 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.938892 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:46.939260 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:46.938947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:46.939260 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:46.939010 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:46.939260 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:46.939036 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:46.939260 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:46.939073 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:48.939057082 +0000 UTC m=+97.334345102 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : configmap "kube-rbac-proxy" not found Jul 02 13:46:46.939260 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:46.939087 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:48.939081406 +0000 UTC m=+97.334369427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:47.027429 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:47.027346 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" Jul 02 13:46:47.149138 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:47.149116 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb"] Jul 02 13:46:47.151590 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:46:47.151566 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b55c20f_0a5d_4cbc_893b_6fba6b7ca618.slice/crio-9221becb13c7329237ed21dab64012ffe4cc885ac739a03e29ed4cf1eca73e8f WatchSource:0}: Error finding container 9221becb13c7329237ed21dab64012ffe4cc885ac739a03e29ed4cf1eca73e8f: Status 404 returned error can't find the container with id 9221becb13c7329237ed21dab64012ffe4cc885ac739a03e29ed4cf1eca73e8f Jul 02 13:46:47.249677 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:47.249657 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znnmt_cbcd4a1e-b369-4587-9a15-c87a6d1121ee/dns-node-resolver/0.log" Jul 02 13:46:47.474948 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:47.474914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" event={"ID":"1b55c20f-0a5d-4cbc-893b-6fba6b7ca618","Type":"ContainerStarted","Data":"9221becb13c7329237ed21dab64012ffe4cc885ac739a03e29ed4cf1eca73e8f"} Jul 02 13:46:48.051337 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:48.051314 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7rlc8_5de12f9a-dfde-4118-b292-a9d0555206ea/node-ca/0.log" Jul 02 13:46:48.480936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:48.480908 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" event={"ID":"1b55c20f-0a5d-4cbc-893b-6fba6b7ca618","Type":"ContainerStarted","Data":"4fa551101556267304b865ad020dbca1d8f57544457b96686baac81ace773c8e"} Jul 02 13:46:48.481067 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:48.480985 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" event={"ID":"1b55c20f-0a5d-4cbc-893b-6fba6b7ca618","Type":"ContainerStarted","Data":"5edcbe4a8a03db03b3a60e61166c9d2f059229e6148ee4678959fcb611cbf711"} Jul 02 13:46:48.498137 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:48.498091 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-9zgbb" podStartSLOduration=1.39414397 podStartE2EDuration="2.498076243s" totalImagesPullingTime="1.103932273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:48.497227883 +0000 UTC m=+96.892515928" watchObservedRunningTime="2026-07-02 13:46:48.498076243 +0000 UTC m=+96.893364286" Jul 02 13:46:48.855018 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:48.854989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:48.855201 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:48.855155 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:48.855267 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:48.855235 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls podName:903b4f1f-5f6e-46c1-9df1-d1adf2424f88 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:56.855213055 +0000 UTC m=+105.250501091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-khkj6" (UID: "903b4f1f-5f6e-46c1-9df1-d1adf2424f88") : secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:48.956359 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:48.956309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:48.956540 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:48.956395 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:48.956540 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:48.956427 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:48.956540 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:48.956484 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:52.956469347 +0000 UTC m=+101.351757368 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : configmap "kube-rbac-proxy" not found Jul 02 13:46:48.956540 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:48.956515 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:48.956705 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:48.956572 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:52.95655625 +0000 UTC m=+101.351844294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:49.056890 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:49.056860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:49.057297 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:49.057012 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 13:46:49.057297 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:49.057032 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7664884b94-c6xc8: secret "image-registry-tls" not found Jul 02 13:46:49.057297 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:49.057090 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls podName:807f0b42-d175-448f-9116-a3e6e7836969 nodeName:}" failed. No retries permitted until 2026-07-02 13:46:57.057072955 +0000 UTC m=+105.452360978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls") pod "image-registry-7664884b94-c6xc8" (UID: "807f0b42-d175-448f-9116-a3e6e7836969") : secret "image-registry-tls" not found Jul 02 13:46:49.252190 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:49.252161 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v7rkx_8ae65fdd-c373-4d88-8021-474f004b21a1/serve-healthcheck-canary/0.log" Jul 02 13:46:51.879191 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:51.879159 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:46:51.879652 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:51.879319 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 13:46:51.879652 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:51.879395 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls podName:2d7721b5-b5a0-47d5-915b-60e4dfa052c7 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:55.879376681 +0000 UTC m=+164.274664703 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls") pod "dns-default-6hcdg" (UID: "2d7721b5-b5a0-47d5-915b-60e4dfa052c7") : secret "dns-default-metrics-tls" not found Jul 02 13:46:52.987276 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:52.987241 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:52.987635 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:52.987313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:46:52.987635 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:52.987381 2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 13:46:52.987635 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:52.987388 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:46:52.987635 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:52.987436 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:00.98742186 +0000 UTC m=+109.382709881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : configmap "kube-rbac-proxy" not found Jul 02 13:46:52.987635 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:52.987449 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:00.987443492 +0000 UTC m=+109.382731513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : secret "insights-runtime-extractor-tls" not found Jul 02 13:46:54.418271 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:54.418243 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pdqvz" Jul 02 13:46:56.916070 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:56.916040 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:46:56.916456 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:56.916144 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:56.916456 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:46:56.916200 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls podName:903b4f1f-5f6e-46c1-9df1-d1adf2424f88 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:12.916186787 +0000 UTC m=+121.311474808 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-khkj6" (UID: "903b4f1f-5f6e-46c1-9df1-d1adf2424f88") : secret "cluster-monitoring-operator-tls" not found Jul 02 13:46:57.117126 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:57.117090 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:57.119405 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:57.119377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"image-registry-7664884b94-c6xc8\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:57.235727 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:57.235624 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:57.363707 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:57.363673 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7664884b94-c6xc8"] Jul 02 13:46:57.368747 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:46:57.368725 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod807f0b42_d175_448f_9116_a3e6e7836969.slice/crio-de859a723976decb7678f228f630e7f084dcbc3c0de747ab2a75476e1145a083 WatchSource:0}: Error finding container de859a723976decb7678f228f630e7f084dcbc3c0de747ab2a75476e1145a083: Status 404 returned error can't find the container with id de859a723976decb7678f228f630e7f084dcbc3c0de747ab2a75476e1145a083 Jul 02 13:46:57.510461 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:57.510375 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" event={"ID":"807f0b42-d175-448f-9116-a3e6e7836969","Type":"ContainerStarted","Data":"023c8914c9e705e18ae042cadf582784917233813471e44d3a1f6400710251ff"} Jul 02 13:46:57.510461 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:57.510422 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" event={"ID":"807f0b42-d175-448f-9116-a3e6e7836969","Type":"ContainerStarted","Data":"de859a723976decb7678f228f630e7f084dcbc3c0de747ab2a75476e1145a083"} Jul 02 13:46:57.510461 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:57.510452 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:46:57.535048 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:46:57.534998 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" podStartSLOduration=16.534981653 podStartE2EDuration="16.534981653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:46:57.534098579 +0000 UTC m=+105.929386622" watchObservedRunningTime="2026-07-02 13:46:57.534981653 +0000 UTC m=+105.930269695" Jul 02 13:47:01.041853 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:01.041813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:47:01.042258 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:01.041903 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:47:01.042258 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:01.041959 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 13:47:01.042258 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:01.042022 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls podName:64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:17.042006483 +0000 UTC m=+125.437294507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7k8v" (UID: "64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37") : secret "insights-runtime-extractor-tls" not found Jul 02 13:47:01.042457 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:01.042436 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:47:12.925330 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:12.925291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:47:12.927523 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:12.927495 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/903b4f1f-5f6e-46c1-9df1-d1adf2424f88-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-khkj6\" (UID: \"903b4f1f-5f6e-46c1-9df1-d1adf2424f88\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:47:13.229084 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.229015 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z5r7g\"" Jul 02 13:47:13.236543 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.236524 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" Jul 02 13:47:13.369804 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.369777 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6"] Jul 02 13:47:13.372700 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:13.372659 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod903b4f1f_5f6e_46c1_9df1_d1adf2424f88.slice/crio-a66c542e807d7d06138d037d713acdca58283bc1ef46d13f074cff292633703f WatchSource:0}: Error finding container a66c542e807d7d06138d037d713acdca58283bc1ef46d13f074cff292633703f: Status 404 returned error can't find the container with id a66c542e807d7d06138d037d713acdca58283bc1ef46d13f074cff292633703f Jul 02 13:47:13.473464 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.473436 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz"] Jul 02 13:47:13.477827 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.477812 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.481856 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.481792 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 02 13:47:13.481856 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.481823 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 13:47:13.482307 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.482291 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 02 13:47:13.482741 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.482727 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 02 13:47:13.482885 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.482867 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 02 13:47:13.484410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.484153 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 13:47:13.490202 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.490186 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 13:47:13.505350 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.505328 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz"] Jul 02 13:47:13.526339 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.526318 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7664884b94-c6xc8"] Jul 02 13:47:13.529144 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.529114 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-ca\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.529244 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.529172 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.529244 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.529203 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.529325 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.529256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-hub\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.529325 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.529300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d127e25-35fd-4f3e-ad46-34a882460579-additional-service-ca\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.529398 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.529327 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9lvg\" (UniqueName: \"kubernetes.io/projected/4d127e25-35fd-4f3e-ad46-34a882460579-kube-api-access-h9lvg\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.530649 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.530624 2558 patch_prober.go:28] interesting pod/image-registry-7664884b94-c6xc8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 13:47:13.530742 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.530681 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" podUID="807f0b42-d175-448f-9116-a3e6e7836969" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 13:47:13.557473 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.557448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" event={"ID":"903b4f1f-5f6e-46c1-9df1-d1adf2424f88","Type":"ContainerStarted","Data":"a66c542e807d7d06138d037d713acdca58283bc1ef46d13f074cff292633703f"} Jul 02 13:47:13.629596 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.629561 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-ca\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.629813 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.629617 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.629813 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.629647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.629813 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.629712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-hub\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.629813 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.629741 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d127e25-35fd-4f3e-ad46-34a882460579-additional-service-ca\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.630070 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.629897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9lvg\" (UniqueName: \"kubernetes.io/projected/4d127e25-35fd-4f3e-ad46-34a882460579-kube-api-access-h9lvg\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.630420 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.630398 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d127e25-35fd-4f3e-ad46-34a882460579-additional-service-ca\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.632245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.632224 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.632426 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.632406 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.632527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.632508 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-ca\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.632586 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.632573 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4d127e25-35fd-4f3e-ad46-34a882460579-hub\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.652968 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.652946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9lvg\" (UniqueName: \"kubernetes.io/projected/4d127e25-35fd-4f3e-ad46-34a882460579-kube-api-access-h9lvg\") pod \"cluster-proxy-proxy-agent-749854f95f-qzsqz\" (UID: \"4d127e25-35fd-4f3e-ad46-34a882460579\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.801647 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.801573 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" Jul 02 13:47:13.950331 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:13.950302 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz"] Jul 02 13:47:13.953612 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:13.953590 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d127e25_35fd_4f3e_ad46_34a882460579.slice/crio-efc8c4b796d791cf51365f420fd3d1bbf888103ef5485b3a9b8d1b2392da425b WatchSource:0}: Error finding container efc8c4b796d791cf51365f420fd3d1bbf888103ef5485b3a9b8d1b2392da425b: Status 404 returned error can't find the container with id efc8c4b796d791cf51365f420fd3d1bbf888103ef5485b3a9b8d1b2392da425b Jul 02 13:47:14.562225 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:14.562185 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" event={"ID":"4d127e25-35fd-4f3e-ad46-34a882460579","Type":"ContainerStarted","Data":"efc8c4b796d791cf51365f420fd3d1bbf888103ef5485b3a9b8d1b2392da425b"} Jul 02 13:47:15.568816 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:15.568781 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" event={"ID":"903b4f1f-5f6e-46c1-9df1-d1adf2424f88","Type":"ContainerStarted","Data":"4b52e4d28cb2dd789201f77a315af099bb9455e9a2a23c6550033d7448c355be"} Jul 02 13:47:15.590664 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:15.590557 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-khkj6" podStartSLOduration=32.630875511 podStartE2EDuration="34.590537108s" totalImagesPullingTime="1.959661597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:46:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:15.588534681 +0000 UTC m=+123.983822725" watchObservedRunningTime="2026-07-02 13:47:15.590537108 +0000 UTC m=+123.985825152" Jul 02 13:47:17.059756 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:17.059717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:47:17.062119 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:17.062092 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7k8v\" (UID: \"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37\") " pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:47:17.082090 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:17.082070 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-dmzxj\"" Jul 02 13:47:17.089592 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:17.089568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n7k8v" Jul 02 13:47:17.663808 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:17.663755 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n7k8v"] Jul 02 13:47:17.669805 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:17.669781 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b71fe7_2e62_4b1d_a73b_dbb7f4d4ea37.slice/crio-4a9609a1f4ef9fcf882a3048748ea12b068b62ff10683959eb3032add3b0085f WatchSource:0}: Error finding container 4a9609a1f4ef9fcf882a3048748ea12b068b62ff10683959eb3032add3b0085f: Status 404 returned error can't find the container with id 4a9609a1f4ef9fcf882a3048748ea12b068b62ff10683959eb3032add3b0085f Jul 02 13:47:18.584264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:18.584223 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" event={"ID":"4d127e25-35fd-4f3e-ad46-34a882460579","Type":"ContainerStarted","Data":"f988da735396300a983033f853d1eefd938e3911ed916c4687a6b6ef2214e855"} Jul 02 13:47:18.584955 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:18.584282 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" event={"ID":"4d127e25-35fd-4f3e-ad46-34a882460579","Type":"ContainerStarted","Data":"3541398f8e5db1dac0f8e7da73123a00ef7c2701305457300c05389df98e0e79"} Jul 02 13:47:18.584955 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:18.584303 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" event={"ID":"4d127e25-35fd-4f3e-ad46-34a882460579","Type":"ContainerStarted","Data":"ff69b6ce8a3c2f0669d8e34eedf81d9b0ca17a19e204be1ec1caaaec0611c831"} Jul 02 13:47:18.586309 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:18.586275 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n7k8v" event={"ID":"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37","Type":"ContainerStarted","Data":"4a9609a1f4ef9fcf882a3048748ea12b068b62ff10683959eb3032add3b0085f"} Jul 02 13:47:18.604889 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:18.604010 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-749854f95f-qzsqz" podStartSLOduration=1.953297396 podStartE2EDuration="5.603992521s" totalImagesPullingTime="3.650695125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:18.603033258 +0000 UTC m=+126.998321298" watchObservedRunningTime="2026-07-02 13:47:18.603992521 +0000 UTC m=+126.999280565" Jul 02 13:47:21.597203 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:21.597170 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n7k8v" event={"ID":"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37","Type":"ContainerStarted","Data":"4f478662be7da739da5eb3e9ec39bdc6f3a6abb2a8a9b177093c21a55886a237"} Jul 02 13:47:21.897563 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:21.897530 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:47:21.899818 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:21.899794 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4897bc-da40-4c75-be21-0c624f676e8a-metrics-certs\") pod \"network-metrics-daemon-nbqdb\" (UID: \"ba4897bc-da40-4c75-be21-0c624f676e8a\") " pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:47:22.080199 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:22.080174 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4vzgw\"" Jul 02 13:47:22.087896 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:22.087876 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nbqdb" Jul 02 13:47:22.222236 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:22.222206 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nbqdb"] Jul 02 13:47:22.225365 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:22.225339 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4897bc_da40_4c75_be21_0c624f676e8a.slice/crio-18b9cfb16d2c24a6c3a7e1aac6c8533c5fd28c7dc20a9da5de4b1abe5390e166 WatchSource:0}: Error finding container 18b9cfb16d2c24a6c3a7e1aac6c8533c5fd28c7dc20a9da5de4b1abe5390e166: Status 404 returned error can't find the container with id 18b9cfb16d2c24a6c3a7e1aac6c8533c5fd28c7dc20a9da5de4b1abe5390e166 Jul 02 13:47:22.602327 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:22.602280 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nbqdb" event={"ID":"ba4897bc-da40-4c75-be21-0c624f676e8a","Type":"ContainerStarted","Data":"18b9cfb16d2c24a6c3a7e1aac6c8533c5fd28c7dc20a9da5de4b1abe5390e166"} Jul 02 13:47:22.604154 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:22.604123 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n7k8v" event={"ID":"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37","Type":"ContainerStarted","Data":"a9f48c49dc7463d58f2f782d3ca7a092bede0174a3b4c750e2b3af88c0d5e252"} Jul 02 13:47:23.533056 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:23.533023 2558 patch_prober.go:28] interesting pod/image-registry-7664884b94-c6xc8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 13:47:23.533177 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:23.533083 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" podUID="807f0b42-d175-448f-9116-a3e6e7836969" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 13:47:23.610220 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:23.610187 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nbqdb" event={"ID":"ba4897bc-da40-4c75-be21-0c624f676e8a","Type":"ContainerStarted","Data":"1a91d180fbb61c5f59cb285096f5a8edb78e3ad4fdd8abafb288081c05a59cde"} Jul 02 13:47:23.610668 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:23.610280 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nbqdb" event={"ID":"ba4897bc-da40-4c75-be21-0c624f676e8a","Type":"ContainerStarted","Data":"4ddf5a3ec78caeb7b6f40eb5058fed9e95381f95b52a5e8ed59ca4602fd6c895"} Jul 02 13:47:23.631693 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:23.631619 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nbqdb" podStartSLOduration=129.4602871 podStartE2EDuration="2m10.631605098s" totalImagesPullingTime="1.171317998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:45:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:23.630099329 +0000 UTC m=+132.025387409" watchObservedRunningTime="2026-07-02 13:47:23.631605098 +0000 UTC m=+132.026893142" Jul 02 13:47:25.618744 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:25.618707 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n7k8v" event={"ID":"64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37","Type":"ContainerStarted","Data":"4c5718b3ee2ae73f21f4574d130bad5c65a156e6481fe1a2521ca5e6060c6840"} Jul 02 13:47:25.656288 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:25.656238 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n7k8v" podStartSLOduration=33.80302422 podStartE2EDuration="40.656221878s" totalImagesPullingTime="6.853197658s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 13:46:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:25.654529027 +0000 UTC m=+134.049817072" watchObservedRunningTime="2026-07-02 13:47:25.656221878 +0000 UTC m=+134.051509921" Jul 02 13:47:33.531175 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:33.531142 2558 patch_prober.go:28] interesting pod/image-registry-7664884b94-c6xc8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 02 13:47:33.531533 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:33.531201 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" podUID="807f0b42-d175-448f-9116-a3e6e7836969" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 13:47:38.545993 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.545949 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" podUID="807f0b42-d175-448f-9116-a3e6e7836969" containerName="registry" containerID="cri-o://023c8914c9e705e18ae042cadf582784917233813471e44d3a1f6400710251ff" gracePeriod=30 Jul 02 13:47:38.665212 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.665176 2558 generic.go:356] "Generic (PLEG): container finished" podID="807f0b42-d175-448f-9116-a3e6e7836969" containerID="023c8914c9e705e18ae042cadf582784917233813471e44d3a1f6400710251ff" exitCode=0 Jul 02 13:47:38.665338 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.665242 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" event={"ID":"807f0b42-d175-448f-9116-a3e6e7836969","Type":"ContainerDied","Data":"023c8914c9e705e18ae042cadf582784917233813471e44d3a1f6400710251ff"} Jul 02 13:47:38.778184 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.778162 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:47:38.916247 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.916217 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-installation-pull-secrets\") pod \"807f0b42-d175-448f-9116-a3e6e7836969\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " Jul 02 13:47:38.916467 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.916275 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/807f0b42-d175-448f-9116-a3e6e7836969-ca-trust-extracted\") pod \"807f0b42-d175-448f-9116-a3e6e7836969\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " Jul 02 13:47:38.916467 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.916299 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-bound-sa-token\") pod \"807f0b42-d175-448f-9116-a3e6e7836969\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " Jul 02 13:47:38.916467 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.916327 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") pod \"807f0b42-d175-448f-9116-a3e6e7836969\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " Jul 02 13:47:38.916467 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.916363 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-registry-certificates\") pod \"807f0b42-d175-448f-9116-a3e6e7836969\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " Jul 02 13:47:38.916467 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.916400 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c6887\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-kube-api-access-c6887\") pod \"807f0b42-d175-448f-9116-a3e6e7836969\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " Jul 02 13:47:38.916467 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.916426 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-trusted-ca\") pod \"807f0b42-d175-448f-9116-a3e6e7836969\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " Jul 02 13:47:38.916467 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.916464 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-image-registry-private-configuration\") pod \"807f0b42-d175-448f-9116-a3e6e7836969\" (UID: \"807f0b42-d175-448f-9116-a3e6e7836969\") " Jul 02 13:47:38.917141 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.917075 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "807f0b42-d175-448f-9116-a3e6e7836969" (UID: "807f0b42-d175-448f-9116-a3e6e7836969"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:47:38.917141 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.917083 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "807f0b42-d175-448f-9116-a3e6e7836969" (UID: "807f0b42-d175-448f-9116-a3e6e7836969"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:47:38.919056 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.919011 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "807f0b42-d175-448f-9116-a3e6e7836969" (UID: "807f0b42-d175-448f-9116-a3e6e7836969"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:47:38.919056 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.919043 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "807f0b42-d175-448f-9116-a3e6e7836969" (UID: "807f0b42-d175-448f-9116-a3e6e7836969"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:47:38.919229 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.919068 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "807f0b42-d175-448f-9116-a3e6e7836969" (UID: "807f0b42-d175-448f-9116-a3e6e7836969"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:47:38.919229 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.919089 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "807f0b42-d175-448f-9116-a3e6e7836969" (UID: "807f0b42-d175-448f-9116-a3e6e7836969"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:47:38.919229 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.919212 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-kube-api-access-c6887" (OuterVolumeSpecName: "kube-api-access-c6887") pod "807f0b42-d175-448f-9116-a3e6e7836969" (UID: "807f0b42-d175-448f-9116-a3e6e7836969"). InnerVolumeSpecName "kube-api-access-c6887". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:47:38.925018 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:38.924993 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/807f0b42-d175-448f-9116-a3e6e7836969-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "807f0b42-d175-448f-9116-a3e6e7836969" (UID: "807f0b42-d175-448f-9116-a3e6e7836969"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:47:39.017819 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.017777 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c6887\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-kube-api-access-c6887\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:47:39.017819 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.017815 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-trusted-ca\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:47:39.017819 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.017825 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-image-registry-private-configuration\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:47:39.018047 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.017858 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/807f0b42-d175-448f-9116-a3e6e7836969-installation-pull-secrets\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:47:39.018047 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.017870 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/807f0b42-d175-448f-9116-a3e6e7836969-ca-trust-extracted\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:47:39.018047 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.017878 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-bound-sa-token\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:47:39.018047 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.017886 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/807f0b42-d175-448f-9116-a3e6e7836969-registry-tls\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:47:39.018047 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.017893 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/807f0b42-d175-448f-9116-a3e6e7836969-registry-certificates\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:47:39.484442 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.484406 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg"] Jul 02 13:47:39.484651 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.484640 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="807f0b42-d175-448f-9116-a3e6e7836969" containerName="registry" Jul 02 13:47:39.484694 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.484653 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="807f0b42-d175-448f-9116-a3e6e7836969" containerName="registry" Jul 02 13:47:39.484724 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.484698 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="807f0b42-d175-448f-9116-a3e6e7836969" containerName="registry" Jul 02 13:47:39.489304 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.489289 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.492807 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.492785 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 13:47:39.492807 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.492792 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 02 13:47:39.492807 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.492787 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 02 13:47:39.493462 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.493445 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-5t5wk\"" Jul 02 13:47:39.508339 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.505825 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg"] Jul 02 13:47:39.534023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.534000 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tqzrt"] Jul 02 13:47:39.536788 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.536773 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.539496 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.539475 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 13:47:39.539581 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.539539 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mczhp\"" Jul 02 13:47:39.540048 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.540030 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 13:47:39.540159 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.540059 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 13:47:39.622903 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.622876 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.622905 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-wtmp\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.622923 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.622939 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-tls\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623014 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ba2697a-8ef7-4539-b727-1e3b33bbd966-metrics-client-ca\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5xtc\" (UniqueName: \"kubernetes.io/projected/4ba2697a-8ef7-4539-b727-1e3b33bbd966-kube-api-access-f5xtc\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623094 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-sys\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52lsb\" (UniqueName: \"kubernetes.io/projected/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-kube-api-access-52lsb\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623144 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623164 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-textfile\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623198 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623194 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-root\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.623543 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.623209 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.669694 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.669666 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" event={"ID":"807f0b42-d175-448f-9116-a3e6e7836969","Type":"ContainerDied","Data":"de859a723976decb7678f228f630e7f084dcbc3c0de747ab2a75476e1145a083"} Jul 02 13:47:39.669775 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.669721 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7664884b94-c6xc8" Jul 02 13:47:39.669775 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.669725 2558 scope.go:117] "RemoveContainer" containerID="023c8914c9e705e18ae042cadf582784917233813471e44d3a1f6400710251ff" Jul 02 13:47:39.699305 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.699280 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7664884b94-c6xc8"] Jul 02 13:47:39.705564 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.705548 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7664884b94-c6xc8"] Jul 02 13:47:39.723622 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723604 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5xtc\" (UniqueName: \"kubernetes.io/projected/4ba2697a-8ef7-4539-b727-1e3b33bbd966-kube-api-access-f5xtc\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.723712 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.723712 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-sys\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.723712 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723667 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52lsb\" (UniqueName: \"kubernetes.io/projected/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-kube-api-access-52lsb\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.723712 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.723712 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723705 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-textfile\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723728 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-sys\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-root\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723771 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723804 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723829 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-wtmp\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723877 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-tls\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723927 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-root\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724020 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.723953 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ba2697a-8ef7-4539-b727-1e3b33bbd966-metrics-client-ca\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724439 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.724073 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-wtmp\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724439 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:39.724150 2558 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 02 13:47:39.724439 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.724149 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-textfile\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724439 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:39.724215 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-tls podName:791e71b4-011f-4c17-b21a-2f1cd1c21e3d nodeName:}" failed. No retries permitted until 2026-07-02 13:47:40.224197438 +0000 UTC m=+148.619485459 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-tls") pod "openshift-state-metrics-57f99c8b49-gc2dg" (UID: "791e71b4-011f-4c17-b21a-2f1cd1c21e3d") : secret "openshift-state-metrics-tls" not found Jul 02 13:47:39.724439 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:39.724241 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 13:47:39.724439 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:39.724310 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-tls podName:4ba2697a-8ef7-4539-b727-1e3b33bbd966 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:40.224293012 +0000 UTC m=+148.619581040 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-tls") pod "node-exporter-tqzrt" (UID: "4ba2697a-8ef7-4539-b727-1e3b33bbd966") : secret "node-exporter-tls" not found Jul 02 13:47:39.724439 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.724425 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.724688 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.724467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.724688 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.724488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ba2697a-8ef7-4539-b727-1e3b33bbd966-metrics-client-ca\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.726099 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.726077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.726309 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.726288 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:39.737635 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.737582 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5xtc\" (UniqueName: \"kubernetes.io/projected/4ba2697a-8ef7-4539-b727-1e3b33bbd966-kube-api-access-f5xtc\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:39.737917 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:39.737900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52lsb\" (UniqueName: \"kubernetes.io/projected/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-kube-api-access-52lsb\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:40.073220 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.073142 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="807f0b42-d175-448f-9116-a3e6e7836969" path="/var/lib/kubelet/pods/807f0b42-d175-448f-9116-a3e6e7836969/volumes" Jul 02 13:47:40.227353 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.227313 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:40.227353 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.227354 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-tls\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:40.229750 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.229720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ba2697a-8ef7-4539-b727-1e3b33bbd966-node-exporter-tls\") pod \"node-exporter-tqzrt\" (UID: \"4ba2697a-8ef7-4539-b727-1e3b33bbd966\") " pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:40.229894 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.229824 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/791e71b4-011f-4c17-b21a-2f1cd1c21e3d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-gc2dg\" (UID: \"791e71b4-011f-4c17-b21a-2f1cd1c21e3d\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:40.398660 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.398568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" Jul 02 13:47:40.445435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.445398 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqzrt" Jul 02 13:47:40.531021 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.530997 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg"] Jul 02 13:47:40.534643 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:40.534615 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod791e71b4_011f_4c17_b21a_2f1cd1c21e3d.slice/crio-36c77eb382906655d73884758b9238d1c592db95c1f66534acbf819074dcc1f4 WatchSource:0}: Error finding container 36c77eb382906655d73884758b9238d1c592db95c1f66534acbf819074dcc1f4: Status 404 returned error can't find the container with id 36c77eb382906655d73884758b9238d1c592db95c1f66534acbf819074dcc1f4 Jul 02 13:47:40.558752 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.558728 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:47:40.562512 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.562494 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.565414 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565372 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 02 13:47:40.565414 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565382 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 02 13:47:40.565572 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565379 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 02 13:47:40.565572 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565381 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 02 13:47:40.565572 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565379 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 02 13:47:40.565676 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565599 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 02 13:47:40.565864 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565831 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 02 13:47:40.565933 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565903 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 02 13:47:40.565989 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565905 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 02 13:47:40.565989 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.565969 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6bhhc\"" Jul 02 13:47:40.583538 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.583514 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:47:40.675408 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.675381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" event={"ID":"791e71b4-011f-4c17-b21a-2f1cd1c21e3d","Type":"ContainerStarted","Data":"dd444e7361472d06cc9578613980727ba355f3c32de371021e9cde3c4985a55d"} Jul 02 13:47:40.675745 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.675440 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" event={"ID":"791e71b4-011f-4c17-b21a-2f1cd1c21e3d","Type":"ContainerStarted","Data":"7444ca5a1922cc3451a1554f1c329be98093106f5d09ee44b02eb5f6933eaf18"} Jul 02 13:47:40.675745 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.675469 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" event={"ID":"791e71b4-011f-4c17-b21a-2f1cd1c21e3d","Type":"ContainerStarted","Data":"36c77eb382906655d73884758b9238d1c592db95c1f66534acbf819074dcc1f4"} Jul 02 13:47:40.676588 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.676564 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqzrt" event={"ID":"4ba2697a-8ef7-4539-b727-1e3b33bbd966","Type":"ContainerStarted","Data":"927a3b04bde1ca231a814d7bb91814d6b5b97c9856a97d56524024adb676fe6a"} Jul 02 13:47:40.731015 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.730988 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-out\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731017 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731056 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-web-config\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731074 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731326 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731326 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731215 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731326 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731244 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731326 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731269 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731326 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731298 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731491 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731358 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8xr\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-kube-api-access-tm8xr\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.731491 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.731386 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.832427 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-out\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.832427 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832437 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.832698 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832467 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.832698 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832499 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-web-config\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.832698 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832523 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.832698 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832586 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.832698 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.832698 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832691 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.833057 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832719 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.833057 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832745 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.833057 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.833057 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832857 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8xr\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-kube-api-access-tm8xr\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.833057 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.832887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.835049 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.833294 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.835049 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.834090 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.835049 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:40.834196 2558 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 02 13:47:40.835049 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:40.834252 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls podName:2c0d79f3-c883-4926-b46d-0fa86ab848d6 nodeName:}" failed. No retries permitted until 2026-07-02 13:47:41.334233465 +0000 UTC m=+149.729521492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6") : secret "alertmanager-main-tls" not found Jul 02 13:47:40.835049 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.834475 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.835745 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.835721 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-web-config\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.837715 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.837693 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.837815 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.837758 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.837936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.837916 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-out\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.838365 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.838345 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.838736 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.838693 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.839038 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.839021 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.840031 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.840009 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:40.845796 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:40.845770 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8xr\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-kube-api-access-tm8xr\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:41.338236 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:41.338202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:41.340446 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:41.340417 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:41.474870 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:41.474818 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:47:41.640383 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:41.640354 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:47:41.682212 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:41.682177 2558 generic.go:356] "Generic (PLEG): container finished" podID="4ba2697a-8ef7-4539-b727-1e3b33bbd966" containerID="0d5418889b59dafbc05b28201ee95794a0c73d52c01414e847e4e15e6e0a4a38" exitCode=0 Jul 02 13:47:41.682610 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:41.682231 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqzrt" event={"ID":"4ba2697a-8ef7-4539-b727-1e3b33bbd966","Type":"ContainerDied","Data":"0d5418889b59dafbc05b28201ee95794a0c73d52c01414e847e4e15e6e0a4a38"} Jul 02 13:47:41.843954 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:41.843830 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0d79f3_c883_4926_b46d_0fa86ab848d6.slice/crio-fbe2a1e402eb2af702108b34e41329aebf1e3c0529d2b420af19df979352f0b7 WatchSource:0}: Error finding container fbe2a1e402eb2af702108b34e41329aebf1e3c0529d2b420af19df979352f0b7: Status 404 returned error can't find the container with id fbe2a1e402eb2af702108b34e41329aebf1e3c0529d2b420af19df979352f0b7 Jul 02 13:47:42.689194 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:42.689156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" event={"ID":"791e71b4-011f-4c17-b21a-2f1cd1c21e3d","Type":"ContainerStarted","Data":"3ea121b0d42976a3f491aa24e072766e9dbb439fee41d4da1d17644415116942"} Jul 02 13:47:42.690488 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:42.690460 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerStarted","Data":"fbe2a1e402eb2af702108b34e41329aebf1e3c0529d2b420af19df979352f0b7"} Jul 02 13:47:42.692691 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:42.692670 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqzrt" event={"ID":"4ba2697a-8ef7-4539-b727-1e3b33bbd966","Type":"ContainerStarted","Data":"730a91f7b98ec89cbb43462a8b90e9dd179950b32475fd13f4565646e2295974"} Jul 02 13:47:42.692780 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:42.692709 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqzrt" event={"ID":"4ba2697a-8ef7-4539-b727-1e3b33bbd966","Type":"ContainerStarted","Data":"bc148a4ffd8870ee70edd1ad31c2efe58c18f8c3e6b7182a21846131fc6508a6"} Jul 02 13:47:42.714284 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:42.714210 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-gc2dg" podStartSLOduration=2.462981938 podStartE2EDuration="3.714193003s" totalImagesPullingTime="1.251211065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:42.713851604 +0000 UTC m=+151.109139646" watchObservedRunningTime="2026-07-02 13:47:42.714193003 +0000 UTC m=+151.109481046" Jul 02 13:47:42.742266 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:42.741911 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tqzrt" podStartSLOduration=2.858937091 podStartE2EDuration="3.741896772s" totalImagesPullingTime="818.732774ms" totalInitContainerRuntime="64.226907ms" isStatefulPod=true podCreationTimestamp="2026-07-02 13:47:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:42.740491472 +0000 UTC m=+151.135779515" watchObservedRunningTime="2026-07-02 13:47:42.741896772 +0000 UTC m=+151.137184815" Jul 02 13:47:43.697923 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.697890 2558 generic.go:356] "Generic (PLEG): container finished" podID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerID="c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5" exitCode=0 Jul 02 13:47:43.698262 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.697982 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerDied","Data":"c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5"} Jul 02 13:47:43.894727 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.894698 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5f9c668684-gg5z4"] Jul 02 13:47:43.897703 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.897688 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:43.900488 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.900463 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c6nprh96d28j6\"" Jul 02 13:47:43.900598 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.900508 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 13:47:43.900598 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.900513 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 02 13:47:43.900786 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.900766 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gj2sd\"" Jul 02 13:47:43.900908 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.900821 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 02 13:47:43.900908 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.900832 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 02 13:47:43.911111 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:43.911094 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f9c668684-gg5z4"] Jul 02 13:47:44.060438 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.060355 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946f30c3-8ab1-42a2-bacd-47548825ba32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.060438 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.060389 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/946f30c3-8ab1-42a2-bacd-47548825ba32-metrics-server-audit-profiles\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.060438 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.060416 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-secret-metrics-server-client-certs\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.060642 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.060483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/946f30c3-8ab1-42a2-bacd-47548825ba32-audit-log\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.060642 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.060514 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-secret-metrics-server-tls\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.060642 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.060531 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-client-ca-bundle\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.060642 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.060575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qp4v9\" (UniqueName: \"kubernetes.io/projected/946f30c3-8ab1-42a2-bacd-47548825ba32-kube-api-access-qp4v9\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.161108 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.161077 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/946f30c3-8ab1-42a2-bacd-47548825ba32-metrics-server-audit-profiles\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.161286 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.161120 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-secret-metrics-server-client-certs\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.161286 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.161231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/946f30c3-8ab1-42a2-bacd-47548825ba32-audit-log\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.161433 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.161408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-secret-metrics-server-tls\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.161496 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.161442 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-client-ca-bundle\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.161548 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.161509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qp4v9\" (UniqueName: \"kubernetes.io/projected/946f30c3-8ab1-42a2-bacd-47548825ba32-kube-api-access-qp4v9\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.161592 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.161569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946f30c3-8ab1-42a2-bacd-47548825ba32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.161648 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.161633 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/946f30c3-8ab1-42a2-bacd-47548825ba32-audit-log\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.162304 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.162242 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/946f30c3-8ab1-42a2-bacd-47548825ba32-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.162304 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.162293 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/946f30c3-8ab1-42a2-bacd-47548825ba32-metrics-server-audit-profiles\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.164128 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.164100 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-secret-metrics-server-client-certs\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.164276 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.164249 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-secret-metrics-server-tls\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.164400 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.164354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/946f30c3-8ab1-42a2-bacd-47548825ba32-client-ca-bundle\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.170689 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.170667 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qp4v9\" (UniqueName: \"kubernetes.io/projected/946f30c3-8ab1-42a2-bacd-47548825ba32-kube-api-access-qp4v9\") pod \"metrics-server-5f9c668684-gg5z4\" (UID: \"946f30c3-8ab1-42a2-bacd-47548825ba32\") " pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.206593 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.206564 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:47:44.358066 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.358000 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5f9c668684-gg5z4"] Jul 02 13:47:44.361583 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:44.361553 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod946f30c3_8ab1_42a2_bacd_47548825ba32.slice/crio-0513a763d0a269df8abc670b14280c05567a8150827d80273f3162bade7f6070 WatchSource:0}: Error finding container 0513a763d0a269df8abc670b14280c05567a8150827d80273f3162bade7f6070: Status 404 returned error can't find the container with id 0513a763d0a269df8abc670b14280c05567a8150827d80273f3162bade7f6070 Jul 02 13:47:44.702383 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:44.702347 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" event={"ID":"946f30c3-8ab1-42a2-bacd-47548825ba32","Type":"ContainerStarted","Data":"0513a763d0a269df8abc670b14280c05567a8150827d80273f3162bade7f6070"} Jul 02 13:47:45.710711 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.710673 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerStarted","Data":"46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2"} Jul 02 13:47:45.711158 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.710758 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerStarted","Data":"8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570"} Jul 02 13:47:45.711158 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.710796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerStarted","Data":"bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e"} Jul 02 13:47:45.711158 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.710853 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerStarted","Data":"7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8"} Jul 02 13:47:45.711158 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.710891 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerStarted","Data":"454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f"} Jul 02 13:47:45.776102 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.776074 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:47:45.780163 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.780126 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.783005 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.782983 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 13:47:45.783114 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.782988 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 13:47:45.783312 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.783297 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 13:47:45.783410 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.783394 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 13:47:45.783518 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.783496 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 13:47:45.787080 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.786913 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 13:47:45.787080 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.786917 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 13:47:45.787407 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.787387 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 13:47:45.787512 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.787424 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b4pt2\"" Jul 02 13:47:45.787710 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.787686 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 13:47:45.788557 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.788259 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 13:47:45.788557 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.788552 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 13:47:45.789244 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.789222 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a954voqs8ld2h\"" Jul 02 13:47:45.791422 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.791404 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 13:47:45.792049 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.792026 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 13:47:45.805121 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.805096 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:47:45.818633 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.818605 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 13:47:45.875774 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.875734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.875961 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.875799 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwtss\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-kube-api-access-rwtss\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.875961 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.875873 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.875961 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.875913 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.875961 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.875945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876164 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.875972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876164 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.875998 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876164 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876069 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-config\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876164 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876119 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876164 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876151 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876373 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876373 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876270 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876373 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876373 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876335 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876373 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876357 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876608 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876380 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876608 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876608 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876432 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876608 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876448 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.876608 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.876466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977330 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977291 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977503 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977348 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwtss\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-kube-api-access-rwtss\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977567 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977623 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977749 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977648 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977749 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977679 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977749 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977703 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-config\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.977749 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977770 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977882 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.977974 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978050 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978073 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978193 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.978387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978263 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.980562 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.978490 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.980562 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.979433 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.982129 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.980890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.982129 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.981394 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.982129 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.981613 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.982129 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.981678 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.982129 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.982089 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-config\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.982593 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.982566 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.982741 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.982693 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.982969 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.982927 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.984044 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.984016 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.984421 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.984314 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.984637 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.984615 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.984919 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.984896 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.985096 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.985077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.985215 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.985192 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.986048 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.986026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:45.987057 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:45.987039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwtss\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-kube-api-access-rwtss\") pod \"prometheus-k8s-0\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:46.090942 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.090915 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:46.247243 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.247132 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:47:46.251900 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:46.251869 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda645d80c_55d4_44db_bc82_14e2772f794d.slice/crio-e08dd1ede9692ec01a0f088e04b13e830f60f8fef41de1a15ab3cd42c2704b43 WatchSource:0}: Error finding container e08dd1ede9692ec01a0f088e04b13e830f60f8fef41de1a15ab3cd42c2704b43: Status 404 returned error can't find the container with id e08dd1ede9692ec01a0f088e04b13e830f60f8fef41de1a15ab3cd42c2704b43 Jul 02 13:47:46.716103 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.716072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" event={"ID":"946f30c3-8ab1-42a2-bacd-47548825ba32","Type":"ContainerStarted","Data":"83c4cf3c02f593d9a50e9fee8fadb92bbe7d6c56a8935c308b12605556aacf50"} Jul 02 13:47:46.719693 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.719650 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerStarted","Data":"90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a"} Jul 02 13:47:46.721553 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.721521 2558 generic.go:356] "Generic (PLEG): container finished" podID="a645d80c-55d4-44db-bc82-14e2772f794d" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" exitCode=0 Jul 02 13:47:46.721675 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.721558 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerDied","Data":"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17"} Jul 02 13:47:46.721675 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.721609 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerStarted","Data":"e08dd1ede9692ec01a0f088e04b13e830f60f8fef41de1a15ab3cd42c2704b43"} Jul 02 13:47:46.737013 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.736964 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" podStartSLOduration=2.040661192 podStartE2EDuration="3.736948626s" totalImagesPullingTime="1.696287434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:46.736598498 +0000 UTC m=+155.131886544" watchObservedRunningTime="2026-07-02 13:47:46.736948626 +0000 UTC m=+155.132236670" Jul 02 13:47:46.772336 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:46.772290 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.305763067 podStartE2EDuration="6.772277778s" totalImagesPullingTime="3.450468434s" totalInitContainerRuntime="16.046277ms" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:46.770475057 +0000 UTC m=+155.165763112" watchObservedRunningTime="2026-07-02 13:47:46.772277778 +0000 UTC m=+155.167565821" Jul 02 13:47:50.752395 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:50.750727 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerStarted","Data":"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688"} Jul 02 13:47:50.752395 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:50.750866 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerStarted","Data":"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22"} Jul 02 13:47:51.033082 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:47:51.033004 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6hcdg" podUID="2d7721b5-b5a0-47d5-915b-60e4dfa052c7" Jul 02 13:47:51.754940 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:51.754908 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hcdg" Jul 02 13:47:53.765547 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:53.765511 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerStarted","Data":"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c"} Jul 02 13:47:53.765938 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:53.765573 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerStarted","Data":"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48"} Jul 02 13:47:53.765938 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:53.765600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerStarted","Data":"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633"} Jul 02 13:47:53.765938 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:53.765626 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerStarted","Data":"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9"} Jul 02 13:47:53.799335 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:53.799285 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.031091676 podStartE2EDuration="8.799265588s" totalImagesPullingTime="5.745694424s" totalInitContainerRuntime="22.479488ms" isStatefulPod=false podCreationTimestamp="2026-07-02 13:47:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:53.797349931 +0000 UTC m=+162.192637973" watchObservedRunningTime="2026-07-02 13:47:53.799265588 +0000 UTC m=+162.194553632" Jul 02 13:47:55.964123 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:55.964083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:47:55.966412 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:55.966390 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d7721b5-b5a0-47d5-915b-60e4dfa052c7-metrics-tls\") pod \"dns-default-6hcdg\" (UID: \"2d7721b5-b5a0-47d5-915b-60e4dfa052c7\") " pod="openshift-dns/dns-default-6hcdg" Jul 02 13:47:56.091078 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:56.091046 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:47:56.261274 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:56.261201 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pnc7w\"" Jul 02 13:47:56.266324 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:56.266308 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6hcdg" Jul 02 13:47:56.411602 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:56.411567 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6hcdg"] Jul 02 13:47:56.418515 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:47:56.418490 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7721b5_b5a0_47d5_915b_60e4dfa052c7.slice/crio-e69d88f4193dd800a54db314e3644f9fc62681e3497427875f4bfc8c59683f0d WatchSource:0}: Error finding container e69d88f4193dd800a54db314e3644f9fc62681e3497427875f4bfc8c59683f0d: Status 404 returned error can't find the container with id e69d88f4193dd800a54db314e3644f9fc62681e3497427875f4bfc8c59683f0d Jul 02 13:47:56.778402 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:56.778368 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hcdg" event={"ID":"2d7721b5-b5a0-47d5-915b-60e4dfa052c7","Type":"ContainerStarted","Data":"e69d88f4193dd800a54db314e3644f9fc62681e3497427875f4bfc8c59683f0d"} Jul 02 13:47:58.788712 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:58.788680 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hcdg" event={"ID":"2d7721b5-b5a0-47d5-915b-60e4dfa052c7","Type":"ContainerStarted","Data":"fae47323c8c637781ed2d3791a57f9a5f2bf1cf3b4af8ad6c1767bc190d50a2a"} Jul 02 13:47:58.789082 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:58.788730 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6hcdg" event={"ID":"2d7721b5-b5a0-47d5-915b-60e4dfa052c7","Type":"ContainerStarted","Data":"c38a07e12cee1a2c1c7bd9d130d4d2b8d23f628b03ced030281270afe4f40457"} Jul 02 13:47:58.789082 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:58.788761 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6hcdg" Jul 02 13:47:58.808249 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:47:58.808204 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6hcdg" podStartSLOduration=130.195662879 podStartE2EDuration="2m11.808189185s" totalImagesPullingTime="1.612526306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:45:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:47:58.807182358 +0000 UTC m=+167.202470404" watchObservedRunningTime="2026-07-02 13:47:58.808189185 +0000 UTC m=+167.203477227" Jul 02 13:48:04.207270 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:04.207189 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:48:04.207614 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:04.207277 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:48:08.795394 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:08.795361 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6hcdg" Jul 02 13:48:15.623957 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:15.623926 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hcdg_2d7721b5-b5a0-47d5-915b-60e4dfa052c7/dns/0.log" Jul 02 13:48:15.631047 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:15.631024 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hcdg_2d7721b5-b5a0-47d5-915b-60e4dfa052c7/kube-rbac-proxy/0.log" Jul 02 13:48:15.994731 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:15.994704 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znnmt_cbcd4a1e-b369-4587-9a15-c87a6d1121ee/dns-node-resolver/0.log" Jul 02 13:48:24.212264 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:24.212234 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:48:24.216067 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:24.216043 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5f9c668684-gg5z4" Jul 02 13:48:46.091852 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:46.091821 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:48:46.110628 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:46.110597 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:48:46.987189 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:46.987164 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:48:59.876542 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:59.876505 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:48:59.877024 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:59.876794 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="alertmanager" containerID="cri-o://454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f" gracePeriod=120 Jul 02 13:48:59.877024 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:59.876891 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="prom-label-proxy" containerID="cri-o://90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a" gracePeriod=120 Jul 02 13:48:59.877024 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:59.876891 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy-metric" containerID="cri-o://46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2" gracePeriod=120 Jul 02 13:48:59.877024 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:59.876933 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy-web" containerID="cri-o://bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e" gracePeriod=120 Jul 02 13:48:59.877024 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:59.876960 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="config-reloader" containerID="cri-o://7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8" gracePeriod=120 Jul 02 13:48:59.877024 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:48:59.876979 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy" containerID="cri-o://8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570" gracePeriod=120 Jul 02 13:49:00.022178 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:00.022155 2558 generic.go:356] "Generic (PLEG): container finished" podID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerID="90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a" exitCode=0 Jul 02 13:49:00.022178 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:00.022175 2558 generic.go:356] "Generic (PLEG): container finished" podID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerID="8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570" exitCode=0 Jul 02 13:49:00.022178 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:00.022185 2558 generic.go:356] "Generic (PLEG): container finished" podID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerID="7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8" exitCode=0 Jul 02 13:49:00.022343 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:00.022191 2558 generic.go:356] "Generic (PLEG): container finished" podID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerID="454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f" exitCode=0 Jul 02 13:49:00.022343 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:00.022225 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerDied","Data":"90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a"} Jul 02 13:49:00.022343 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:00.022290 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerDied","Data":"8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570"} Jul 02 13:49:00.022343 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:00.022317 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerDied","Data":"7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8"} Jul 02 13:49:00.022343 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:00.022341 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerDied","Data":"454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f"} Jul 02 13:49:01.028889 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.028861 2558 generic.go:356] "Generic (PLEG): container finished" podID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerID="46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2" exitCode=0 Jul 02 13:49:01.029150 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.028928 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerDied","Data":"46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2"} Jul 02 13:49:01.215826 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.215801 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:01.356469 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356430 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-out\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356469 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356489 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356517 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-web\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356536 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-web-config\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356553 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-trusted-ca-bundle\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356575 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-main-db\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356611 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-metrics-client-ca\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356642 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356685 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm8xr\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-kube-api-access-tm8xr\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356717 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.356772 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356769 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-cluster-tls-config\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.357250 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356801 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-volume\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.357250 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.356824 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-tls-assets\") pod \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\" (UID: \"2c0d79f3-c883-4926-b46d-0fa86ab848d6\") " Jul 02 13:49:01.357250 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.357011 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:01.357250 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.357147 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.357250 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.357188 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:01.358987 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.358956 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:01.359240 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.359224 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:01.359715 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.359685 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-out" (OuterVolumeSpecName: "config-out") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:01.359948 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.359915 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:01.359948 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.359916 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:01.360126 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.360018 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-volume" (OuterVolumeSpecName: "config-volume") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:01.360800 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.360770 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-kube-api-access-tm8xr" (OuterVolumeSpecName: "kube-api-access-tm8xr") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "kube-api-access-tm8xr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:01.361668 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.361640 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:01.361751 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.361673 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:01.363366 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.363280 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:01.369433 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.369410 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-web-config" (OuterVolumeSpecName: "web-config") pod "2c0d79f3-c883-4926-b46d-0fa86ab848d6" (UID: "2c0d79f3-c883-4926-b46d-0fa86ab848d6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:01.458101 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458040 2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-volume\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458101 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458063 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-tls-assets\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458101 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458075 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-config-out\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458101 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458087 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458102 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458117 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-web-config\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458129 2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c0d79f3-c883-4926-b46d-0fa86ab848d6-alertmanager-main-db\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458142 2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c0d79f3-c883-4926-b46d-0fa86ab848d6-metrics-client-ca\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458155 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-main-tls\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458170 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm8xr\" (UniqueName: \"kubernetes.io/projected/2c0d79f3-c883-4926-b46d-0fa86ab848d6-kube-api-access-tm8xr\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458183 2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:01.458294 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:01.458196 2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c0d79f3-c883-4926-b46d-0fa86ab848d6-cluster-tls-config\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:02.035694 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.035666 2558 generic.go:356] "Generic (PLEG): container finished" podID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerID="bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e" exitCode=0 Jul 02 13:49:02.036103 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.035744 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerDied","Data":"bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e"} Jul 02 13:49:02.036103 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.035811 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c0d79f3-c883-4926-b46d-0fa86ab848d6","Type":"ContainerDied","Data":"fbe2a1e402eb2af702108b34e41329aebf1e3c0529d2b420af19df979352f0b7"} Jul 02 13:49:02.036103 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.035756 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 02 13:49:02.036103 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.035856 2558 scope.go:117] "RemoveContainer" containerID="90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a" Jul 02 13:49:02.043491 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.043475 2558 scope.go:117] "RemoveContainer" containerID="46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2" Jul 02 13:49:02.050743 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.050721 2558 scope.go:117] "RemoveContainer" containerID="8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570" Jul 02 13:49:02.056997 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.056982 2558 scope.go:117] "RemoveContainer" containerID="bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e" Jul 02 13:49:02.063244 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.063221 2558 scope.go:117] "RemoveContainer" containerID="7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8" Jul 02 13:49:02.066333 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.066314 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:49:02.076194 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.076171 2558 scope.go:117] "RemoveContainer" containerID="454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f" Jul 02 13:49:02.076707 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.076688 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 02 13:49:02.082720 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.082696 2558 scope.go:117] "RemoveContainer" containerID="c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5" Jul 02 13:49:02.089228 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.089213 2558 scope.go:117] "RemoveContainer" containerID="90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a" Jul 02 13:49:02.089471 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:02.089449 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a\": container with ID starting with 90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a not found: ID does not exist" containerID="90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a" Jul 02 13:49:02.089539 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.089483 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a"} err="failed to get container status \"90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a\": rpc error: code = NotFound desc = could not find container \"90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a\": container with ID starting with 90b64dcb6910328948c5b7103111249df8bbcaa7379dd15ea43248e286e09c4a not found: ID does not exist" Jul 02 13:49:02.089539 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.089522 2558 scope.go:117] "RemoveContainer" containerID="46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2" Jul 02 13:49:02.089788 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:02.089771 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2\": container with ID starting with 46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2 not found: ID does not exist" containerID="46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2" Jul 02 13:49:02.089824 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.089795 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2"} err="failed to get container status \"46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2\": rpc error: code = NotFound desc = could not find container \"46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2\": container with ID starting with 46e8e9a30a6dc9f81cfe09f0bf2dc48c3d275bedfac3ae84eb55bfd62beb36a2 not found: ID does not exist" Jul 02 13:49:02.089824 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.089809 2558 scope.go:117] "RemoveContainer" containerID="8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570" Jul 02 13:49:02.090050 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:02.090035 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570\": container with ID starting with 8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570 not found: ID does not exist" containerID="8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570" Jul 02 13:49:02.090091 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090052 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570"} err="failed to get container status \"8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570\": rpc error: code = NotFound desc = could not find container \"8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570\": container with ID starting with 8b08acb00d92f8a383444badcfcd6d7427eb2993145e851ce4ab539da73c1570 not found: ID does not exist" Jul 02 13:49:02.090091 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090064 2558 scope.go:117] "RemoveContainer" containerID="bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e" Jul 02 13:49:02.090277 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:02.090255 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e\": container with ID starting with bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e not found: ID does not exist" containerID="bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e" Jul 02 13:49:02.090316 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090283 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e"} err="failed to get container status \"bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e\": rpc error: code = NotFound desc = could not find container \"bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e\": container with ID starting with bd2f643a6110933d6e6096a9323522263e1d1396e8a895949e93c01a6c3ae95e not found: ID does not exist" Jul 02 13:49:02.090316 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090297 2558 scope.go:117] "RemoveContainer" containerID="7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8" Jul 02 13:49:02.090522 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:02.090505 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8\": container with ID starting with 7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8 not found: ID does not exist" containerID="7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8" Jul 02 13:49:02.090576 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090529 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8"} err="failed to get container status \"7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8\": rpc error: code = NotFound desc = could not find container \"7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8\": container with ID starting with 7b3b85186c1cba7547460aad426839052404a7182c55ad5d4d09816ab70dcfe8 not found: ID does not exist" Jul 02 13:49:02.090576 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090549 2558 scope.go:117] "RemoveContainer" containerID="454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f" Jul 02 13:49:02.090745 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:02.090730 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f\": container with ID starting with 454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f not found: ID does not exist" containerID="454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f" Jul 02 13:49:02.090803 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090750 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f"} err="failed to get container status \"454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f\": rpc error: code = NotFound desc = could not find container \"454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f\": container with ID starting with 454909f0151c11f4e155821790a1657946c4dc8b4d9f81f9fcc117cef8ee681f not found: ID does not exist" Jul 02 13:49:02.090803 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090768 2558 scope.go:117] "RemoveContainer" containerID="c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5" Jul 02 13:49:02.090979 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:02.090965 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5\": container with ID starting with c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5 not found: ID does not exist" containerID="c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5" Jul 02 13:49:02.091014 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:02.090982 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5"} err="failed to get container status \"c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5\": rpc error: code = NotFound desc = could not find container \"c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5\": container with ID starting with c14271d4e7eb369d743350937e538da1c7008d2d48f0a81074575fc4101da9b5 not found: ID does not exist" Jul 02 13:49:04.074146 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.074113 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" path="/var/lib/kubelet/pods/2c0d79f3-c883-4926-b46d-0fa86ab848d6/volumes" Jul 02 13:49:04.204643 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.204611 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:49:04.204947 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.204919 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="prometheus" containerID="cri-o://872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" gracePeriod=600 Jul 02 13:49:04.205033 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.204958 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy" containerID="cri-o://58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" gracePeriod=600 Jul 02 13:49:04.205033 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.204999 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" gracePeriod=600 Jul 02 13:49:04.205136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.205022 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy-web" containerID="cri-o://4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" gracePeriod=600 Jul 02 13:49:04.205136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.204974 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="thanos-sidecar" containerID="cri-o://1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" gracePeriod=600 Jul 02 13:49:04.205136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.205021 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="config-reloader" containerID="cri-o://7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" gracePeriod=600 Jul 02 13:49:04.443951 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.443928 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:04.579197 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579157 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-config\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579197 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579201 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-metrics-client-certs\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579223 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-kubelet-serving-ca-bundle\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579244 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwtss\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-kube-api-access-rwtss\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579259 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-0\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579280 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-tls-assets\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579307 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-config-out\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579322 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-tls\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579341 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-grpc-tls\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579371 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-trusted-ca-bundle\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579399 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-serving-certs-ca-bundle\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.579435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579426 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-metrics-client-ca\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.580023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579458 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-kube-rbac-proxy\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.580023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579490 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.580023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579535 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-db\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.580023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579559 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-web-config\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.580023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579593 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-2\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.580023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579638 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-thanos-prometheus-http-client-file\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.580023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579673 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.580023 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579710 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-1\") pod \"a645d80c-55d4-44db-bc82-14e2772f794d\" (UID: \"a645d80c-55d4-44db-bc82-14e2772f794d\") " Jul 02 13:49:04.581933 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.579627 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:04.581933 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.580284 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:04.581933 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.580779 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:04.581933 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.581275 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:04.581933 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.581594 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-config-out" (OuterVolumeSpecName: "config-out") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:04.581933 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.581810 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-kube-api-access-rwtss" (OuterVolumeSpecName: "kube-api-access-rwtss") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "kube-api-access-rwtss". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:04.581933 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.581919 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-config" (OuterVolumeSpecName: "config") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.582354 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.582039 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.582354 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.582150 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:04.582354 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.582320 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:04.582518 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.582382 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 13:49:04.582668 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.582642 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:49:04.582739 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.582717 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.583936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.583909 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:49:04.584066 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.584033 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.584173 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.584070 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.584326 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.584308 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.584463 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.584446 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.584507 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.584459 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.592915 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.592880 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-web-config" (OuterVolumeSpecName: "web-config") pod "a645d80c-55d4-44db-bc82-14e2772f794d" (UID: "a645d80c-55d4-44db-bc82-14e2772f794d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 13:49:04.680731 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680698 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-metrics-client-ca\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680731 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680731 2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-kube-rbac-proxy\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680746 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680760 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-db\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680772 2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-web-config\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680785 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680798 2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680812 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680825 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680859 2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-config\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680873 2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-metrics-client-certs\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680888 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680903 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwtss\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-kube-api-access-rwtss\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.680914 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680917 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.681278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680929 2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a645d80c-55d4-44db-bc82-14e2772f794d-tls-assets\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.681278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680942 2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a645d80c-55d4-44db-bc82-14e2772f794d-config-out\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.681278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680954 2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.681278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680968 2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a645d80c-55d4-44db-bc82-14e2772f794d-secret-grpc-tls\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.681278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680982 2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:04.681278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:04.680996 2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a645d80c-55d4-44db-bc82-14e2772f794d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:49:05.049946 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049862 2558 generic.go:356] "Generic (PLEG): container finished" podID="a645d80c-55d4-44db-bc82-14e2772f794d" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" exitCode=0 Jul 02 13:49:05.049946 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049886 2558 generic.go:356] "Generic (PLEG): container finished" podID="a645d80c-55d4-44db-bc82-14e2772f794d" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" exitCode=0 Jul 02 13:49:05.049946 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049892 2558 generic.go:356] "Generic (PLEG): container finished" podID="a645d80c-55d4-44db-bc82-14e2772f794d" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" exitCode=0 Jul 02 13:49:05.049946 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049899 2558 generic.go:356] "Generic (PLEG): container finished" podID="a645d80c-55d4-44db-bc82-14e2772f794d" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" exitCode=0 Jul 02 13:49:05.049946 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049904 2558 generic.go:356] "Generic (PLEG): container finished" podID="a645d80c-55d4-44db-bc82-14e2772f794d" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" exitCode=0 Jul 02 13:49:05.049946 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049909 2558 generic.go:356] "Generic (PLEG): container finished" podID="a645d80c-55d4-44db-bc82-14e2772f794d" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" exitCode=0 Jul 02 13:49:05.049946 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049938 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerDied","Data":"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c"} Jul 02 13:49:05.050382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049992 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerDied","Data":"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48"} Jul 02 13:49:05.050382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.049996 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.050382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.050021 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerDied","Data":"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633"} Jul 02 13:49:05.050382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.050046 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerDied","Data":"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9"} Jul 02 13:49:05.050382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.050068 2558 scope.go:117] "RemoveContainer" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" Jul 02 13:49:05.050382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.050072 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerDied","Data":"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688"} Jul 02 13:49:05.050382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.050210 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerDied","Data":"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22"} Jul 02 13:49:05.050382 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.050260 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a645d80c-55d4-44db-bc82-14e2772f794d","Type":"ContainerDied","Data":"e08dd1ede9692ec01a0f088e04b13e830f60f8fef41de1a15ab3cd42c2704b43"} Jul 02 13:49:05.060801 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.060207 2558 scope.go:117] "RemoveContainer" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" Jul 02 13:49:05.067699 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.067681 2558 scope.go:117] "RemoveContainer" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" Jul 02 13:49:05.074558 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.074541 2558 scope.go:117] "RemoveContainer" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" Jul 02 13:49:05.078035 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.078016 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:49:05.081576 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.081559 2558 scope.go:117] "RemoveContainer" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" Jul 02 13:49:05.082869 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.082852 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:49:05.088150 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.088130 2558 scope.go:117] "RemoveContainer" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" Jul 02 13:49:05.094899 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.094880 2558 scope.go:117] "RemoveContainer" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" Jul 02 13:49:05.101390 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.101375 2558 scope.go:117] "RemoveContainer" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" Jul 02 13:49:05.101626 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:05.101608 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": container with ID starting with ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c not found: ID does not exist" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" Jul 02 13:49:05.101683 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.101635 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c"} err="failed to get container status \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": rpc error: code = NotFound desc = could not find container \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": container with ID starting with ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c not found: ID does not exist" Jul 02 13:49:05.101683 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.101653 2558 scope.go:117] "RemoveContainer" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" Jul 02 13:49:05.101904 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:05.101886 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": container with ID starting with 58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48 not found: ID does not exist" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" Jul 02 13:49:05.101951 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.101910 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48"} err="failed to get container status \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": rpc error: code = NotFound desc = could not find container \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": container with ID starting with 58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48 not found: ID does not exist" Jul 02 13:49:05.101951 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.101925 2558 scope.go:117] "RemoveContainer" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" Jul 02 13:49:05.102157 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:05.102140 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": container with ID starting with 4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633 not found: ID does not exist" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" Jul 02 13:49:05.102205 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.102162 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633"} err="failed to get container status \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": rpc error: code = NotFound desc = could not find container \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": container with ID starting with 4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633 not found: ID does not exist" Jul 02 13:49:05.102205 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.102178 2558 scope.go:117] "RemoveContainer" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" Jul 02 13:49:05.102381 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:05.102366 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": container with ID starting with 1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9 not found: ID does not exist" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" Jul 02 13:49:05.102426 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.102384 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9"} err="failed to get container status \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": rpc error: code = NotFound desc = could not find container \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": container with ID starting with 1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9 not found: ID does not exist" Jul 02 13:49:05.102426 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.102395 2558 scope.go:117] "RemoveContainer" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" Jul 02 13:49:05.102614 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:05.102598 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": container with ID starting with 7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688 not found: ID does not exist" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" Jul 02 13:49:05.102651 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.102618 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688"} err="failed to get container status \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": rpc error: code = NotFound desc = could not find container \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": container with ID starting with 7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688 not found: ID does not exist" Jul 02 13:49:05.102651 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.102630 2558 scope.go:117] "RemoveContainer" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" Jul 02 13:49:05.102809 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:05.102792 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": container with ID starting with 872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22 not found: ID does not exist" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" Jul 02 13:49:05.102867 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.102812 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22"} err="failed to get container status \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": rpc error: code = NotFound desc = could not find container \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": container with ID starting with 872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22 not found: ID does not exist" Jul 02 13:49:05.102867 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.102823 2558 scope.go:117] "RemoveContainer" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" Jul 02 13:49:05.103015 ip-10-0-133-48 kubenswrapper[2558]: E0702 13:49:05.102998 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": container with ID starting with 47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17 not found: ID does not exist" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" Jul 02 13:49:05.103054 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103017 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17"} err="failed to get container status \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": rpc error: code = NotFound desc = could not find container \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": container with ID starting with 47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17 not found: ID does not exist" Jul 02 13:49:05.103054 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103028 2558 scope.go:117] "RemoveContainer" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" Jul 02 13:49:05.103184 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103169 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c"} err="failed to get container status \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": rpc error: code = NotFound desc = could not find container \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": container with ID starting with ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c not found: ID does not exist" Jul 02 13:49:05.103224 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103185 2558 scope.go:117] "RemoveContainer" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" Jul 02 13:49:05.103333 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103314 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48"} err="failed to get container status \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": rpc error: code = NotFound desc = could not find container \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": container with ID starting with 58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48 not found: ID does not exist" Jul 02 13:49:05.103370 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103334 2558 scope.go:117] "RemoveContainer" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" Jul 02 13:49:05.103554 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103535 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633"} err="failed to get container status \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": rpc error: code = NotFound desc = could not find container \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": container with ID starting with 4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633 not found: ID does not exist" Jul 02 13:49:05.103605 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103555 2558 scope.go:117] "RemoveContainer" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" Jul 02 13:49:05.103781 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103764 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9"} err="failed to get container status \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": rpc error: code = NotFound desc = could not find container \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": container with ID starting with 1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9 not found: ID does not exist" Jul 02 13:49:05.103824 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103781 2558 scope.go:117] "RemoveContainer" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" Jul 02 13:49:05.104017 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.103998 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688"} err="failed to get container status \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": rpc error: code = NotFound desc = could not find container \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": container with ID starting with 7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688 not found: ID does not exist" Jul 02 13:49:05.104087 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104020 2558 scope.go:117] "RemoveContainer" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" Jul 02 13:49:05.104231 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104214 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22"} err="failed to get container status \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": rpc error: code = NotFound desc = could not find container \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": container with ID starting with 872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22 not found: ID does not exist" Jul 02 13:49:05.104298 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104233 2558 scope.go:117] "RemoveContainer" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" Jul 02 13:49:05.104442 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104425 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17"} err="failed to get container status \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": rpc error: code = NotFound desc = could not find container \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": container with ID starting with 47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17 not found: ID does not exist" Jul 02 13:49:05.104487 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104442 2558 scope.go:117] "RemoveContainer" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" Jul 02 13:49:05.104653 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104634 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c"} err="failed to get container status \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": rpc error: code = NotFound desc = could not find container \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": container with ID starting with ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c not found: ID does not exist" Jul 02 13:49:05.104722 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104654 2558 scope.go:117] "RemoveContainer" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" Jul 02 13:49:05.104874 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104859 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48"} err="failed to get container status \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": rpc error: code = NotFound desc = could not find container \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": container with ID starting with 58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48 not found: ID does not exist" Jul 02 13:49:05.104936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.104873 2558 scope.go:117] "RemoveContainer" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" Jul 02 13:49:05.105076 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105057 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633"} err="failed to get container status \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": rpc error: code = NotFound desc = could not find container \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": container with ID starting with 4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633 not found: ID does not exist" Jul 02 13:49:05.105130 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105078 2558 scope.go:117] "RemoveContainer" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" Jul 02 13:49:05.105273 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105260 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9"} err="failed to get container status \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": rpc error: code = NotFound desc = could not find container \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": container with ID starting with 1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9 not found: ID does not exist" Jul 02 13:49:05.105326 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105273 2558 scope.go:117] "RemoveContainer" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" Jul 02 13:49:05.105491 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105472 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688"} err="failed to get container status \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": rpc error: code = NotFound desc = could not find container \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": container with ID starting with 7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688 not found: ID does not exist" Jul 02 13:49:05.105538 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105491 2558 scope.go:117] "RemoveContainer" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" Jul 02 13:49:05.105683 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105668 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22"} err="failed to get container status \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": rpc error: code = NotFound desc = could not find container \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": container with ID starting with 872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22 not found: ID does not exist" Jul 02 13:49:05.105727 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105684 2558 scope.go:117] "RemoveContainer" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" Jul 02 13:49:05.105907 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105888 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17"} err="failed to get container status \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": rpc error: code = NotFound desc = could not find container \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": container with ID starting with 47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17 not found: ID does not exist" Jul 02 13:49:05.105981 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.105908 2558 scope.go:117] "RemoveContainer" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" Jul 02 13:49:05.106136 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106120 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c"} err="failed to get container status \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": rpc error: code = NotFound desc = could not find container \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": container with ID starting with ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c not found: ID does not exist" Jul 02 13:49:05.106178 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106137 2558 scope.go:117] "RemoveContainer" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" Jul 02 13:49:05.106344 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106326 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48"} err="failed to get container status \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": rpc error: code = NotFound desc = could not find container \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": container with ID starting with 58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48 not found: ID does not exist" Jul 02 13:49:05.106416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106346 2558 scope.go:117] "RemoveContainer" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" Jul 02 13:49:05.106551 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106528 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633"} err="failed to get container status \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": rpc error: code = NotFound desc = could not find container \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": container with ID starting with 4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633 not found: ID does not exist" Jul 02 13:49:05.106596 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106552 2558 scope.go:117] "RemoveContainer" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" Jul 02 13:49:05.106732 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106715 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9"} err="failed to get container status \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": rpc error: code = NotFound desc = could not find container \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": container with ID starting with 1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9 not found: ID does not exist" Jul 02 13:49:05.106794 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106733 2558 scope.go:117] "RemoveContainer" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" Jul 02 13:49:05.106960 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106943 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688"} err="failed to get container status \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": rpc error: code = NotFound desc = could not find container \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": container with ID starting with 7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688 not found: ID does not exist" Jul 02 13:49:05.107010 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.106962 2558 scope.go:117] "RemoveContainer" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" Jul 02 13:49:05.107154 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.107137 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22"} err="failed to get container status \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": rpc error: code = NotFound desc = could not find container \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": container with ID starting with 872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22 not found: ID does not exist" Jul 02 13:49:05.107211 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.107155 2558 scope.go:117] "RemoveContainer" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" Jul 02 13:49:05.107376 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.107359 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17"} err="failed to get container status \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": rpc error: code = NotFound desc = could not find container \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": container with ID starting with 47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17 not found: ID does not exist" Jul 02 13:49:05.107418 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.107377 2558 scope.go:117] "RemoveContainer" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" Jul 02 13:49:05.107574 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.107557 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c"} err="failed to get container status \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": rpc error: code = NotFound desc = could not find container \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": container with ID starting with ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c not found: ID does not exist" Jul 02 13:49:05.107644 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.107575 2558 scope.go:117] "RemoveContainer" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" Jul 02 13:49:05.107861 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.107828 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48"} err="failed to get container status \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": rpc error: code = NotFound desc = could not find container \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": container with ID starting with 58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48 not found: ID does not exist" Jul 02 13:49:05.107903 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.107862 2558 scope.go:117] "RemoveContainer" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" Jul 02 13:49:05.108053 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108036 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633"} err="failed to get container status \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": rpc error: code = NotFound desc = could not find container \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": container with ID starting with 4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633 not found: ID does not exist" Jul 02 13:49:05.108112 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108054 2558 scope.go:117] "RemoveContainer" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" Jul 02 13:49:05.108268 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108250 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9"} err="failed to get container status \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": rpc error: code = NotFound desc = could not find container \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": container with ID starting with 1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9 not found: ID does not exist" Jul 02 13:49:05.108315 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108268 2558 scope.go:117] "RemoveContainer" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" Jul 02 13:49:05.108461 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108445 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688"} err="failed to get container status \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": rpc error: code = NotFound desc = could not find container \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": container with ID starting with 7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688 not found: ID does not exist" Jul 02 13:49:05.108518 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108464 2558 scope.go:117] "RemoveContainer" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" Jul 02 13:49:05.108676 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108660 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22"} err="failed to get container status \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": rpc error: code = NotFound desc = could not find container \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": container with ID starting with 872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22 not found: ID does not exist" Jul 02 13:49:05.108731 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108676 2558 scope.go:117] "RemoveContainer" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" Jul 02 13:49:05.108932 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108914 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17"} err="failed to get container status \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": rpc error: code = NotFound desc = could not find container \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": container with ID starting with 47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17 not found: ID does not exist" Jul 02 13:49:05.109059 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.108932 2558 scope.go:117] "RemoveContainer" containerID="ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c" Jul 02 13:49:05.109149 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109133 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c"} err="failed to get container status \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": rpc error: code = NotFound desc = could not find container \"ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c\": container with ID starting with ee210fc3b7aca493ef2841e47c3e70bb29cb727f71132fcdfc5cf6d38794303c not found: ID does not exist" Jul 02 13:49:05.109196 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109150 2558 scope.go:117] "RemoveContainer" containerID="58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48" Jul 02 13:49:05.109356 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109339 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48"} err="failed to get container status \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": rpc error: code = NotFound desc = could not find container \"58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48\": container with ID starting with 58c95b68fc96058d7071ad8f83f4f6dde39f34a3d92c98424a9258bd04c21d48 not found: ID does not exist" Jul 02 13:49:05.109395 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109356 2558 scope.go:117] "RemoveContainer" containerID="4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633" Jul 02 13:49:05.109568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109548 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633"} err="failed to get container status \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": rpc error: code = NotFound desc = could not find container \"4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633\": container with ID starting with 4652e92cfaa9649c2d65cb2e178fac7dab284e28aaaef97631bae6fc431fc633 not found: ID does not exist" Jul 02 13:49:05.109568 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109568 2558 scope.go:117] "RemoveContainer" containerID="1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9" Jul 02 13:49:05.109775 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109759 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9"} err="failed to get container status \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": rpc error: code = NotFound desc = could not find container \"1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9\": container with ID starting with 1a1f8c36b079699f9234a4418c51e004a9d5367ec5c286474d43491a76919cd9 not found: ID does not exist" Jul 02 13:49:05.109833 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109777 2558 scope.go:117] "RemoveContainer" containerID="7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688" Jul 02 13:49:05.110006 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.109987 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688"} err="failed to get container status \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": rpc error: code = NotFound desc = could not find container \"7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688\": container with ID starting with 7ce3536fe2b237c423b69cc67be77f2c09df13c16f94c7b70466d5208fd1e688 not found: ID does not exist" Jul 02 13:49:05.110048 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.110007 2558 scope.go:117] "RemoveContainer" containerID="872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22" Jul 02 13:49:05.110235 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.110215 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22"} err="failed to get container status \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": rpc error: code = NotFound desc = could not find container \"872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22\": container with ID starting with 872e13630ba70fd4ce971cf7d52bb602925399e293cc6323b34fc79387065d22 not found: ID does not exist" Jul 02 13:49:05.110235 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.110232 2558 scope.go:117] "RemoveContainer" containerID="47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17" Jul 02 13:49:05.110444 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.110428 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17"} err="failed to get container status \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": rpc error: code = NotFound desc = could not find container \"47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17\": container with ID starting with 47138fe30bb1ef92432e7779237039b68add84b798d34a2e4b4f62cd118a1b17 not found: ID does not exist" Jul 02 13:49:05.112243 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112222 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:49:05.112482 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112471 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="config-reloader" Jul 02 13:49:05.112527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112483 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="config-reloader" Jul 02 13:49:05.112527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112495 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="init-config-reloader" Jul 02 13:49:05.112527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112501 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="init-config-reloader" Jul 02 13:49:05.112527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112508 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="prometheus" Jul 02 13:49:05.112527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112513 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="prometheus" Jul 02 13:49:05.112527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112521 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="alertmanager" Jul 02 13:49:05.112527 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112526 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="alertmanager" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112535 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="config-reloader" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112540 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="config-reloader" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112546 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy-web" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112551 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy-web" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112558 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="thanos-sidecar" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112563 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="thanos-sidecar" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112570 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy-web" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112575 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy-web" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112580 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="init-config-reloader" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112586 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="init-config-reloader" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112593 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112598 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112607 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy-metric" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112611 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy-metric" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112616 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="prom-label-proxy" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112622 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="prom-label-proxy" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112627 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy-thanos" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112632 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy-thanos" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112638 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112643 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112681 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112687 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="config-reloader" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112693 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112700 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy-thanos" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112706 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="kube-rbac-proxy-web" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112712 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="alertmanager" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112717 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy-metric" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112722 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="thanos-sidecar" Jul 02 13:49:05.112716 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112727 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="config-reloader" Jul 02 13:49:05.113497 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112732 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="prom-label-proxy" Jul 02 13:49:05.113497 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112737 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0d79f3-c883-4926-b46d-0fa86ab848d6" containerName="kube-rbac-proxy-web" Jul 02 13:49:05.113497 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.112742 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" containerName="prometheus" Jul 02 13:49:05.117767 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.117753 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.120318 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120298 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 13:49:05.120416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120308 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 13:49:05.120416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120332 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a954voqs8ld2h\"" Jul 02 13:49:05.120416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120330 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 13:49:05.120416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120363 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 13:49:05.120673 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120657 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 13:49:05.120735 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120665 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 13:49:05.120788 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120678 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 13:49:05.120977 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.120962 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-b4pt2\"" Jul 02 13:49:05.121066 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.121048 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 13:49:05.121123 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.121062 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 13:49:05.121181 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.121152 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 13:49:05.121305 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.121286 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 13:49:05.121398 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.121378 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 13:49:05.124365 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.124310 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 13:49:05.128165 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.128147 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 13:49:05.132335 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.132316 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:49:05.182622 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182742 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182742 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182742 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182663 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182742 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182684 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182742 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/852dc927-3563-4a45-9a7e-872b0000c110-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182758 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182773 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-config\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182787 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-web-config\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182805 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.182936 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.183281 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.182991 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlhx\" (UniqueName: \"kubernetes.io/projected/852dc927-3563-4a45-9a7e-872b0000c110-kube-api-access-lqlhx\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.183281 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.183028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.183281 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.183052 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.183281 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.183095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.183281 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.183126 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/852dc927-3563-4a45-9a7e-872b0000c110-config-out\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.183281 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.183167 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284073 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284035 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284073 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284073 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284094 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/852dc927-3563-4a45-9a7e-872b0000c110-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284136 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284158 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284181 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-config\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284205 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-web-config\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284278 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284260 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284304 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284326 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlhx\" (UniqueName: \"kubernetes.io/projected/852dc927-3563-4a45-9a7e-872b0000c110-kube-api-access-lqlhx\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284344 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284364 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284388 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284417 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/852dc927-3563-4a45-9a7e-872b0000c110-config-out\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.284640 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.284512 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.285903 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.285520 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.287381 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.287351 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.287484 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.287384 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.287484 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.287433 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-config\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.287604 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.287481 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.287604 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.287490 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/852dc927-3563-4a45-9a7e-872b0000c110-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.288269 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.287978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.288269 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.288067 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.288425 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.288304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.288482 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.288434 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.289028 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.288612 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.289028 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.288671 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-web-config\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.289028 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.288966 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.289213 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.289076 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.289282 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.289257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852dc927-3563-4a45-9a7e-872b0000c110-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.289755 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.289723 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/852dc927-3563-4a45-9a7e-872b0000c110-config-out\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.289875 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.289858 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.290526 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.290492 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.290806 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.290791 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/852dc927-3563-4a45-9a7e-872b0000c110-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.297008 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.296992 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlhx\" (UniqueName: \"kubernetes.io/projected/852dc927-3563-4a45-9a7e-872b0000c110-kube-api-access-lqlhx\") pod \"prometheus-k8s-0\" (UID: \"852dc927-3563-4a45-9a7e-872b0000c110\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.427489 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.427454 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:49:05.565357 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:05.565335 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 13:49:05.567630 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:49:05.567591 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852dc927_3563_4a45_9a7e_872b0000c110.slice/crio-fa3bc3e6040e670fe3255ec412731bd91409119c70c46cdd03c504f5784846c3 WatchSource:0}: Error finding container fa3bc3e6040e670fe3255ec412731bd91409119c70c46cdd03c504f5784846c3: Status 404 returned error can't find the container with id fa3bc3e6040e670fe3255ec412731bd91409119c70c46cdd03c504f5784846c3 Jul 02 13:49:06.055270 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:06.055233 2558 generic.go:356] "Generic (PLEG): container finished" podID="852dc927-3563-4a45-9a7e-872b0000c110" containerID="cb6cd747d40ed31c233f08396c721c5179233e9ba22ce8b993d30d142e3313d5" exitCode=0 Jul 02 13:49:06.055416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:06.055322 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"852dc927-3563-4a45-9a7e-872b0000c110","Type":"ContainerDied","Data":"cb6cd747d40ed31c233f08396c721c5179233e9ba22ce8b993d30d142e3313d5"} Jul 02 13:49:06.055416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:06.055393 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"852dc927-3563-4a45-9a7e-872b0000c110","Type":"ContainerStarted","Data":"fa3bc3e6040e670fe3255ec412731bd91409119c70c46cdd03c504f5784846c3"} Jul 02 13:49:06.073571 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:06.073553 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a645d80c-55d4-44db-bc82-14e2772f794d" path="/var/lib/kubelet/pods/a645d80c-55d4-44db-bc82-14e2772f794d/volumes" Jul 02 13:49:07.062137 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:07.062096 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"852dc927-3563-4a45-9a7e-872b0000c110","Type":"ContainerStarted","Data":"4603c488b6eb05c18ab965e595a5e69ab158cb804c838ec8d7165af2d60fbdfe"} Jul 02 13:49:07.062502 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:07.062191 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"852dc927-3563-4a45-9a7e-872b0000c110","Type":"ContainerStarted","Data":"118f3fac932a9984dd05954909520adbea8a14d8df97d33074a26b0f18944908"} Jul 02 13:49:07.062502 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:07.062219 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"852dc927-3563-4a45-9a7e-872b0000c110","Type":"ContainerStarted","Data":"b796e2fad386d223b04ec886b64c1d458889112a564478dc13570c76963de314"} Jul 02 13:49:07.062502 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:07.062243 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"852dc927-3563-4a45-9a7e-872b0000c110","Type":"ContainerStarted","Data":"9aa2beac6191247cf4e7350c32b7a1152425af7950e64af0916335bd391e6123"} Jul 02 13:49:07.062502 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:07.062265 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"852dc927-3563-4a45-9a7e-872b0000c110","Type":"ContainerStarted","Data":"bdff82674793b4604e718776fecea9acba73cde708105e195506a547be617c35"} Jul 02 13:49:07.062502 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:07.062288 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"852dc927-3563-4a45-9a7e-872b0000c110","Type":"ContainerStarted","Data":"0047bbc878a08e6392952c4e6758a93d3e77d37d944da916fa3a1edb64eaf103"} Jul 02 13:49:07.093133 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:07.093079 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.075459576 podStartE2EDuration="2.0930583s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.598724ms" isStatefulPod=false podCreationTimestamp="2026-07-02 13:49:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:49:07.092284778 +0000 UTC m=+235.487572846" watchObservedRunningTime="2026-07-02 13:49:07.0930583 +0000 UTC m=+235.488346344" Jul 02 13:49:10.428515 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:49:10.428480 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:50:05.428378 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:50:05.428327 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:50:05.443379 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:50:05.443357 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:50:06.281204 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:50:06.281174 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 13:50:11.961627 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:50:11.961601 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:50:11.972330 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:50:11.972307 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:50:11.972773 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:50:11.972752 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 13:55:11.990779 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:11.990746 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:55:11.998237 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:11.998210 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 13:55:25.463316 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.463287 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-9qprq"] Jul 02 13:55:25.466387 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.466372 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9qprq" Jul 02 13:55:25.469119 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.469091 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 02 13:55:25.469119 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.469113 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 02 13:55:25.469315 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.469090 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 02 13:55:25.469378 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.469348 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-97d78\"" Jul 02 13:55:25.478359 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.478340 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-9qprq"] Jul 02 13:55:25.519438 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.519415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d03976b-faa4-4c82-9562-10c89290421b-model-cache\") pod \"s3-init-9qprq\" (UID: \"3d03976b-faa4-4c82-9562-10c89290421b\") " pod="kserve/s3-init-9qprq" Jul 02 13:55:25.519542 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.519447 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttk2s\" (UniqueName: \"kubernetes.io/projected/3d03976b-faa4-4c82-9562-10c89290421b-kube-api-access-ttk2s\") pod \"s3-init-9qprq\" (UID: \"3d03976b-faa4-4c82-9562-10c89290421b\") " pod="kserve/s3-init-9qprq" Jul 02 13:55:25.620825 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.620789 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d03976b-faa4-4c82-9562-10c89290421b-model-cache\") pod \"s3-init-9qprq\" (UID: \"3d03976b-faa4-4c82-9562-10c89290421b\") " pod="kserve/s3-init-9qprq" Jul 02 13:55:25.620960 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.620834 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttk2s\" (UniqueName: \"kubernetes.io/projected/3d03976b-faa4-4c82-9562-10c89290421b-kube-api-access-ttk2s\") pod \"s3-init-9qprq\" (UID: \"3d03976b-faa4-4c82-9562-10c89290421b\") " pod="kserve/s3-init-9qprq" Jul 02 13:55:25.621251 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.621231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d03976b-faa4-4c82-9562-10c89290421b-model-cache\") pod \"s3-init-9qprq\" (UID: \"3d03976b-faa4-4c82-9562-10c89290421b\") " pod="kserve/s3-init-9qprq" Jul 02 13:55:25.632325 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.632304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttk2s\" (UniqueName: \"kubernetes.io/projected/3d03976b-faa4-4c82-9562-10c89290421b-kube-api-access-ttk2s\") pod \"s3-init-9qprq\" (UID: \"3d03976b-faa4-4c82-9562-10c89290421b\") " pod="kserve/s3-init-9qprq" Jul 02 13:55:25.775167 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.775096 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9qprq" Jul 02 13:55:25.898662 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.898638 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-9qprq"] Jul 02 13:55:25.901255 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:55:25.901229 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d03976b_faa4_4c82_9562_10c89290421b.slice/crio-53beddcd4810f586010a626ea0bbf66516eb6b8101c7619a55c5f2e6f75d5a91 WatchSource:0}: Error finding container 53beddcd4810f586010a626ea0bbf66516eb6b8101c7619a55c5f2e6f75d5a91: Status 404 returned error can't find the container with id 53beddcd4810f586010a626ea0bbf66516eb6b8101c7619a55c5f2e6f75d5a91 Jul 02 13:55:25.903075 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:25.903058 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 13:55:26.361203 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:26.361163 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9qprq" event={"ID":"3d03976b-faa4-4c82-9562-10c89290421b","Type":"ContainerStarted","Data":"53beddcd4810f586010a626ea0bbf66516eb6b8101c7619a55c5f2e6f75d5a91"} Jul 02 13:55:30.379990 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:30.379952 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9qprq" event={"ID":"3d03976b-faa4-4c82-9562-10c89290421b","Type":"ContainerStarted","Data":"72bce4e55f3f8ce492e7521c8f9e23b5d2e08b7117a6d55a34631844e8bdbdf5"} Jul 02 13:55:32.388511 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:32.388473 2558 generic.go:356] "Generic (PLEG): container finished" podID="3d03976b-faa4-4c82-9562-10c89290421b" containerID="72bce4e55f3f8ce492e7521c8f9e23b5d2e08b7117a6d55a34631844e8bdbdf5" exitCode=0 Jul 02 13:55:32.388890 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:32.388543 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9qprq" event={"ID":"3d03976b-faa4-4c82-9562-10c89290421b","Type":"ContainerDied","Data":"72bce4e55f3f8ce492e7521c8f9e23b5d2e08b7117a6d55a34631844e8bdbdf5"} Jul 02 13:55:37.416352 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:37.416319 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9qprq" event={"ID":"3d03976b-faa4-4c82-9562-10c89290421b","Type":"ContainerStarted","Data":"e87d22ac1f01e0fdb6abcc5015d8b044fcc7f05e22c8569a52360f17c289ad32"} Jul 02 13:55:37.434116 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:55:37.434066 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-9qprq" podStartSLOduration=1.967981892 podStartE2EDuration="12.434046002s" totalImagesPullingTime="8.145344196s" totalInitContainerRuntime="2.320719914s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:55:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:55:37.434014812 +0000 UTC m=+625.829302857" watchObservedRunningTime="2026-07-02 13:55:37.434046002 +0000 UTC m=+625.829334039" Jul 02 13:56:42.650124 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:42.650085 2558 generic.go:356] "Generic (PLEG): container finished" podID="3d03976b-faa4-4c82-9562-10c89290421b" containerID="e87d22ac1f01e0fdb6abcc5015d8b044fcc7f05e22c8569a52360f17c289ad32" exitCode=0 Jul 02 13:56:42.650549 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:42.650154 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9qprq" event={"ID":"3d03976b-faa4-4c82-9562-10c89290421b","Type":"ContainerDied","Data":"e87d22ac1f01e0fdb6abcc5015d8b044fcc7f05e22c8569a52360f17c289ad32"} Jul 02 13:56:43.774052 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:43.774029 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9qprq" Jul 02 13:56:43.815663 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:43.815642 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d03976b-faa4-4c82-9562-10c89290421b-model-cache\") pod \"3d03976b-faa4-4c82-9562-10c89290421b\" (UID: \"3d03976b-faa4-4c82-9562-10c89290421b\") " Jul 02 13:56:43.815770 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:43.815675 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttk2s\" (UniqueName: \"kubernetes.io/projected/3d03976b-faa4-4c82-9562-10c89290421b-kube-api-access-ttk2s\") pod \"3d03976b-faa4-4c82-9562-10c89290421b\" (UID: \"3d03976b-faa4-4c82-9562-10c89290421b\") " Jul 02 13:56:43.817699 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:43.817670 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d03976b-faa4-4c82-9562-10c89290421b-kube-api-access-ttk2s" (OuterVolumeSpecName: "kube-api-access-ttk2s") pod "3d03976b-faa4-4c82-9562-10c89290421b" (UID: "3d03976b-faa4-4c82-9562-10c89290421b"). InnerVolumeSpecName "kube-api-access-ttk2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:56:43.834491 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:43.834467 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3d03976b-faa4-4c82-9562-10c89290421b-model-cache" (OuterVolumeSpecName: "model-cache") pod "3d03976b-faa4-4c82-9562-10c89290421b" (UID: "3d03976b-faa4-4c82-9562-10c89290421b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:56:43.916245 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:43.916227 2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d03976b-faa4-4c82-9562-10c89290421b-model-cache\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:56:43.916329 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:43.916247 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttk2s\" (UniqueName: \"kubernetes.io/projected/3d03976b-faa4-4c82-9562-10c89290421b-kube-api-access-ttk2s\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:56:44.658204 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:44.658175 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-9qprq" Jul 02 13:56:44.658204 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:44.658197 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-9qprq" event={"ID":"3d03976b-faa4-4c82-9562-10c89290421b","Type":"ContainerDied","Data":"53beddcd4810f586010a626ea0bbf66516eb6b8101c7619a55c5f2e6f75d5a91"} Jul 02 13:56:44.658416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:44.658231 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53beddcd4810f586010a626ea0bbf66516eb6b8101c7619a55c5f2e6f75d5a91" Jul 02 13:56:52.406956 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.406926 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-custom-clw88"] Jul 02 13:56:52.407333 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.407198 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d03976b-faa4-4c82-9562-10c89290421b" containerName="download-hf-model" Jul 02 13:56:52.407333 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.407211 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d03976b-faa4-4c82-9562-10c89290421b" containerName="download-hf-model" Jul 02 13:56:52.407333 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.407222 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d03976b-faa4-4c82-9562-10c89290421b" containerName="s3-init" Jul 02 13:56:52.407333 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.407227 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d03976b-faa4-4c82-9562-10c89290421b" containerName="s3-init" Jul 02 13:56:52.407333 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.407275 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d03976b-faa4-4c82-9562-10c89290421b" containerName="s3-init" Jul 02 13:56:52.410281 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.410264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:56:52.415994 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.415970 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 02 13:56:52.416227 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.416204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-custom-artifact\"" Jul 02 13:56:52.416319 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.416204 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 02 13:56:52.416865 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.416833 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-97d78\"" Jul 02 13:56:52.422193 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.422170 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-clw88"] Jul 02 13:56:52.483335 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.483310 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcced529-63e2-4873-81b5-fb554f9eac7a-model-cache\") pod \"s3-tls-init-custom-clw88\" (UID: \"bcced529-63e2-4873-81b5-fb554f9eac7a\") " pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:56:52.483435 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.483352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvcrt\" (UniqueName: \"kubernetes.io/projected/bcced529-63e2-4873-81b5-fb554f9eac7a-kube-api-access-pvcrt\") pod \"s3-tls-init-custom-clw88\" (UID: \"bcced529-63e2-4873-81b5-fb554f9eac7a\") " pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:56:52.584067 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.584042 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcced529-63e2-4873-81b5-fb554f9eac7a-model-cache\") pod \"s3-tls-init-custom-clw88\" (UID: \"bcced529-63e2-4873-81b5-fb554f9eac7a\") " pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:56:52.584161 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.584085 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvcrt\" (UniqueName: \"kubernetes.io/projected/bcced529-63e2-4873-81b5-fb554f9eac7a-kube-api-access-pvcrt\") pod \"s3-tls-init-custom-clw88\" (UID: \"bcced529-63e2-4873-81b5-fb554f9eac7a\") " pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:56:52.584380 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.584363 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcced529-63e2-4873-81b5-fb554f9eac7a-model-cache\") pod \"s3-tls-init-custom-clw88\" (UID: \"bcced529-63e2-4873-81b5-fb554f9eac7a\") " pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:56:52.593163 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.593143 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvcrt\" (UniqueName: \"kubernetes.io/projected/bcced529-63e2-4873-81b5-fb554f9eac7a-kube-api-access-pvcrt\") pod \"s3-tls-init-custom-clw88\" (UID: \"bcced529-63e2-4873-81b5-fb554f9eac7a\") " pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:56:52.719524 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.719500 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:56:52.843636 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:52.843503 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-custom-clw88"] Jul 02 13:56:52.846291 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:56:52.846261 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcced529_63e2_4873_81b5_fb554f9eac7a.slice/crio-dbdd435531b523f2a95818a25018c7d9c313336fc2bb6de068cf04515e391a31 WatchSource:0}: Error finding container dbdd435531b523f2a95818a25018c7d9c313336fc2bb6de068cf04515e391a31: Status 404 returned error can't find the container with id dbdd435531b523f2a95818a25018c7d9c313336fc2bb6de068cf04515e391a31 Jul 02 13:56:53.692496 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:53.692458 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-clw88" event={"ID":"bcced529-63e2-4873-81b5-fb554f9eac7a","Type":"ContainerStarted","Data":"45e94b57cb318018377ddcc8c90ab4055d18a4b4838eb4b4f8d69ed2c1d9c30b"} Jul 02 13:56:53.692909 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:53.692508 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-clw88" event={"ID":"bcced529-63e2-4873-81b5-fb554f9eac7a","Type":"ContainerStarted","Data":"dbdd435531b523f2a95818a25018c7d9c313336fc2bb6de068cf04515e391a31"} Jul 02 13:56:55.701416 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:55.701384 2558 generic.go:356] "Generic (PLEG): container finished" podID="bcced529-63e2-4873-81b5-fb554f9eac7a" containerID="45e94b57cb318018377ddcc8c90ab4055d18a4b4838eb4b4f8d69ed2c1d9c30b" exitCode=0 Jul 02 13:56:55.701769 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:55.701446 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-clw88" event={"ID":"bcced529-63e2-4873-81b5-fb554f9eac7a","Type":"ContainerDied","Data":"45e94b57cb318018377ddcc8c90ab4055d18a4b4838eb4b4f8d69ed2c1d9c30b"} Jul 02 13:56:56.707826 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:56:56.707792 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-clw88" event={"ID":"bcced529-63e2-4873-81b5-fb554f9eac7a","Type":"ContainerStarted","Data":"9164901e11b37999df0a2e308dc368a413f9375ad177fc00dc8586695da57d90"} Jul 02 13:57:03.736596 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:03.736562 2558 generic.go:356] "Generic (PLEG): container finished" podID="bcced529-63e2-4873-81b5-fb554f9eac7a" containerID="9164901e11b37999df0a2e308dc368a413f9375ad177fc00dc8586695da57d90" exitCode=0 Jul 02 13:57:03.736953 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:03.736615 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-clw88" event={"ID":"bcced529-63e2-4873-81b5-fb554f9eac7a","Type":"ContainerDied","Data":"9164901e11b37999df0a2e308dc368a413f9375ad177fc00dc8586695da57d90"} Jul 02 13:57:04.886202 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:04.886173 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:57:04.976777 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:04.976734 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcced529-63e2-4873-81b5-fb554f9eac7a-model-cache\") pod \"bcced529-63e2-4873-81b5-fb554f9eac7a\" (UID: \"bcced529-63e2-4873-81b5-fb554f9eac7a\") " Jul 02 13:57:04.976962 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:04.976833 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pvcrt\" (UniqueName: \"kubernetes.io/projected/bcced529-63e2-4873-81b5-fb554f9eac7a-kube-api-access-pvcrt\") pod \"bcced529-63e2-4873-81b5-fb554f9eac7a\" (UID: \"bcced529-63e2-4873-81b5-fb554f9eac7a\") " Jul 02 13:57:04.978792 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:04.978762 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcced529-63e2-4873-81b5-fb554f9eac7a-kube-api-access-pvcrt" (OuterVolumeSpecName: "kube-api-access-pvcrt") pod "bcced529-63e2-4873-81b5-fb554f9eac7a" (UID: "bcced529-63e2-4873-81b5-fb554f9eac7a"). InnerVolumeSpecName "kube-api-access-pvcrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:57:04.996179 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:04.996126 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcced529-63e2-4873-81b5-fb554f9eac7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "bcced529-63e2-4873-81b5-fb554f9eac7a" (UID: "bcced529-63e2-4873-81b5-fb554f9eac7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:57:05.077833 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:05.077805 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pvcrt\" (UniqueName: \"kubernetes.io/projected/bcced529-63e2-4873-81b5-fb554f9eac7a-kube-api-access-pvcrt\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:57:05.077833 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:05.077829 2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bcced529-63e2-4873-81b5-fb554f9eac7a-model-cache\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:57:05.745875 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:05.745825 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-custom-clw88" event={"ID":"bcced529-63e2-4873-81b5-fb554f9eac7a","Type":"ContainerDied","Data":"dbdd435531b523f2a95818a25018c7d9c313336fc2bb6de068cf04515e391a31"} Jul 02 13:57:05.746056 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:05.745882 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbdd435531b523f2a95818a25018c7d9c313336fc2bb6de068cf04515e391a31" Jul 02 13:57:05.746056 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:05.745856 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-custom-clw88" Jul 02 13:57:07.703916 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.703884 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-tls-init-serving-jwv6d"] Jul 02 13:57:07.704254 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.704178 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcced529-63e2-4873-81b5-fb554f9eac7a" containerName="s3-tls-init-custom" Jul 02 13:57:07.704254 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.704191 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcced529-63e2-4873-81b5-fb554f9eac7a" containerName="s3-tls-init-custom" Jul 02 13:57:07.704254 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.704211 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcced529-63e2-4873-81b5-fb554f9eac7a" containerName="download-hf-model" Jul 02 13:57:07.704254 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.704216 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcced529-63e2-4873-81b5-fb554f9eac7a" containerName="download-hf-model" Jul 02 13:57:07.704386 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.704278 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcced529-63e2-4873-81b5-fb554f9eac7a" containerName="s3-tls-init-custom" Jul 02 13:57:07.707124 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.707109 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:07.709581 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.709557 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 02 13:57:07.709694 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.709557 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-97d78\"" Jul 02 13:57:07.710509 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.710491 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 02 13:57:07.710610 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.710497 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"seaweedfs-tls-serving-artifact\"" Jul 02 13:57:07.716288 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.716269 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-jwv6d"] Jul 02 13:57:07.796395 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.796367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a39a11-456b-484d-8323-f4a3efa017bb-model-cache\") pod \"s3-tls-init-serving-jwv6d\" (UID: \"f0a39a11-456b-484d-8323-f4a3efa017bb\") " pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:07.796526 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.796415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2fdd\" (UniqueName: \"kubernetes.io/projected/f0a39a11-456b-484d-8323-f4a3efa017bb-kube-api-access-w2fdd\") pod \"s3-tls-init-serving-jwv6d\" (UID: \"f0a39a11-456b-484d-8323-f4a3efa017bb\") " pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:07.897108 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.897083 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a39a11-456b-484d-8323-f4a3efa017bb-model-cache\") pod \"s3-tls-init-serving-jwv6d\" (UID: \"f0a39a11-456b-484d-8323-f4a3efa017bb\") " pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:07.897228 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.897139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2fdd\" (UniqueName: \"kubernetes.io/projected/f0a39a11-456b-484d-8323-f4a3efa017bb-kube-api-access-w2fdd\") pod \"s3-tls-init-serving-jwv6d\" (UID: \"f0a39a11-456b-484d-8323-f4a3efa017bb\") " pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:07.897508 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.897491 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a39a11-456b-484d-8323-f4a3efa017bb-model-cache\") pod \"s3-tls-init-serving-jwv6d\" (UID: \"f0a39a11-456b-484d-8323-f4a3efa017bb\") " pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:07.906150 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:07.906127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2fdd\" (UniqueName: \"kubernetes.io/projected/f0a39a11-456b-484d-8323-f4a3efa017bb-kube-api-access-w2fdd\") pod \"s3-tls-init-serving-jwv6d\" (UID: \"f0a39a11-456b-484d-8323-f4a3efa017bb\") " pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:08.016555 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:08.016485 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:08.142672 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:08.142641 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-tls-init-serving-jwv6d"] Jul 02 13:57:08.146633 ip-10-0-133-48 kubenswrapper[2558]: W0702 13:57:08.146609 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0a39a11_456b_484d_8323_f4a3efa017bb.slice/crio-12070c059eeed85429b41f1814007f3b1f8ac11efd2c9f3b294f37091fb060e2 WatchSource:0}: Error finding container 12070c059eeed85429b41f1814007f3b1f8ac11efd2c9f3b294f37091fb060e2: Status 404 returned error can't find the container with id 12070c059eeed85429b41f1814007f3b1f8ac11efd2c9f3b294f37091fb060e2 Jul 02 13:57:08.761279 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:08.761240 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-jwv6d" event={"ID":"f0a39a11-456b-484d-8323-f4a3efa017bb","Type":"ContainerStarted","Data":"0e8fee4ced477d6ba030b7da91ca9065ff3d6830e94cafe816da3e5242aefea9"} Jul 02 13:57:08.761279 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:08.761276 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-jwv6d" event={"ID":"f0a39a11-456b-484d-8323-f4a3efa017bb","Type":"ContainerStarted","Data":"12070c059eeed85429b41f1814007f3b1f8ac11efd2c9f3b294f37091fb060e2"} Jul 02 13:57:10.771303 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:10.771271 2558 generic.go:356] "Generic (PLEG): container finished" podID="f0a39a11-456b-484d-8323-f4a3efa017bb" containerID="0e8fee4ced477d6ba030b7da91ca9065ff3d6830e94cafe816da3e5242aefea9" exitCode=0 Jul 02 13:57:10.771668 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:10.771320 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-jwv6d" event={"ID":"f0a39a11-456b-484d-8323-f4a3efa017bb","Type":"ContainerDied","Data":"0e8fee4ced477d6ba030b7da91ca9065ff3d6830e94cafe816da3e5242aefea9"} Jul 02 13:57:11.776973 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:11.776941 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-jwv6d" event={"ID":"f0a39a11-456b-484d-8323-f4a3efa017bb","Type":"ContainerStarted","Data":"29f8f3c8b2f154733b0439c1bbc80260d3d8cb21591a6966eb889259ce99c5b5"} Jul 02 13:57:11.794244 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:11.794201 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-tls-init-serving-jwv6d" podStartSLOduration=3.201359478 podStartE2EDuration="4.794187033s" totalImagesPullingTime="0s" totalInitContainerRuntime="1.592827555s" isStatefulPod=false podCreationTimestamp="2026-07-02 13:57:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 13:57:11.792802471 +0000 UTC m=+720.188090515" watchObservedRunningTime="2026-07-02 13:57:11.794187033 +0000 UTC m=+720.189475079" Jul 02 13:57:17.804963 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:17.804925 2558 generic.go:356] "Generic (PLEG): container finished" podID="f0a39a11-456b-484d-8323-f4a3efa017bb" containerID="29f8f3c8b2f154733b0439c1bbc80260d3d8cb21591a6966eb889259ce99c5b5" exitCode=0 Jul 02 13:57:17.805437 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:17.804988 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-jwv6d" event={"ID":"f0a39a11-456b-484d-8323-f4a3efa017bb","Type":"ContainerDied","Data":"29f8f3c8b2f154733b0439c1bbc80260d3d8cb21591a6966eb889259ce99c5b5"} Jul 02 13:57:18.952417 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:18.952393 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:19.079814 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.079747 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a39a11-456b-484d-8323-f4a3efa017bb-model-cache\") pod \"f0a39a11-456b-484d-8323-f4a3efa017bb\" (UID: \"f0a39a11-456b-484d-8323-f4a3efa017bb\") " Jul 02 13:57:19.079814 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.079800 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2fdd\" (UniqueName: \"kubernetes.io/projected/f0a39a11-456b-484d-8323-f4a3efa017bb-kube-api-access-w2fdd\") pod \"f0a39a11-456b-484d-8323-f4a3efa017bb\" (UID: \"f0a39a11-456b-484d-8323-f4a3efa017bb\") " Jul 02 13:57:19.081753 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.081721 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a39a11-456b-484d-8323-f4a3efa017bb-kube-api-access-w2fdd" (OuterVolumeSpecName: "kube-api-access-w2fdd") pod "f0a39a11-456b-484d-8323-f4a3efa017bb" (UID: "f0a39a11-456b-484d-8323-f4a3efa017bb"). InnerVolumeSpecName "kube-api-access-w2fdd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 13:57:19.101305 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.101283 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0a39a11-456b-484d-8323-f4a3efa017bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "f0a39a11-456b-484d-8323-f4a3efa017bb" (UID: "f0a39a11-456b-484d-8323-f4a3efa017bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 13:57:19.181256 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.181231 2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f0a39a11-456b-484d-8323-f4a3efa017bb-model-cache\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:57:19.181256 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.181253 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2fdd\" (UniqueName: \"kubernetes.io/projected/f0a39a11-456b-484d-8323-f4a3efa017bb-kube-api-access-w2fdd\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 13:57:19.813752 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.813721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-tls-init-serving-jwv6d" event={"ID":"f0a39a11-456b-484d-8323-f4a3efa017bb","Type":"ContainerDied","Data":"12070c059eeed85429b41f1814007f3b1f8ac11efd2c9f3b294f37091fb060e2"} Jul 02 13:57:19.813752 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.813743 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-tls-init-serving-jwv6d" Jul 02 13:57:19.813752 ip-10-0-133-48 kubenswrapper[2558]: I0702 13:57:19.813756 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="12070c059eeed85429b41f1814007f3b1f8ac11efd2c9f3b294f37091fb060e2" Jul 02 14:00:12.023501 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:00:12.023469 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 14:00:12.023501 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:00:12.023486 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 14:05:12.047730 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:05:12.047687 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 14:05:12.048291 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:05:12.047870 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 14:10:12.074673 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:10:12.074647 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 14:10:12.074673 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:10:12.074666 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 14:12:35.134088 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.134054 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wrwz8/must-gather-mf2qz"] Jul 02 14:12:35.134525 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.134307 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a39a11-456b-484d-8323-f4a3efa017bb" containerName="s3-tls-init-serving" Jul 02 14:12:35.134525 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.134318 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a39a11-456b-484d-8323-f4a3efa017bb" containerName="s3-tls-init-serving" Jul 02 14:12:35.134525 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.134333 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a39a11-456b-484d-8323-f4a3efa017bb" containerName="download-hf-model" Jul 02 14:12:35.134525 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.134339 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a39a11-456b-484d-8323-f4a3efa017bb" containerName="download-hf-model" Jul 02 14:12:35.134525 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.134389 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a39a11-456b-484d-8323-f4a3efa017bb" containerName="s3-tls-init-serving" Jul 02 14:12:35.137312 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.137297 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:12:35.139599 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.139577 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wrwz8\"/\"default-dockercfg-zfxgx\"" Jul 02 14:12:35.140460 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.140423 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wrwz8\"/\"openshift-service-ca.crt\"" Jul 02 14:12:35.140581 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.140536 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wrwz8\"/\"kube-root-ca.crt\"" Jul 02 14:12:35.147996 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.147974 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wrwz8/must-gather-mf2qz"] Jul 02 14:12:35.232549 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.232516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ec85a7ce-8590-46c9-b023-604e5528e122-must-gather-output\") pod \"must-gather-mf2qz\" (UID: \"ec85a7ce-8590-46c9-b023-604e5528e122\") " pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:12:35.232700 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.232591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd6dt\" (UniqueName: \"kubernetes.io/projected/ec85a7ce-8590-46c9-b023-604e5528e122-kube-api-access-nd6dt\") pod \"must-gather-mf2qz\" (UID: \"ec85a7ce-8590-46c9-b023-604e5528e122\") " pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:12:35.333890 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.333847 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd6dt\" (UniqueName: \"kubernetes.io/projected/ec85a7ce-8590-46c9-b023-604e5528e122-kube-api-access-nd6dt\") pod \"must-gather-mf2qz\" (UID: \"ec85a7ce-8590-46c9-b023-604e5528e122\") " pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:12:35.334063 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.333907 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ec85a7ce-8590-46c9-b023-604e5528e122-must-gather-output\") pod \"must-gather-mf2qz\" (UID: \"ec85a7ce-8590-46c9-b023-604e5528e122\") " pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:12:35.334254 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.334233 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ec85a7ce-8590-46c9-b023-604e5528e122-must-gather-output\") pod \"must-gather-mf2qz\" (UID: \"ec85a7ce-8590-46c9-b023-604e5528e122\") " pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:12:35.350332 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.350299 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd6dt\" (UniqueName: \"kubernetes.io/projected/ec85a7ce-8590-46c9-b023-604e5528e122-kube-api-access-nd6dt\") pod \"must-gather-mf2qz\" (UID: \"ec85a7ce-8590-46c9-b023-604e5528e122\") " pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:12:35.445986 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.445965 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:12:35.574669 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.574647 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wrwz8/must-gather-mf2qz"] Jul 02 14:12:35.576731 ip-10-0-133-48 kubenswrapper[2558]: W0702 14:12:35.576699 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec85a7ce_8590_46c9_b023_604e5528e122.slice/crio-acf63867c260497279f3ba766cfd932ba09dad076175fa9beaa0076b8d90fd73 WatchSource:0}: Error finding container acf63867c260497279f3ba766cfd932ba09dad076175fa9beaa0076b8d90fd73: Status 404 returned error can't find the container with id acf63867c260497279f3ba766cfd932ba09dad076175fa9beaa0076b8d90fd73 Jul 02 14:12:35.578520 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:35.578501 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 14:12:36.115567 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:36.115536 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" event={"ID":"ec85a7ce-8590-46c9-b023-604e5528e122","Type":"ContainerStarted","Data":"acf63867c260497279f3ba766cfd932ba09dad076175fa9beaa0076b8d90fd73"} Jul 02 14:12:42.143536 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:42.143502 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" event={"ID":"ec85a7ce-8590-46c9-b023-604e5528e122","Type":"ContainerStarted","Data":"24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59"} Jul 02 14:12:42.143927 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:42.143551 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" event={"ID":"ec85a7ce-8590-46c9-b023-604e5528e122","Type":"ContainerStarted","Data":"4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac"} Jul 02 14:12:42.162987 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:12:42.162930 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" podStartSLOduration=1.131083386 podStartE2EDuration="7.162913037s" totalImagesPullingTime="6.031829651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 14:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:12:42.161851027 +0000 UTC m=+1650.557139064" watchObservedRunningTime="2026-07-02 14:12:42.162913037 +0000 UTC m=+1650.558201081" Jul 02 14:13:02.223712 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:02.223678 2558 generic.go:356] "Generic (PLEG): container finished" podID="ec85a7ce-8590-46c9-b023-604e5528e122" containerID="4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac" exitCode=0 Jul 02 14:13:02.224237 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:02.223746 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" event={"ID":"ec85a7ce-8590-46c9-b023-604e5528e122","Type":"ContainerDied","Data":"4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac"} Jul 02 14:13:02.224237 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:02.224159 2558 scope.go:117] "RemoveContainer" containerID="4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac" Jul 02 14:13:03.106411 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:03.106382 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wrwz8_must-gather-mf2qz_ec85a7ce-8590-46c9-b023-604e5528e122/gather/0.log" Jul 02 14:13:06.975596 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:06.975567 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5mb6x_63919b3f-cf3a-4123-8c08-f8523c0cffa1/global-pull-secret-syncer/0.log" Jul 02 14:13:07.220006 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:07.219967 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-95jv6_351f0159-6a82-4ea3-a98a-bfd340dd2d77/konnectivity-agent/0.log" Jul 02 14:13:07.296168 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:07.296094 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-48.ec2.internal_2f3af09ff95337a8d907ef00f73c36b6/haproxy/0.log" Jul 02 14:13:08.463668 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.463635 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-wrwz8/must-gather-mf2qz"] Jul 02 14:13:08.464162 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.463875 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" containerName="copy" containerID="cri-o://24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59" gracePeriod=2 Jul 02 14:13:08.465559 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.465539 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-wrwz8/must-gather-mf2qz"] Jul 02 14:13:08.466554 ip-10-0-133-48 kubenswrapper[2558]: E0702 14:13:08.466522 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-mf2qz\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wrwz8\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:13:08.685179 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.685158 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wrwz8_must-gather-mf2qz_ec85a7ce-8590-46c9-b023-604e5528e122/copy/0.log" Jul 02 14:13:08.686505 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.686490 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:13:08.688769 ip-10-0-133-48 kubenswrapper[2558]: E0702 14:13:08.688744 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-mf2qz\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wrwz8\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:13:08.695079 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.695066 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd6dt\" (UniqueName: \"kubernetes.io/projected/ec85a7ce-8590-46c9-b023-604e5528e122-kube-api-access-nd6dt\") pod \"ec85a7ce-8590-46c9-b023-604e5528e122\" (UID: \"ec85a7ce-8590-46c9-b023-604e5528e122\") " Jul 02 14:13:08.695147 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.695110 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ec85a7ce-8590-46c9-b023-604e5528e122-must-gather-output\") pod \"ec85a7ce-8590-46c9-b023-604e5528e122\" (UID: \"ec85a7ce-8590-46c9-b023-604e5528e122\") " Jul 02 14:13:08.696288 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.696260 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec85a7ce-8590-46c9-b023-604e5528e122-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "ec85a7ce-8590-46c9-b023-604e5528e122" (UID: "ec85a7ce-8590-46c9-b023-604e5528e122"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 14:13:08.697100 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.697078 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec85a7ce-8590-46c9-b023-604e5528e122-kube-api-access-nd6dt" (OuterVolumeSpecName: "kube-api-access-nd6dt") pod "ec85a7ce-8590-46c9-b023-604e5528e122" (UID: "ec85a7ce-8590-46c9-b023-604e5528e122"). InnerVolumeSpecName "kube-api-access-nd6dt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 14:13:08.796514 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.796443 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd6dt\" (UniqueName: \"kubernetes.io/projected/ec85a7ce-8590-46c9-b023-604e5528e122-kube-api-access-nd6dt\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 14:13:08.796514 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:08.796484 2558 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ec85a7ce-8590-46c9-b023-604e5528e122-must-gather-output\") on node \"ip-10-0-133-48.ec2.internal\" DevicePath \"\"" Jul 02 14:13:09.254293 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.254267 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-wrwz8_must-gather-mf2qz_ec85a7ce-8590-46c9-b023-604e5528e122/copy/0.log" Jul 02 14:13:09.254661 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.254636 2558 generic.go:356] "Generic (PLEG): container finished" podID="ec85a7ce-8590-46c9-b023-604e5528e122" containerID="24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59" exitCode=143 Jul 02 14:13:09.254710 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.254676 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:13:09.254746 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.254710 2558 scope.go:117] "RemoveContainer" containerID="24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59" Jul 02 14:13:09.259565 ip-10-0-133-48 kubenswrapper[2558]: E0702 14:13:09.259536 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-mf2qz\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wrwz8\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:13:09.263639 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.263618 2558 scope.go:117] "RemoveContainer" containerID="4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac" Jul 02 14:13:09.269427 ip-10-0-133-48 kubenswrapper[2558]: E0702 14:13:09.269399 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-mf2qz\" is forbidden: User \"system:node:ip-10-0-133-48.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-wrwz8\": no relationship found between node 'ip-10-0-133-48.ec2.internal' and this object" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" pod="openshift-must-gather-wrwz8/must-gather-mf2qz" Jul 02 14:13:09.275750 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.275735 2558 scope.go:117] "RemoveContainer" containerID="24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59" Jul 02 14:13:09.275990 ip-10-0-133-48 kubenswrapper[2558]: E0702 14:13:09.275972 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59\": container with ID starting with 24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59 not found: ID does not exist" containerID="24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59" Jul 02 14:13:09.276047 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.276002 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59"} err="failed to get container status \"24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59\": rpc error: code = NotFound desc = could not find container \"24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59\": container with ID starting with 24e268d2881dec13769f74a2fd831ead3bd2a909a5f062445cc6bda62bd52d59 not found: ID does not exist" Jul 02 14:13:09.276047 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.276019 2558 scope.go:117] "RemoveContainer" containerID="4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac" Jul 02 14:13:09.276241 ip-10-0-133-48 kubenswrapper[2558]: E0702 14:13:09.276224 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac\": container with ID starting with 4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac not found: ID does not exist" containerID="4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac" Jul 02 14:13:09.276292 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:09.276250 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac"} err="failed to get container status \"4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac\": rpc error: code = NotFound desc = could not find container \"4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac\": container with ID starting with 4f0d2adaa568b7d0e7040cd04a4abed1b4ad3c137fc3c5860f3580b1a0524dac not found: ID does not exist" Jul 02 14:13:10.073672 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:10.073638 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" path="/var/lib/kubelet/pods/ec85a7ce-8590-46c9-b023-604e5528e122/volumes" Jul 02 14:13:11.654311 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:11.654236 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-khkj6_903b4f1f-5f6e-46c1-9df1-d1adf2424f88/cluster-monitoring-operator/0.log" Jul 02 14:13:11.780393 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:11.780361 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5f9c668684-gg5z4_946f30c3-8ab1-42a2-bacd-47548825ba32/metrics-server/0.log" Jul 02 14:13:11.943361 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:11.943335 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqzrt_4ba2697a-8ef7-4539-b727-1e3b33bbd966/node-exporter/0.log" Jul 02 14:13:11.975888 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:11.975857 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqzrt_4ba2697a-8ef7-4539-b727-1e3b33bbd966/kube-rbac-proxy/0.log" Jul 02 14:13:12.005910 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.005887 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqzrt_4ba2697a-8ef7-4539-b727-1e3b33bbd966/init-textfile/0.log" Jul 02 14:13:12.151239 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.151211 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-gc2dg_791e71b4-011f-4c17-b21a-2f1cd1c21e3d/kube-rbac-proxy-main/0.log" Jul 02 14:13:12.177778 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.177756 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-gc2dg_791e71b4-011f-4c17-b21a-2f1cd1c21e3d/kube-rbac-proxy-self/0.log" Jul 02 14:13:12.202596 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.202539 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-gc2dg_791e71b4-011f-4c17-b21a-2f1cd1c21e3d/openshift-state-metrics/0.log" Jul 02 14:13:12.244580 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.244551 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_852dc927-3563-4a45-9a7e-872b0000c110/prometheus/0.log" Jul 02 14:13:12.271270 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.271243 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_852dc927-3563-4a45-9a7e-872b0000c110/config-reloader/0.log" Jul 02 14:13:12.302240 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.302218 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_852dc927-3563-4a45-9a7e-872b0000c110/thanos-sidecar/0.log" Jul 02 14:13:12.328252 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.328227 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_852dc927-3563-4a45-9a7e-872b0000c110/kube-rbac-proxy-web/0.log" Jul 02 14:13:12.354701 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.354682 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_852dc927-3563-4a45-9a7e-872b0000c110/kube-rbac-proxy/0.log" Jul 02 14:13:12.379379 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.379359 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_852dc927-3563-4a45-9a7e-872b0000c110/kube-rbac-proxy-thanos/0.log" Jul 02 14:13:12.405168 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:12.405150 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_852dc927-3563-4a45-9a7e-872b0000c110/init-config-reloader/0.log" Jul 02 14:13:15.528576 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.528547 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-v29f2_3a51e800-2b2b-4aff-b610-127cd217a01d/volume-data-source-validator/0.log" Jul 02 14:13:15.711795 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.711764 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm"] Jul 02 14:13:15.712073 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.712056 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" containerName="copy" Jul 02 14:13:15.712073 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.712073 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" containerName="copy" Jul 02 14:13:15.712198 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.712086 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" containerName="gather" Jul 02 14:13:15.712198 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.712092 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" containerName="gather" Jul 02 14:13:15.712198 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.712133 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" containerName="gather" Jul 02 14:13:15.712198 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.712141 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec85a7ce-8590-46c9-b023-604e5528e122" containerName="copy" Jul 02 14:13:15.714400 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.714380 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.716956 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.716937 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hs76s\"/\"openshift-service-ca.crt\"" Jul 02 14:13:15.717864 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.717830 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hs76s\"/\"default-dockercfg-2gmp6\"" Jul 02 14:13:15.717864 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.717861 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hs76s\"/\"kube-root-ca.crt\"" Jul 02 14:13:15.728414 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.728389 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm"] Jul 02 14:13:15.751730 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.751706 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-proc\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.751867 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.751736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-lib-modules\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.751867 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.751768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-podres\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.751867 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.751858 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd89w\" (UniqueName: \"kubernetes.io/projected/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-kube-api-access-xd89w\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.751998 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.751903 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-sys\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852293 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd89w\" (UniqueName: \"kubernetes.io/projected/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-kube-api-access-xd89w\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852293 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852260 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-sys\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852293 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852283 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-proc\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852556 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-lib-modules\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852556 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852358 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-podres\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852556 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-sys\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852556 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-proc\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852556 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852487 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-lib-modules\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.852556 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.852489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-podres\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:15.861054 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:15.861026 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd89w\" (UniqueName: \"kubernetes.io/projected/b28a6cfd-e738-4b5e-8949-41ed3c5ebabe-kube-api-access-xd89w\") pod \"perf-node-gather-daemonset-pv4gm\" (UID: \"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe\") " pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:16.026905 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:16.026873 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:16.158047 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:16.158018 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm"] Jul 02 14:13:16.160631 ip-10-0-133-48 kubenswrapper[2558]: W0702 14:13:16.160605 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb28a6cfd_e738_4b5e_8949_41ed3c5ebabe.slice/crio-d29cfb30a6004ed2ce4f3b032ad84591f62243174c1939be3ae13157002bc625 WatchSource:0}: Error finding container d29cfb30a6004ed2ce4f3b032ad84591f62243174c1939be3ae13157002bc625: Status 404 returned error can't find the container with id d29cfb30a6004ed2ce4f3b032ad84591f62243174c1939be3ae13157002bc625 Jul 02 14:13:16.281724 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:16.281693 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" event={"ID":"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe","Type":"ContainerStarted","Data":"d29cfb30a6004ed2ce4f3b032ad84591f62243174c1939be3ae13157002bc625"} Jul 02 14:13:16.543290 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:16.543257 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hcdg_2d7721b5-b5a0-47d5-915b-60e4dfa052c7/dns/0.log" Jul 02 14:13:16.568319 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:16.568293 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6hcdg_2d7721b5-b5a0-47d5-915b-60e4dfa052c7/kube-rbac-proxy/0.log" Jul 02 14:13:16.749446 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:16.749410 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-znnmt_cbcd4a1e-b369-4587-9a15-c87a6d1121ee/dns-node-resolver/0.log" Jul 02 14:13:17.287179 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:17.287142 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" event={"ID":"b28a6cfd-e738-4b5e-8949-41ed3c5ebabe","Type":"ContainerStarted","Data":"1b5d1cffe58dd408b82f6392d3444c00f8d74e11cd39f3c6cf82becf9bdd23be"} Jul 02 14:13:17.287352 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:17.287271 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:17.306301 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:17.306253 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" podStartSLOduration=2.306239582 podStartE2EDuration="2.306239582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 14:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 14:13:17.304788057 +0000 UTC m=+1685.700076102" watchObservedRunningTime="2026-07-02 14:13:17.306239582 +0000 UTC m=+1685.701527662" Jul 02 14:13:17.409821 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:17.409791 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7rlc8_5de12f9a-dfde-4118-b292-a9d0555206ea/node-ca/0.log" Jul 02 14:13:18.721298 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:18.721262 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-v7rkx_8ae65fdd-c373-4d88-8021-474f004b21a1/serve-healthcheck-canary/0.log" Jul 02 14:13:19.211173 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:19.211142 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n7k8v_64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37/kube-rbac-proxy/0.log" Jul 02 14:13:19.237722 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:19.237696 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n7k8v_64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37/exporter/0.log" Jul 02 14:13:19.261024 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:19.261001 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n7k8v_64b71fe7-2e62-4b1d-a73b-dbb7f4d4ea37/extractor/0.log" Jul 02 14:13:21.741683 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:21.741653 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-9qprq_3d03976b-faa4-4c82-9562-10c89290421b/s3-init/0.log" Jul 02 14:13:21.759538 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:21.759514 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-9qprq_3d03976b-faa4-4c82-9562-10c89290421b/download-hf-model/0.log" Jul 02 14:13:21.795528 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:21.795502 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-clw88_bcced529-63e2-4873-81b5-fb554f9eac7a/s3-tls-init-custom/0.log" Jul 02 14:13:21.812099 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:21.812075 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-custom-clw88_bcced529-63e2-4873-81b5-fb554f9eac7a/download-hf-model/0.log" Jul 02 14:13:21.846651 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:21.846627 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-jwv6d_f0a39a11-456b-484d-8323-f4a3efa017bb/s3-tls-init-serving/0.log" Jul 02 14:13:21.863922 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:21.863906 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-tls-init-serving-jwv6d_f0a39a11-456b-484d-8323-f4a3efa017bb/download-hf-model/0.log" Jul 02 14:13:23.302877 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:23.302850 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hs76s/perf-node-gather-daemonset-pv4gm" Jul 02 14:13:26.360387 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:26.360357 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-9zgbb_1b55c20f-0a5d-4cbc-893b-6fba6b7ca618/migrator/0.log" Jul 02 14:13:26.401819 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:26.401796 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-9zgbb_1b55c20f-0a5d-4cbc-893b-6fba6b7ca618/graceful-termination/0.log" Jul 02 14:13:27.829830 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:27.829800 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2j2fk_2f515a57-205a-4764-b435-fcdecd75ffdc/kube-multus/0.log" Jul 02 14:13:27.861925 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:27.861902 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fxjtn_5fa98ade-4a63-473a-a09f-6f54d3df0d25/kube-multus-additional-cni-plugins/0.log" Jul 02 14:13:27.888430 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:27.888410 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fxjtn_5fa98ade-4a63-473a-a09f-6f54d3df0d25/egress-router-binary-copy/0.log" Jul 02 14:13:27.914394 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:27.914372 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fxjtn_5fa98ade-4a63-473a-a09f-6f54d3df0d25/cni-plugins/0.log" Jul 02 14:13:27.936864 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:27.936829 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fxjtn_5fa98ade-4a63-473a-a09f-6f54d3df0d25/bond-cni-plugin/0.log" Jul 02 14:13:27.961079 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:27.961063 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fxjtn_5fa98ade-4a63-473a-a09f-6f54d3df0d25/routeoverride-cni/0.log" Jul 02 14:13:27.986226 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:27.986204 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fxjtn_5fa98ade-4a63-473a-a09f-6f54d3df0d25/whereabouts-cni-bincopy/0.log" Jul 02 14:13:28.017017 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:28.016998 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fxjtn_5fa98ade-4a63-473a-a09f-6f54d3df0d25/whereabouts-cni/0.log" Jul 02 14:13:28.590658 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:28.590625 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nbqdb_ba4897bc-da40-4c75-be21-0c624f676e8a/network-metrics-daemon/0.log" Jul 02 14:13:28.611858 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:28.611813 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nbqdb_ba4897bc-da40-4c75-be21-0c624f676e8a/kube-rbac-proxy/0.log" Jul 02 14:13:29.513703 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.513678 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-controller/0.log" Jul 02 14:13:29.537793 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.537770 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/1.log" Jul 02 14:13:29.537957 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.537805 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovn-acl-logging/0.log" Jul 02 14:13:29.566392 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.566367 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/kube-rbac-proxy-node/0.log" Jul 02 14:13:29.598484 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.598462 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 14:13:29.622670 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.622648 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/northd/0.log" Jul 02 14:13:29.645903 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.645876 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/nbdb/0.log" Jul 02 14:13:29.673808 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.673790 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/sbdb/0.log" Jul 02 14:13:29.738704 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:29.738680 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-825xg_0f54bf60-0685-4668-8fd6-2cf589af983f/ovnkube-controller/0.log" Jul 02 14:13:31.432556 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:31.432525 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-pdqvz_3b1fe649-41e5-4a6f-b042-6c1ac5fd52fd/network-check-target-container/0.log" Jul 02 14:13:32.431587 ip-10-0-133-48 kubenswrapper[2558]: I0702 14:13:32.431559 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8g9k2_a308d647-b99e-4fb7-b747-32e534eb8617/iptables-alerter/0.log"