Jul 01 20:46:27.758721 ip-10-0-129-25 systemd[1]: Starting Kubernetes Kubelet... Jul 01 20:46:28.176285 ip-10-0-129-25 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:46:28.176285 ip-10-0-129-25 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 20:46:28.176285 ip-10-0-129-25 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:46:28.176285 ip-10-0-129-25 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 20:46:28.176285 ip-10-0-129-25 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 20:46:28.178840 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.178768 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 20:46:28.185258 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185242 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:46:28.185258 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185258 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185262 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185265 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185268 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185271 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185273 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185277 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185280 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185283 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185286 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185290 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185293 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185295 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185298 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185300 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185303 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185306 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185308 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185315 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:46:28.185323 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185318 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185321 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185323 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185325 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185329 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185332 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185335 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185337 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185340 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185342 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185345 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185347 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185349 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185352 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185354 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185357 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185359 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185362 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185364 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185366 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:46:28.185803 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185369 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185371 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185373 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185376 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185380 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185382 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185384 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185386 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185389 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185391 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185394 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185396 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185399 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185402 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185407 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185411 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185414 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185417 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185420 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:46:28.186281 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185423 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185425 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185428 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185431 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185434 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185437 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185439 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185442 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185444 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185446 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185448 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185451 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185465 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185468 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185471 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185473 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185476 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185478 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185481 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185483 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:46:28.186756 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185486 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185488 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185512 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185515 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185518 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185521 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185523 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185527 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185530 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185532 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185535 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185538 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185540 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185543 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185545 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185548 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185550 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185553 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185555 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.185558 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:46:28.187276 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186249 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186255 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186258 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186261 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186263 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186265 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186268 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186274 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186278 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186280 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186284 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186287 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186290 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186294 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186297 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186299 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186302 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186304 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186307 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186309 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:46:28.187776 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186312 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186315 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186317 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186320 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186323 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186325 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186328 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186330 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186333 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186335 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186338 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186340 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186343 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186347 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186350 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186352 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186355 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186358 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186360 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186363 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:46:28.188297 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186365 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186368 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186371 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186374 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186378 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186380 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186383 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186386 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186388 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186391 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186394 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186396 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186398 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186401 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186403 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186406 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186408 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186411 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186413 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:46:28.188787 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186416 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186418 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186421 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186423 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186426 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186428 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186430 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186435 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186438 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186441 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186443 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186446 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186448 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186450 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186468 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186470 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186473 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186476 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186479 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:46:28.189243 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186482 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186485 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186487 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186490 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186493 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186495 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186497 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186500 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186502 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186505 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186507 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186509 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186512 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186514 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186517 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186519 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186522 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186524 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186527 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186529 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:46:28.189718 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186531 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186881 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186886 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186888 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186891 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186894 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186897 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186899 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186902 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186904 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186907 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186910 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186915 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186918 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186920 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186923 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186925 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186928 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186932 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:46:28.190188 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186935 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186938 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186941 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186944 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186947 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186950 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186952 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186955 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186957 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186960 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186963 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186966 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186970 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186973 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186975 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186978 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186980 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186983 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186985 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:46:28.190648 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186987 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186989 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186992 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186994 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186997 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.186999 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187004 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187006 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187009 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187012 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187014 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187016 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187019 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187022 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187024 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187027 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187030 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187032 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187035 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187037 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:46:28.191108 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187040 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187042 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187045 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187047 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187051 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187053 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187056 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187058 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187061 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187063 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187066 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187068 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187070 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187073 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187075 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187077 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187080 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187082 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187086 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:46:28.191618 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187089 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187091 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187095 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187097 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187100 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187103 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187105 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187107 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187110 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187112 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187115 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187117 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187120 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187122 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187125 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187127 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187129 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187132 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187143 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187146 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:46:28.192086 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187148 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187151 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187153 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187228 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187238 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187244 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187249 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187255 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187260 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187266 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187272 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187277 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187281 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187285 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187289 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187292 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187295 2562 flags.go:64] FLAG: --cgroup-root="" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187298 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187301 2562 flags.go:64] FLAG: --client-ca-file="" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187303 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187306 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187310 2562 flags.go:64] FLAG: --cluster-domain="" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187313 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 20:46:28.192578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187316 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187318 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187322 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187325 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187328 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187331 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187333 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187336 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187339 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187342 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187345 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187348 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187351 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187354 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187357 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187359 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187362 2562 flags.go:64] FLAG: --enable-server="true" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187365 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187370 2562 flags.go:64] FLAG: --event-burst="100" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187373 2562 flags.go:64] FLAG: --event-qps="50" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187376 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187379 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187382 2562 flags.go:64] FLAG: --eviction-hard="" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187386 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 20:46:28.193145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187388 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187392 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187394 2562 flags.go:64] FLAG: --eviction-soft="" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187397 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187400 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187402 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187405 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187408 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187410 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187413 2562 flags.go:64] FLAG: --feature-gates="" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187416 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187419 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187422 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187425 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187427 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187430 2562 flags.go:64] FLAG: --help="false" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187433 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187436 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187439 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187441 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187444 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187447 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187450 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 20:46:28.193726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187465 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187468 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187471 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187475 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187478 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187481 2562 flags.go:64] FLAG: --kube-reserved="" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187484 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187487 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187490 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187493 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187496 2562 flags.go:64] FLAG: --lock-file="" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187498 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187501 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187504 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187509 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187512 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187515 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187517 2562 flags.go:64] FLAG: --logging-format="text" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187520 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187523 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187526 2562 flags.go:64] FLAG: --manifest-url="" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187529 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187532 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187535 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187542 2562 flags.go:64] FLAG: --max-pods="110" Jul 01 20:46:28.194358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187545 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187548 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187551 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187553 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187556 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187559 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187562 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187568 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187571 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187574 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187578 2562 flags.go:64] FLAG: --pod-cidr="" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187581 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187586 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187589 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187593 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187595 2562 flags.go:64] FLAG: --port="10250" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187598 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187601 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05b05d08d6556a40a" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187604 2562 flags.go:64] FLAG: --qos-reserved="" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187607 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187610 2562 flags.go:64] FLAG: --register-node="true" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187613 2562 flags.go:64] FLAG: --register-with-taints="" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187616 2562 flags.go:64] FLAG: --registry-burst="10" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187619 2562 flags.go:64] FLAG: --registry-qps="5" Jul 01 20:46:28.195320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187622 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187624 2562 flags.go:64] FLAG: --reserved-memory="" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187627 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187630 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187633 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187636 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187639 2562 flags.go:64] FLAG: --runonce="false" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187641 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187644 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187647 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187650 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187652 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187655 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187658 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187661 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187664 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187666 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187669 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187673 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187676 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187678 2562 flags.go:64] FLAG: --system-cgroups="" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187681 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187686 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187689 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187691 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 20:46:28.196035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187695 2562 flags.go:64] FLAG: --tls-min-version="" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187698 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187701 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187704 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187706 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187709 2562 flags.go:64] FLAG: --v="2" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187712 2562 flags.go:64] FLAG: --version="false" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187716 2562 flags.go:64] FLAG: --vmodule="" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187719 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.187722 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187844 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187848 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187851 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187854 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187857 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187859 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187862 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187864 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187866 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187869 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187871 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:46:28.196657 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187875 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187878 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187882 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187884 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187888 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187890 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187892 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187896 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187898 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187901 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187903 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187906 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187908 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187911 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187914 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187916 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187919 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187922 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187925 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187927 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:46:28.197206 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187930 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187932 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187934 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187937 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187939 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187942 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187944 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187947 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187951 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187954 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187956 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187958 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187961 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187963 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187966 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187968 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187971 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187974 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187976 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:46:28.197708 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187980 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187982 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187984 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187987 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187989 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187991 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187994 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187997 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.187999 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188001 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188004 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188006 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188009 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188011 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188013 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188016 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188018 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188021 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188023 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188025 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:46:28.198177 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188028 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188030 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188032 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188035 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188037 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188040 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188042 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188045 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188047 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188050 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188053 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188055 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188059 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188062 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188064 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188067 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188069 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188072 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188074 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:46:28.198665 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188076 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188079 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188082 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188084 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188087 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188089 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188091 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188094 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188096 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.188099 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.188712 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.196983 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.196998 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.197017 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 20:46:28.199127 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.197022 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197091 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197097 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197100 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197103 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197106 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197109 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197111 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197115 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197117 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197120 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197122 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197125 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197127 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197130 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197132 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197136 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197140 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197143 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:46:28.199511 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197145 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197148 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197150 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197153 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197155 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197162 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197165 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197167 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197170 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197172 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197174 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197177 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197179 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197181 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197183 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197186 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197188 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197190 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197193 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:46:28.199971 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197196 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197199 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197203 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197206 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197209 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197212 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197214 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197217 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197220 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197223 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197226 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197228 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197230 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197233 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197236 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197238 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197240 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197243 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197246 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:46:28.200480 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197248 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197250 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197253 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197255 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197258 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197260 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197262 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197265 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197267 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197270 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197272 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197275 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197277 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197279 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197282 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197284 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197287 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197290 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197292 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197295 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:46:28.200946 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197297 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197299 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197302 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197305 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197308 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197310 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197312 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197315 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197317 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197320 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197322 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197324 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197327 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197329 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197331 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197334 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197336 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197338 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197341 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197343 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:46:28.201425 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197345 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197348 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197350 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.197355 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197494 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197500 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197503 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197506 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197510 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197512 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197515 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197518 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197521 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197525 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197528 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 20:46:28.201958 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197531 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197534 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197537 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197539 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197541 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197544 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197546 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197549 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197551 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197553 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197556 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197558 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197561 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197563 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197565 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197568 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197570 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197573 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197575 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 20:46:28.202340 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197578 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197580 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197583 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197585 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197589 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197593 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197595 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197598 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197601 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197603 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197606 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197608 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197611 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197613 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197615 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197618 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197621 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197623 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197625 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 20:46:28.202802 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197627 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197630 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197632 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197634 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197637 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197639 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197641 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197644 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197646 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197648 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197651 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197657 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197660 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197662 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197665 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197668 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197670 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197673 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197676 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197678 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 20:46:28.203361 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197681 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197683 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197685 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197688 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197690 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197692 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197695 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197697 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197699 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197702 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197704 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197707 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197709 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197712 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197715 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197717 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197720 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197722 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197725 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197727 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 20:46:28.203864 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197729 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197732 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197735 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197738 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197741 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197743 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197745 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197748 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197750 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:28.197753 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.197757 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.197867 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.201417 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.202792 2562 server.go:1019] "Starting client certificate rotation" Jul 01 20:46:28.204606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.202910 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 20:46:28.205079 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.202951 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 20:46:28.206809 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.206790 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 20:46:28.208054 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.208039 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 20:46:28.217912 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.217895 2562 log.go:25] "Validated CRI v1 runtime API" Jul 01 20:46:28.219920 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.219897 2562 log.go:25] "Validated CRI v1 image API" Jul 01 20:46:28.220771 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.220754 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 20:46:28.227052 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.227035 2562 fs.go:135] Filesystem UUIDs: map[09bc904b-e07f-4443-a32c-c2a7aec8a961:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 d353dd99-1c36-46a4-b5cd-dab95302a9c2:/dev/nvme0n1p3] Jul 01 20:46:28.227123 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.227052 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 20:46:28.231869 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.231768 2562 manager.go:216] Machine: {Timestamp:2026-07-01 20:46:28.23045045 +0000 UTC m=+0.353552792 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104407 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24a3e036bafe3d4a07f2b9a2261d2c SystemUUID:ec24a3e0-36ba-fe3d-4a07-f2b9a2261d2c BootID:ba8c6d7b-98bd-41a5-ad36-c24d0a63eb8d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:92:1b:ce:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:92:1b:ce:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:96:0a:ed:cd:b3:16 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 20:46:28.231869 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.231861 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 20:46:28.231965 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.231956 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 20:46:28.235363 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.235341 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 20:46:28.235505 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.235365 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 20:46:28.236505 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.236495 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 20:46:28.236537 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.236507 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 20:46:28.236537 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.236514 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 20:46:28.237054 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.237039 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 20:46:28.237174 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.237162 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 20:46:28.237972 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.237963 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 20:46:28.241960 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.241943 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 01 20:46:28.242088 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.242078 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 20:46:28.242145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.242107 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 01 20:46:28.242145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.242116 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 20:46:28.242145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.242129 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 20:46:28.242145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.242138 2562 kubelet.go:398] "Adding apiserver pod source" Jul 01 20:46:28.242145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.242145 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 20:46:28.242504 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.242485 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 20:46:28.242504 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.242505 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 20:46:28.247496 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.247477 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 20:46:28.248825 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.248812 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 20:46:28.248870 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.248842 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 20:46:28.249412 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249402 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 20:46:28.249449 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249417 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 20:46:28.249449 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249423 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 20:46:28.249449 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249428 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 20:46:28.249449 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249436 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 20:46:28.249449 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249441 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 20:46:28.249602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249501 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 20:46:28.249602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249507 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 20:46:28.249602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249514 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 20:46:28.249602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249519 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 20:46:28.249602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249527 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 20:46:28.249602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249534 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 20:46:28.249602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249555 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 20:46:28.249602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.249560 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 20:46:28.252603 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.252590 2562 server.go:1268] "Started kubelet" Jul 01 20:46:28.252742 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.252688 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 20:46:28.252802 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.252764 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 20:46:28.253399 ip-10-0-129-25 systemd[1]: Started Kubernetes Kubelet. Jul 01 20:46:28.253549 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.253512 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 20:46:28.253939 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.253830 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 20:46:28.254945 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.254921 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 20:46:28.255031 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.254960 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 20:46:28.255031 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.255018 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 20:46:28.256374 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.256358 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 01 20:46:28.258715 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.257812 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-25.ec2.internal.18be4561aa0f3e8d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-25.ec2.internal,UID:ip-10-0-129-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-25.ec2.internal,},FirstTimestamp:2026-07-01 20:46:28.252565133 +0000 UTC m=+0.375667456,LastTimestamp:2026-07-01 20:46:28.252565133 +0000 UTC m=+0.375667456,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-25.ec2.internal,}" Jul 01 20:46:28.259500 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.259480 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 20:46:28.262004 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.261987 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 20:46:28.262004 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.261996 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 20:46:28.262129 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.262058 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:28.262560 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.262542 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 20:46:28.263024 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.262736 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 20:46:28.263109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.263099 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 20:46:28.263446 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.263431 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 01 20:46:28.263557 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.263451 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 01 20:46:28.263766 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.263654 2562 factory.go:55] Registering systemd factory Jul 01 20:46:28.263849 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.263809 2562 factory.go:223] Registration of the systemd container factory successfully Jul 01 20:46:28.264066 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.264054 2562 factory.go:153] Registering CRI-O factory Jul 01 20:46:28.264120 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.264070 2562 factory.go:223] Registration of the crio container factory successfully Jul 01 20:46:28.264154 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.264120 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 20:46:28.264154 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.264147 2562 factory.go:103] Registering Raw factory Jul 01 20:46:28.264246 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.264162 2562 manager.go:1196] Started watching for new ooms in manager Jul 01 20:46:28.264314 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.264291 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 20:46:28.264365 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.264337 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 20:46:28.264586 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.264569 2562 manager.go:349] Starting recovery of all containers Jul 01 20:46:28.264941 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.264918 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lthh4" Jul 01 20:46:28.274218 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.274201 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lthh4" Jul 01 20:46:28.275502 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.275484 2562 manager.go:354] Recovery completed Jul 01 20:46:28.279411 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.279400 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:46:28.281110 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.281096 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:46:28.281193 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.281120 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:46:28.281193 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.281130 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:46:28.281650 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.281624 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 20:46:28.281650 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.281638 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 20:46:28.281772 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.281653 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:46:28.281772 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.281655 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 01 20:46:28.282294 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.282280 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:46:28.282344 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.282307 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:46:28.282344 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.282320 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:46:28.282784 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.282772 2562 policy_none.go:49] "None policy: Start" Jul 01 20:46:28.282826 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.282790 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 20:46:28.282826 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.282801 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 20:46:28.283721 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.283711 2562 policy_none.go:47] "Start" Jul 01 20:46:28.319007 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.318993 2562 manager.go:337] "Starting Device Plugin manager" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.319020 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.319029 2562 server.go:87] "Starting device plugin registration server" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.319322 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.319334 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.319426 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.319526 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.319534 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.319890 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.319931 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.331368 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.332614 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.332641 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.332657 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 20:46:28.333902 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.332684 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 20:46:28.335100 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.335085 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:46:28.420118 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.420102 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:46:28.420853 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.420840 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:46:28.420913 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.420866 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:46:28.420913 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.420875 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:46:28.420913 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.420896 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.432682 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.432630 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.432682 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.432649 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-25.ec2.internal\": node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:28.432770 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.432728 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal"] Jul 01 20:46:28.432802 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.432782 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:46:28.433416 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.433402 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:46:28.433492 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.433432 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:46:28.433492 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.433445 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:46:28.434612 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.434600 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:46:28.434699 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.434687 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.434740 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.434713 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:46:28.435234 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.435216 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:46:28.435321 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.435239 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:46:28.435321 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.435247 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:46:28.435321 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.435269 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:46:28.435321 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.435286 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:46:28.435321 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.435296 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:46:28.436265 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.436252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.436318 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.436277 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 20:46:28.437540 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.437520 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientMemory" Jul 01 20:46:28.437635 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.437553 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 20:46:28.437635 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.437568 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeHasSufficientPID" Jul 01 20:46:28.454034 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.454014 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-25.ec2.internal\" not found" node="ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.457758 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.457741 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-25.ec2.internal\" not found" node="ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.464984 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.464964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.465056 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.464991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.465056 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.465008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1ab4c0d6465e7f5a7a74878f3504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"8e1ab4c0d6465e7f5a7a74878f3504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.483577 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.483552 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:28.565611 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.565589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.565715 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.565614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.565715 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.565635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1ab4c0d6465e7f5a7a74878f3504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"8e1ab4c0d6465e7f5a7a74878f3504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.565715 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.565661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8e1ab4c0d6465e7f5a7a74878f3504c3-config\") pod \"kube-apiserver-proxy-ip-10-0-129-25.ec2.internal\" (UID: \"8e1ab4c0d6465e7f5a7a74878f3504c3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.565715 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.565694 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.565715 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.565693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8addf80ffef511284ff88389f3e758ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal\" (UID: \"8addf80ffef511284ff88389f3e758ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.583630 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.583604 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:28.683999 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.683923 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:28.757056 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.757033 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.761246 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:28.761232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 01 20:46:28.784405 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.784380 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:28.884947 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:28.884913 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:30.445407 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:30.445375 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:30.546044 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:30.546022 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:30.646492 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:30.646467 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:30.662656 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:30.662605 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 20:46:30.662748 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:30.662732 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 20:46:30.738093 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:30.738062 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 20:41:29 +0000 UTC" deadline="2028-03-22 09:42:27.444244408 +0000 UTC" Jul 01 20:46:30.738093 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:30.738091 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15108h55m56.70615714s" Jul 01 20:46:30.747383 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:30.747363 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:30.808245 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:30.808098 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8addf80ffef511284ff88389f3e758ea.slice/crio-e883867e79ab0e5eff88e39355589b6370a9bd7a6ff96a39885f1bdee6bdac20 WatchSource:0}: Error finding container e883867e79ab0e5eff88e39355589b6370a9bd7a6ff96a39885f1bdee6bdac20: Status 404 returned error can't find the container with id e883867e79ab0e5eff88e39355589b6370a9bd7a6ff96a39885f1bdee6bdac20 Jul 01 20:46:30.808461 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:30.808442 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e1ab4c0d6465e7f5a7a74878f3504c3.slice/crio-39d7c048e7a825fe8350ed5aa9812b6b0764805bd99fac2807e6cfbeaf358a1e WatchSource:0}: Error finding container 39d7c048e7a825fe8350ed5aa9812b6b0764805bd99fac2807e6cfbeaf358a1e: Status 404 returned error can't find the container with id 39d7c048e7a825fe8350ed5aa9812b6b0764805bd99fac2807e6cfbeaf358a1e Jul 01 20:46:30.814806 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:30.814771 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:46:30.848200 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:30.848177 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:30.948755 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:30.948707 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:30.999628 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:30.999608 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:46:31.049597 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.049576 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:31.138495 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.138469 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:46:31.150036 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.150013 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-25.ec2.internal\" not found" Jul 01 20:46:31.205060 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.204987 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:46:31.222394 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.222370 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" Jul 01 20:46:31.235366 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.235345 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 20:46:31.236502 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.236468 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" Jul 01 20:46:31.246172 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.246155 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 20:46:31.703555 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.703258 2562 apiserver.go:52] "Watching apiserver" Jul 01 20:46:31.711403 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.710125 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 20:46:31.711575 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.711555 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 20:46:31.711970 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.711943 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-tqwnj","kube-system/konnectivity-agent-bljqt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84","openshift-cluster-node-tuning-operator/tuned-wgltw","openshift-dns/node-resolver-x9gsc","openshift-image-registry/node-ca-bk27w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal","openshift-multus/multus-2rkvx","kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal","openshift-multus/multus-additional-cni-plugins-kdj9r","openshift-multus/network-metrics-daemon-dfms9","openshift-network-diagnostics/network-check-target-9xq79","openshift-network-operator/iptables-alerter-rgcd4","openshift-ovn-kubernetes/ovnkube-node-h7bpx"] Jul 01 20:46:31.713863 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.713840 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.715234 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.715211 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:31.716664 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.716647 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 20:46:31.716915 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.716902 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.717702 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.717683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 20:46:31.717998 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.717980 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 20:46:31.718424 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.718406 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 20:46:31.718692 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.718678 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 20:46:31.718901 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.718853 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 20:46:31.719075 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.719058 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6gzkl\"" Jul 01 20:46:31.719591 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.719572 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 20:46:31.719885 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.719871 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cndv8\"" Jul 01 20:46:31.719965 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.719907 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 20:46:31.720134 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.720118 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-74g5g\"" Jul 01 20:46:31.720218 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.720202 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.720326 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.720304 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 20:46:31.720581 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.720564 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 20:46:31.721119 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.721078 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.721992 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.721739 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:31.721992 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.721822 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:31.723174 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.723146 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 20:46:31.724114 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724096 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.724114 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724109 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 20:46:31.724373 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724356 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 20:46:31.724441 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724393 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 20:46:31.724521 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724439 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 20:46:31.724939 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724716 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 20:46:31.724939 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724723 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 20:46:31.724939 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724758 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 20:46:31.724939 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724726 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 20:46:31.724939 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.724773 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rx4qq\"" Jul 01 20:46:31.726074 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.726056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.728366 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.727944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.729925 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.729906 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dqdtj\"" Jul 01 20:46:31.731079 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.731060 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:31.731192 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.731124 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7fxsd\"" Jul 01 20:46:31.731192 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.731125 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:31.732759 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.732635 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.733634 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.733617 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:46:31.735233 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.735211 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cqnrf\"" Jul 01 20:46:31.735688 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.735669 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-47stp\"" Jul 01 20:46:31.735807 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.735784 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 20:46:31.736025 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736004 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 20:46:31.736102 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736033 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 20:46:31.736153 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 20:46:31.736308 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736289 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 20:46:31.736372 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-cni-bin\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.736423 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-log-socket\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.736423 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736410 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:46:31.736547 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736439 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-run\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.736547 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736471 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-socket-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.736547 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e097ef9-805e-4b23-b57b-8b74ac8ede72-tmp-dir\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.736687 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736547 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lqdtg\"" Jul 01 20:46:31.736687 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.736687 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.736687 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:31.736867 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c04c508-7598-453b-aaa3-541c09793ff9-cni-binary-copy\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.736975 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.737043 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.736990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.737043 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 20:46:31.737043 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-systemd-units\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.737185 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737044 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.737185 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737099 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 20:46:31.737185 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.737118 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:31.737185 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-etc-kubernetes\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.737185 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.737408 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-ovn\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.737408 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737235 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-node-log\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.737408 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737288 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqsgn\" (UniqueName: \"kubernetes.io/projected/585c90c3-db8e-4c3e-aec5-7064332e682e-kube-api-access-rqsgn\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.737408 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737344 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-system-cni-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.737408 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737369 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-cni-bin\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.737408 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqcqx\" (UniqueName: \"kubernetes.io/projected/85654290-0922-4150-a3d2-742fd113fe07-kube-api-access-mqcqx\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.737683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737425 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-ovnkube-script-lib\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.737683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-kubernetes\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.737683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-os-release\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.737683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-netns\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.737683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737583 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-systemd\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.737683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-var-lib-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.737683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-kubelet\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.737974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gbvg\" (UniqueName: \"kubernetes.io/projected/2c04c508-7598-453b-aaa3-541c09793ff9-kube-api-access-8gbvg\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.737974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81b95aae-fb93-4edf-8248-0b64dc342a2f-konnectivity-ca\") pod \"konnectivity-agent-bljqt\" (UID: \"81b95aae-fb93-4edf-8248-0b64dc342a2f\") " pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:31.737974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737786 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-system-cni-dir\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.737974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-k8s-cni-cncf-io\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.737974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-run-ovn-kubernetes\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.738200 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.737974 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.738200 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738010 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg9br\" (UniqueName: \"kubernetes.io/projected/1e097ef9-805e-4b23-b57b-8b74ac8ede72-kube-api-access-pg9br\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.738200 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysconfig\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.738200 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysctl-conf\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.738200 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738153 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-host\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.738407 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/85654290-0922-4150-a3d2-742fd113fe07-etc-tuned\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.738407 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.738407 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-registration-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.738407 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-device-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.738407 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738399 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e097ef9-805e-4b23-b57b-8b74ac8ede72-hosts-file\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.738630 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738476 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-kubelet\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.738630 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-systemd\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.738630 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-cni-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.739044 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.738593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-multus-certs\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.739128 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739061 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-modprobe-d\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.739128 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-sys\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.739263 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-cnibin\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.739263 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-os-release\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.739263 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9wbd\" (UniqueName: \"kubernetes.io/projected/d68195ee-0a76-4dd3-a690-f6f0f8833221-kube-api-access-l9wbd\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.739263 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-cni-netd\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.739471 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-ovnkube-config\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.739471 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739299 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-cnibin\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.739471 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81b95aae-fb93-4edf-8248-0b64dc342a2f-agent-certs\") pod \"konnectivity-agent-bljqt\" (UID: \"81b95aae-fb93-4edf-8248-0b64dc342a2f\") " pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:31.739471 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-lib-modules\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.739471 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.739797 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-socket-dir-parent\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.739797 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-sys-fs\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.739797 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739627 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qx9\" (UniqueName: \"kubernetes.io/projected/fd1b155c-d821-4452-a143-9f250688fdc7-kube-api-access-j7qx9\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.739797 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739655 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-slash\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.739797 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-etc-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.739797 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739730 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-env-overrides\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.739797 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-run-netns\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-conf-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739857 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysctl-d\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-var-lib-kubelet\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85654290-0922-4150-a3d2-742fd113fe07-tmp\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.739992 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/585c90c3-db8e-4c3e-aec5-7064332e682e-ovn-node-metrics-cert\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.740022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvrs5\" (UniqueName: \"kubernetes.io/projected/61593544-4ffb-4630-af39-740a84a89867-kube-api-access-gvrs5\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.740051 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-cni-multus\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.740089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-hostroot\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.740181 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.740112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c04c508-7598-453b-aaa3-541c09793ff9-multus-daemon-config\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.745725 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.745701 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 20:46:31.765750 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.765731 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-z7smn" Jul 01 20:46:31.777416 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.777390 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-z7smn" Jul 01 20:46:31.797583 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.797544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" event={"ID":"8e1ab4c0d6465e7f5a7a74878f3504c3","Type":"ContainerStarted","Data":"39d7c048e7a825fe8350ed5aa9812b6b0764805bd99fac2807e6cfbeaf358a1e"} Jul 01 20:46:31.798800 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.798775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"8addf80ffef511284ff88389f3e758ea","Type":"ContainerStarted","Data":"e883867e79ab0e5eff88e39355589b6370a9bd7a6ff96a39885f1bdee6bdac20"} Jul 01 20:46:31.824377 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.824356 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 20:46:31.840456 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-sys\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.840581 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-cnibin\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.840581 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840548 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-cnibin\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.840581 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-sys\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.840744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-os-release\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.840744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9wbd\" (UniqueName: \"kubernetes.io/projected/d68195ee-0a76-4dd3-a690-f6f0f8833221-kube-api-access-l9wbd\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.840744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-cni-netd\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.840744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-ovnkube-config\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.840744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-cnibin\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.840744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-os-release\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.840744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81b95aae-fb93-4edf-8248-0b64dc342a2f-agent-certs\") pod \"konnectivity-agent-bljqt\" (UID: \"81b95aae-fb93-4edf-8248-0b64dc342a2f\") " pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:31.840744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-lib-modules\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-cni-netd\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840790 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-socket-dir-parent\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840836 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe82e58f-51df-4cb6-8c7f-855599d57966-serviceca\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-sys-fs\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qx9\" (UniqueName: \"kubernetes.io/projected/fd1b155c-d821-4452-a143-9f250688fdc7-kube-api-access-j7qx9\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-slash\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-etc-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.840993 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-etc-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.841109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841040 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-sys-fs\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-socket-dir-parent\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-cnibin\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-slash\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841405 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-env-overrides\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6f48\" (UniqueName: \"kubernetes.io/projected/fe82e58f-51df-4cb6-8c7f-855599d57966-kube-api-access-w6f48\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841445 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-run-netns\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-conf-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6gx6\" (UniqueName: \"kubernetes.io/projected/89cbe17e-2ec6-49c0-b419-40f82987d3fa-kube-api-access-x6gx6\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysctl-d\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.841574 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-var-lib-kubelet\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841588 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85654290-0922-4150-a3d2-742fd113fe07-tmp\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841606 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/585c90c3-db8e-4c3e-aec5-7064332e682e-ovn-node-metrics-cert\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvrs5\" (UniqueName: \"kubernetes.io/projected/61593544-4ffb-4630-af39-740a84a89867-kube-api-access-gvrs5\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-cni-multus\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-hostroot\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c04c508-7598-453b-aaa3-541c09793ff9-multus-daemon-config\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-cni-bin\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-log-socket\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce48a9f8-571d-4157-86e3-486076a847b0-dbus\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-run\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-ovnkube-config\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-socket-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841820 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-run-netns\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841835 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e097ef9-805e-4b23-b57b-8b74ac8ede72-tmp-dir\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841873 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841929 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-socket-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841935 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-conf-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842030 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.841972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-cni-multus\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysctl-d\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842051 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-hostroot\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c04c508-7598-453b-aaa3-541c09793ff9-cni-binary-copy\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842130 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-systemd-units\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-etc-kubernetes\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-ovn\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-node-log\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqsgn\" (UniqueName: \"kubernetes.io/projected/585c90c3-db8e-4c3e-aec5-7064332e682e-kube-api-access-rqsgn\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842364 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-system-cni-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-cni-bin\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.842712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqcqx\" (UniqueName: \"kubernetes.io/projected/85654290-0922-4150-a3d2-742fd113fe07-kube-api-access-mqcqx\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-ovnkube-script-lib\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-kubernetes\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-os-release\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-netns\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c04c508-7598-453b-aaa3-541c09793ff9-multus-daemon-config\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-systemd\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-cni-bin\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-var-lib-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842623 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-log-socket\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-kubelet\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842678 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gbvg\" (UniqueName: \"kubernetes.io/projected/2c04c508-7598-453b-aaa3-541c09793ff9-kube-api-access-8gbvg\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842712 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-ovn\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81b95aae-fb93-4edf-8248-0b64dc342a2f-konnectivity-ca\") pod \"konnectivity-agent-bljqt\" (UID: \"81b95aae-fb93-4edf-8248-0b64dc342a2f\") " pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-system-cni-dir\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.843270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842681 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-kubelet\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-k8s-cni-cncf-io\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe82e58f-51df-4cb6-8c7f-855599d57966-host\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89cbe17e-2ec6-49c0-b419-40f82987d3fa-iptables-alerter-script\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842956 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89cbe17e-2ec6-49c0-b419-40f82987d3fa-host-slash\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-run-ovn-kubernetes\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842999 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-var-lib-kubelet\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg9br\" (UniqueName: \"kubernetes.io/projected/1e097ef9-805e-4b23-b57b-8b74ac8ede72-kube-api-access-pg9br\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysconfig\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysctl-conf\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-lib-modules\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843086 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-host\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/85654290-0922-4150-a3d2-742fd113fe07-etc-tuned\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843134 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-registration-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-device-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.844287 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e097ef9-805e-4b23-b57b-8b74ac8ede72-hosts-file\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-kubelet\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-systemd\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-cni-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.842959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e097ef9-805e-4b23-b57b-8b74ac8ede72-tmp-dir\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843505 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-multus-certs\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-modprobe-d\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843563 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce48a9f8-571d-4157-86e3-486076a847b0-kubelet-config\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843715 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-multus-cni-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-system-cni-dir\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.843792 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-run\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.844165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-env-overrides\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.844856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81b95aae-fb93-4edf-8248-0b64dc342a2f-konnectivity-ca\") pod \"konnectivity-agent-bljqt\" (UID: \"81b95aae-fb93-4edf-8248-0b64dc342a2f\") " pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.844909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-k8s-cni-cncf-io\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.844952 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-run-ovn-kubernetes\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.845083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845019 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-etc-selinux\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysconfig\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-sysctl-conf\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845369 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-host\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845701 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-registration-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845747 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-device-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845787 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-systemd\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-kubelet\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d68195ee-0a76-4dd3-a690-f6f0f8833221-tuning-conf-dir\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/85654290-0922-4150-a3d2-742fd113fe07-tmp\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-multus-certs\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845912 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-node-log\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845981 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-kubernetes\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.845973 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-run-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-modprobe-d\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81b95aae-fb93-4edf-8248-0b64dc342a2f-agent-certs\") pod \"konnectivity-agent-bljqt\" (UID: \"81b95aae-fb93-4edf-8248-0b64dc342a2f\") " pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-etc-kubernetes\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/85654290-0922-4150-a3d2-742fd113fe07-etc-systemd\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.847310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd1b155c-d821-4452-a143-9f250688fdc7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846322 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846335 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-run-netns\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-system-cni-dir\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.846464 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846508 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-os-release\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.846560 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs podName:61593544-4ffb-4630-af39-740a84a89867 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:32.346523496 +0000 UTC m=+3.009597561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs") pod "network-metrics-daemon-dfms9" (UID: "61593544-4ffb-4630-af39-740a84a89867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-var-lib-openvswitch\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/585c90c3-db8e-4c3e-aec5-7064332e682e-ovnkube-script-lib\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846695 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c04c508-7598-453b-aaa3-541c09793ff9-host-var-lib-cni-bin\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846724 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/585c90c3-db8e-4c3e-aec5-7064332e682e-systemd-units\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.846853 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1e097ef9-805e-4b23-b57b-8b74ac8ede72-hosts-file\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.847043 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.847141 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d68195ee-0a76-4dd3-a690-f6f0f8833221-cni-binary-copy\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.848918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.847182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c04c508-7598-453b-aaa3-541c09793ff9-cni-binary-copy\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.851656 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.851603 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qx9\" (UniqueName: \"kubernetes.io/projected/fd1b155c-d821-4452-a143-9f250688fdc7-kube-api-access-j7qx9\") pod \"aws-ebs-csi-driver-node-pnf84\" (UID: \"fd1b155c-d821-4452-a143-9f250688fdc7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:31.852501 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.852466 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9wbd\" (UniqueName: \"kubernetes.io/projected/d68195ee-0a76-4dd3-a690-f6f0f8833221-kube-api-access-l9wbd\") pod \"multus-additional-cni-plugins-kdj9r\" (UID: \"d68195ee-0a76-4dd3-a690-f6f0f8833221\") " pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:31.855173 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.855121 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gbvg\" (UniqueName: \"kubernetes.io/projected/2c04c508-7598-453b-aaa3-541c09793ff9-kube-api-access-8gbvg\") pod \"multus-2rkvx\" (UID: \"2c04c508-7598-453b-aaa3-541c09793ff9\") " pod="openshift-multus/multus-2rkvx" Jul 01 20:46:31.855933 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.855913 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/85654290-0922-4150-a3d2-742fd113fe07-etc-tuned\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.857660 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.857635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/585c90c3-db8e-4c3e-aec5-7064332e682e-ovn-node-metrics-cert\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.858328 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.858293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg9br\" (UniqueName: \"kubernetes.io/projected/1e097ef9-805e-4b23-b57b-8b74ac8ede72-kube-api-access-pg9br\") pod \"node-resolver-x9gsc\" (UID: \"1e097ef9-805e-4b23-b57b-8b74ac8ede72\") " pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:31.862126 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.862086 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvrs5\" (UniqueName: \"kubernetes.io/projected/61593544-4ffb-4630-af39-740a84a89867-kube-api-access-gvrs5\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:31.862279 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.862211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqsgn\" (UniqueName: \"kubernetes.io/projected/585c90c3-db8e-4c3e-aec5-7064332e682e-kube-api-access-rqsgn\") pod \"ovnkube-node-h7bpx\" (UID: \"585c90c3-db8e-4c3e-aec5-7064332e682e\") " pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:31.864528 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.864511 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqcqx\" (UniqueName: \"kubernetes.io/projected/85654290-0922-4150-a3d2-742fd113fe07-kube-api-access-mqcqx\") pod \"tuned-wgltw\" (UID: \"85654290-0922-4150-a3d2-742fd113fe07\") " pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:31.944015 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.943980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce48a9f8-571d-4157-86e3-486076a847b0-kubelet-config\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.944156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.944027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe82e58f-51df-4cb6-8c7f-855599d57966-serviceca\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.944156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.944056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6f48\" (UniqueName: \"kubernetes.io/projected/fe82e58f-51df-4cb6-8c7f-855599d57966-kube-api-access-w6f48\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.944156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.944079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6gx6\" (UniqueName: \"kubernetes.io/projected/89cbe17e-2ec6-49c0-b419-40f82987d3fa-kube-api-access-x6gx6\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.944156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.944122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce48a9f8-571d-4157-86e3-486076a847b0-dbus\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.944156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.944123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ce48a9f8-571d-4157-86e3-486076a847b0-kubelet-config\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.944384 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.944366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ce48a9f8-571d-4157-86e3-486076a847b0-dbus\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.944453 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.944412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:31.944643 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.944543 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:31.944755 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.944603 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret podName:ce48a9f8-571d-4157-86e3-486076a847b0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:32.444584288 +0000 UTC m=+3.107658363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret") pod "global-pull-secret-syncer-tqwnj" (UID: "ce48a9f8-571d-4157-86e3-486076a847b0") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:31.946755 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.946726 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:31.946861 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.946787 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe82e58f-51df-4cb6-8c7f-855599d57966-host\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.946861 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.946802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fe82e58f-51df-4cb6-8c7f-855599d57966-serviceca\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.946861 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.946823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89cbe17e-2ec6-49c0-b419-40f82987d3fa-iptables-alerter-script\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.947006 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.946892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fe82e58f-51df-4cb6-8c7f-855599d57966-host\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:31.947056 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.947024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89cbe17e-2ec6-49c0-b419-40f82987d3fa-host-slash\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.947154 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.947115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89cbe17e-2ec6-49c0-b419-40f82987d3fa-host-slash\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.947586 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.947567 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/89cbe17e-2ec6-49c0-b419-40f82987d3fa-iptables-alerter-script\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.954702 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.954650 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:46:31.954702 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.954682 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:46:31.954702 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.954696 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cmm2r for pod openshift-network-diagnostics/network-check-target-9xq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:31.954855 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:31.954762 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r podName:342772b3-9eb3-4f40-96ce-ef458a91f7c0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:32.454744186 +0000 UTC m=+3.117818268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-cmm2r" (UniqueName: "kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r") pod "network-check-target-9xq79" (UID: "342772b3-9eb3-4f40-96ce-ef458a91f7c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:31.956145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.956127 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6gx6\" (UniqueName: \"kubernetes.io/projected/89cbe17e-2ec6-49c0-b419-40f82987d3fa-kube-api-access-x6gx6\") pod \"iptables-alerter-rgcd4\" (UID: \"89cbe17e-2ec6-49c0-b419-40f82987d3fa\") " pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:31.956198 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:31.956157 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6f48\" (UniqueName: \"kubernetes.io/projected/fe82e58f-51df-4cb6-8c7f-855599d57966-kube-api-access-w6f48\") pod \"node-ca-bk27w\" (UID: \"fe82e58f-51df-4cb6-8c7f-855599d57966\") " pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:32.028808 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.028781 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" Jul 01 20:46:32.041656 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.041630 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:32.050358 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.050338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" Jul 01 20:46:32.057168 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.057148 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:32.065190 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.065173 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x9gsc" Jul 01 20:46:32.074848 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.074830 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wgltw" Jul 01 20:46:32.081388 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.081369 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2rkvx" Jul 01 20:46:32.090935 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.090918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bk27w" Jul 01 20:46:32.097500 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.097472 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rgcd4" Jul 01 20:46:32.351043 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.350963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:32.351178 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.351099 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:32.351178 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.351176 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs podName:61593544-4ffb-4630-af39-740a84a89867 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:33.35115141 +0000 UTC m=+4.014225474 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs") pod "network-metrics-daemon-dfms9" (UID: "61593544-4ffb-4630-af39-740a84a89867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:32.452112 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.452072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:32.452284 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.452218 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:32.452350 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.452291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret podName:ce48a9f8-571d-4157-86e3-486076a847b0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:33.452277349 +0000 UTC m=+4.115351415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret") pod "global-pull-secret-syncer-tqwnj" (UID: "ce48a9f8-571d-4157-86e3-486076a847b0") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:32.552620 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.552587 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:32.552786 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.552735 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:46:32.552786 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.552756 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:46:32.552786 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.552767 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cmm2r for pod openshift-network-diagnostics/network-check-target-9xq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:32.552925 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.552834 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r podName:342772b3-9eb3-4f40-96ce-ef458a91f7c0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:33.552816303 +0000 UTC m=+4.215890386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmm2r" (UniqueName: "kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r") pod "network-check-target-9xq79" (UID: "342772b3-9eb3-4f40-96ce-ef458a91f7c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:32.643091 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:32.643066 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e097ef9_805e_4b23_b57b_8b74ac8ede72.slice/crio-689fa8e2e01418ef4444fa3c83cfb0db766c7da4763490630bac6bbd58cd442f WatchSource:0}: Error finding container 689fa8e2e01418ef4444fa3c83cfb0db766c7da4763490630bac6bbd58cd442f: Status 404 returned error can't find the container with id 689fa8e2e01418ef4444fa3c83cfb0db766c7da4763490630bac6bbd58cd442f Jul 01 20:46:32.645060 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:32.645034 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe82e58f_51df_4cb6_8c7f_855599d57966.slice/crio-b9cb0cda789a37d0d09db185f4419925eda2354fbbb9a0706a17f470fc09b94e WatchSource:0}: Error finding container b9cb0cda789a37d0d09db185f4419925eda2354fbbb9a0706a17f470fc09b94e: Status 404 returned error can't find the container with id b9cb0cda789a37d0d09db185f4419925eda2354fbbb9a0706a17f470fc09b94e Jul 01 20:46:32.645669 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:32.645645 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1b155c_d821_4452_a143_9f250688fdc7.slice/crio-fe6d11b2d8345834300550274355f64043cc90c27948f065063df9b94aa30858 WatchSource:0}: Error finding container fe6d11b2d8345834300550274355f64043cc90c27948f065063df9b94aa30858: Status 404 returned error can't find the container with id fe6d11b2d8345834300550274355f64043cc90c27948f065063df9b94aa30858 Jul 01 20:46:32.646440 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:32.646426 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68195ee_0a76_4dd3_a690_f6f0f8833221.slice/crio-83fc9789742839990cf35c55723d86a8aedd580894e8fa58c9ea8e537d5dae12 WatchSource:0}: Error finding container 83fc9789742839990cf35c55723d86a8aedd580894e8fa58c9ea8e537d5dae12: Status 404 returned error can't find the container with id 83fc9789742839990cf35c55723d86a8aedd580894e8fa58c9ea8e537d5dae12 Jul 01 20:46:32.676042 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:32.676008 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85654290_0922_4150_a3d2_742fd113fe07.slice/crio-dd3d4aa6eb76a35171fc506526f8909fd58feb3c47c6fb75ecc53edee6b1acac WatchSource:0}: Error finding container dd3d4aa6eb76a35171fc506526f8909fd58feb3c47c6fb75ecc53edee6b1acac: Status 404 returned error can't find the container with id dd3d4aa6eb76a35171fc506526f8909fd58feb3c47c6fb75ecc53edee6b1acac Jul 01 20:46:32.676845 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:32.676823 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c04c508_7598_453b_aaa3_541c09793ff9.slice/crio-36e4ef17e81424c3877a69d3b64a9f714649871b60800ef6e84baceb2658d64b WatchSource:0}: Error finding container 36e4ef17e81424c3877a69d3b64a9f714649871b60800ef6e84baceb2658d64b: Status 404 returned error can't find the container with id 36e4ef17e81424c3877a69d3b64a9f714649871b60800ef6e84baceb2658d64b Jul 01 20:46:32.677993 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:46:32.677851 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89cbe17e_2ec6_49c0_b419_40f82987d3fa.slice/crio-a98651b945eaf22cf600a965c946ca88d119bcd6951c89a5db52f23acd0aa38b WatchSource:0}: Error finding container a98651b945eaf22cf600a965c946ca88d119bcd6951c89a5db52f23acd0aa38b: Status 404 returned error can't find the container with id a98651b945eaf22cf600a965c946ca88d119bcd6951c89a5db52f23acd0aa38b Jul 01 20:46:32.780880 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.780853 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:41:31 +0000 UTC" deadline="2028-01-12 03:50:25.858289916 +0000 UTC" Jul 01 20:46:32.780880 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.780879 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13423h3m53.077413839s" Jul 01 20:46:32.793422 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.793365 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:32.793530 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:32.793498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:32.801781 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.801757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bljqt" event={"ID":"81b95aae-fb93-4edf-8248-0b64dc342a2f","Type":"ContainerStarted","Data":"ee3c599e2a1a8aa5bd97c58ce471c8523fc2581b711f4106284abe2c8416c6eb"} Jul 01 20:46:32.802895 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.802875 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"0f0e177b818db003184d609b6bf711ac4570a6bea21836cd2c0b60ba7b0d3f95"} Jul 01 20:46:32.804068 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.804040 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerStarted","Data":"83fc9789742839990cf35c55723d86a8aedd580894e8fa58c9ea8e537d5dae12"} Jul 01 20:46:32.805227 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.805206 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rgcd4" event={"ID":"89cbe17e-2ec6-49c0-b419-40f82987d3fa","Type":"ContainerStarted","Data":"a98651b945eaf22cf600a965c946ca88d119bcd6951c89a5db52f23acd0aa38b"} Jul 01 20:46:32.806434 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.806411 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2rkvx" event={"ID":"2c04c508-7598-453b-aaa3-541c09793ff9","Type":"ContainerStarted","Data":"36e4ef17e81424c3877a69d3b64a9f714649871b60800ef6e84baceb2658d64b"} Jul 01 20:46:32.810346 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.810307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgltw" event={"ID":"85654290-0922-4150-a3d2-742fd113fe07","Type":"ContainerStarted","Data":"dd3d4aa6eb76a35171fc506526f8909fd58feb3c47c6fb75ecc53edee6b1acac"} Jul 01 20:46:32.811371 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.811351 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" event={"ID":"fd1b155c-d821-4452-a143-9f250688fdc7","Type":"ContainerStarted","Data":"fe6d11b2d8345834300550274355f64043cc90c27948f065063df9b94aa30858"} Jul 01 20:46:32.812320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.812298 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bk27w" event={"ID":"fe82e58f-51df-4cb6-8c7f-855599d57966","Type":"ContainerStarted","Data":"b9cb0cda789a37d0d09db185f4419925eda2354fbbb9a0706a17f470fc09b94e"} Jul 01 20:46:32.815332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.815292 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x9gsc" event={"ID":"1e097ef9-805e-4b23-b57b-8b74ac8ede72","Type":"ContainerStarted","Data":"689fa8e2e01418ef4444fa3c83cfb0db766c7da4763490630bac6bbd58cd442f"} Jul 01 20:46:32.817618 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.817597 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" event={"ID":"8e1ab4c0d6465e7f5a7a74878f3504c3","Type":"ContainerStarted","Data":"45d555c737da4dea13d629ac4a863cbd49b4fa52674f6c378d58cfd7c0cee110"} Jul 01 20:46:32.834169 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:32.834132 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-25.ec2.internal" podStartSLOduration=1.834121778 podStartE2EDuration="1.834121778s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:32.834003973 +0000 UTC m=+3.497078056" watchObservedRunningTime="2026-07-01 20:46:32.834121778 +0000 UTC m=+3.497195860" Jul 01 20:46:33.362388 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.362100 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:33.362651 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.362448 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:33.362651 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.362615 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs podName:61593544-4ffb-4630-af39-740a84a89867 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:35.362594675 +0000 UTC m=+6.025668743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs") pod "network-metrics-daemon-dfms9" (UID: "61593544-4ffb-4630-af39-740a84a89867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:33.462929 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.462890 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:33.463100 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.463066 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:33.463169 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.463124 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret podName:ce48a9f8-571d-4157-86e3-486076a847b0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:35.463107294 +0000 UTC m=+6.126181358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret") pod "global-pull-secret-syncer-tqwnj" (UID: "ce48a9f8-571d-4157-86e3-486076a847b0") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:33.567504 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.566893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:33.567504 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.567061 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:46:33.567504 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.567082 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:46:33.567504 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.567095 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cmm2r for pod openshift-network-diagnostics/network-check-target-9xq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:33.567504 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.567152 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r podName:342772b3-9eb3-4f40-96ce-ef458a91f7c0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:35.567134093 +0000 UTC m=+6.230208158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmm2r" (UniqueName: "kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r") pod "network-check-target-9xq79" (UID: "342772b3-9eb3-4f40-96ce-ef458a91f7c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:33.781807 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.781659 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 20:41:31 +0000 UTC" deadline="2028-01-23 15:33:50.810761247 +0000 UTC" Jul 01 20:46:33.781807 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.781720 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13698h47m17.02904484s" Jul 01 20:46:33.796014 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.795360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:33.796014 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.795509 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:33.796014 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.795869 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:33.796014 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:33.795949 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:33.836305 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.836250 2562 generic.go:356] "Generic (PLEG): container finished" podID="8addf80ffef511284ff88389f3e758ea" containerID="5539cc1b66cf860c37382d19e8c1080a9504cdb532170c50b9e016dee68686a2" exitCode=0 Jul 01 20:46:33.837011 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:33.836983 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"8addf80ffef511284ff88389f3e758ea","Type":"ContainerDied","Data":"5539cc1b66cf860c37382d19e8c1080a9504cdb532170c50b9e016dee68686a2"} Jul 01 20:46:34.793340 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:34.793309 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:34.793839 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:34.793435 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:34.852134 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:34.852096 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" event={"ID":"8addf80ffef511284ff88389f3e758ea","Type":"ContainerStarted","Data":"311c0a61595e288d7dcc75465d7a6f8df385b5e907cb9552d53cd155be4ff467"} Jul 01 20:46:35.382925 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:35.382891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:35.383092 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.383066 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:35.383150 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.383127 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs podName:61593544-4ffb-4630-af39-740a84a89867 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:39.383109089 +0000 UTC m=+10.046183168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs") pod "network-metrics-daemon-dfms9" (UID: "61593544-4ffb-4630-af39-740a84a89867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:35.484247 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:35.484210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:35.484430 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.484373 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:35.484518 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.484443 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret podName:ce48a9f8-571d-4157-86e3-486076a847b0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:39.484423793 +0000 UTC m=+10.147497871 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret") pod "global-pull-secret-syncer-tqwnj" (UID: "ce48a9f8-571d-4157-86e3-486076a847b0") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:35.585042 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:35.585008 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:35.585199 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.585177 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:46:35.585199 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.585197 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:46:35.585305 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.585209 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cmm2r for pod openshift-network-diagnostics/network-check-target-9xq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:35.585305 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.585263 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r podName:342772b3-9eb3-4f40-96ce-ef458a91f7c0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:39.585245622 +0000 UTC m=+10.248319697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmm2r" (UniqueName: "kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r") pod "network-check-target-9xq79" (UID: "342772b3-9eb3-4f40-96ce-ef458a91f7c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:35.794572 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:35.793388 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:35.794572 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:35.793396 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:35.794572 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.794301 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:35.794572 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:35.794415 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:36.793376 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:36.793340 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:36.793579 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:36.793472 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:37.793949 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:37.793916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:37.794344 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:37.793921 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:37.794344 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:37.794049 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:37.794344 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:37.794153 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:38.793472 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:38.793437 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:38.793654 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:38.793581 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:39.416846 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:39.416813 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:39.417298 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.417002 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:39.417298 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.417076 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs podName:61593544-4ffb-4630-af39-740a84a89867 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:47.417056147 +0000 UTC m=+18.080130211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs") pod "network-metrics-daemon-dfms9" (UID: "61593544-4ffb-4630-af39-740a84a89867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:39.517781 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:39.517223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:39.517781 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.517370 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:39.517781 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.517428 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret podName:ce48a9f8-571d-4157-86e3-486076a847b0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:47.5174101 +0000 UTC m=+18.180484163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret") pod "global-pull-secret-syncer-tqwnj" (UID: "ce48a9f8-571d-4157-86e3-486076a847b0") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:39.618092 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:39.617990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:39.618255 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.618131 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:46:39.618255 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.618158 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:46:39.618255 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.618171 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cmm2r for pod openshift-network-diagnostics/network-check-target-9xq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:39.618255 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.618214 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r podName:342772b3-9eb3-4f40-96ce-ef458a91f7c0 nodeName:}" failed. No retries permitted until 2026-07-01 20:46:47.618201725 +0000 UTC m=+18.281275788 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmm2r" (UniqueName: "kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r") pod "network-check-target-9xq79" (UID: "342772b3-9eb3-4f40-96ce-ef458a91f7c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:39.797251 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:39.796846 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:39.797251 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.796929 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:39.797447 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:39.797434 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:39.797664 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:39.797640 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:40.793973 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:40.793525 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:40.793973 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:40.793652 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:41.793989 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:41.793956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:41.794365 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:41.794063 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:41.795541 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:41.793916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:41.795675 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:41.795656 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:42.793585 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:42.793547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:42.793744 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:42.793663 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:43.793665 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:43.793634 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:43.794103 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:43.793771 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:43.794103 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:43.793829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:43.794103 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:43.793934 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:44.793636 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:44.793603 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:44.793795 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:44.793723 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:45.793731 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:45.793692 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:45.793731 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:45.793715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:45.794237 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:45.793818 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:45.794237 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:45.793902 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:46.793354 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:46.793326 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:46.793516 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:46.793421 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:47.478558 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:47.478523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:47.478939 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.478683 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:47.478939 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.478761 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs podName:61593544-4ffb-4630-af39-740a84a89867 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:03.478740146 +0000 UTC m=+34.141814230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs") pod "network-metrics-daemon-dfms9" (UID: "61593544-4ffb-4630-af39-740a84a89867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:46:47.579606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:47.579561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:47.579761 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.579719 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:47.579833 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.579782 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret podName:ce48a9f8-571d-4157-86e3-486076a847b0 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:03.579761233 +0000 UTC m=+34.242835294 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret") pod "global-pull-secret-syncer-tqwnj" (UID: "ce48a9f8-571d-4157-86e3-486076a847b0") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:46:47.680518 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:47.680467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:47.680655 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.680641 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:46:47.680722 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.680660 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:46:47.680722 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.680669 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cmm2r for pod openshift-network-diagnostics/network-check-target-9xq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:47.680801 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.680723 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r podName:342772b3-9eb3-4f40-96ce-ef458a91f7c0 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:03.680706844 +0000 UTC m=+34.343780905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmm2r" (UniqueName: "kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r") pod "network-check-target-9xq79" (UID: "342772b3-9eb3-4f40-96ce-ef458a91f7c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:46:47.793095 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:47.792895 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:47.793095 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.793040 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:47.793095 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:47.793066 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:47.793336 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:47.793181 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:48.793250 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:48.793219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:48.793658 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:48.793329 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:49.796718 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:49.796691 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:49.797117 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:49.796777 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:49.797117 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:49.796814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:49.797117 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:49.796938 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:50.793009 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:50.792981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:50.793174 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:50.793092 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:51.796032 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.795891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:51.796359 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.795952 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:51.796359 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:51.796129 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:51.796359 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:51.796170 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:51.884132 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.884102 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2rkvx" event={"ID":"2c04c508-7598-453b-aaa3-541c09793ff9","Type":"ContainerStarted","Data":"606ff04f7b418b862d2fd567652cc32c2963a97dc4f70c04b2820bbfdc37c569"} Jul 01 20:46:51.885415 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.885384 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wgltw" event={"ID":"85654290-0922-4150-a3d2-742fd113fe07","Type":"ContainerStarted","Data":"25bae2476fb49d3b91ff3463b5c89da2a1cdfc06d15639b7e73ac8eb39d73625"} Jul 01 20:46:51.886761 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.886736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" event={"ID":"fd1b155c-d821-4452-a143-9f250688fdc7","Type":"ContainerStarted","Data":"d223c292189e1e52953cd21c302b96cb9ed2e7ccc85ebd781b9376725941a16e"} Jul 01 20:46:51.888182 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.888165 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bk27w" event={"ID":"fe82e58f-51df-4cb6-8c7f-855599d57966","Type":"ContainerStarted","Data":"c5c62d18f7765b5209156fab0bd2f46e13579131dfc0dc198a5366485a7f7125"} Jul 01 20:46:51.890948 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.890919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x9gsc" event={"ID":"1e097ef9-805e-4b23-b57b-8b74ac8ede72","Type":"ContainerStarted","Data":"1289337ee4014c6a268209f18c0fa7d72eadfba8256acaa987f2c4451cd8ec75"} Jul 01 20:46:51.892517 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.892464 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bljqt" event={"ID":"81b95aae-fb93-4edf-8248-0b64dc342a2f","Type":"ContainerStarted","Data":"ae3ebe82a57f2dd14009c9231bf5a32789df93485d498446cf803102f143dea2"} Jul 01 20:46:51.895106 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.895068 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"1bd9903480d0cd8bd83c96c2d98135930b2e71d0e2cf426eba5cf32e64494658"} Jul 01 20:46:51.895230 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.895163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"c2688e28e43475aa15e714a22c8efc2888fb9fb33d9d855c3bed1a2ce692c37c"} Jul 01 20:46:51.895230 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.895217 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"071f64b8c2fece5073d3e055783f744926595e388e8079713c44e6cbfbd3e9f3"} Jul 01 20:46:51.896680 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.896656 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerStarted","Data":"dbbdfdae7387d0c688f0a52823ceed9650ae87e6fc513893e3b05b5b34f5a018"} Jul 01 20:46:51.906788 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.906748 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-25.ec2.internal" podStartSLOduration=20.906735742 podStartE2EDuration="20.906735742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:34.873224644 +0000 UTC m=+5.536298730" watchObservedRunningTime="2026-07-01 20:46:51.906735742 +0000 UTC m=+22.569809825" Jul 01 20:46:51.906894 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.906815 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2rkvx" podStartSLOduration=3.074911872 podStartE2EDuration="21.906810851s" totalImagesPullingTime="18.831898979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:51.906613563 +0000 UTC m=+22.569687664" watchObservedRunningTime="2026-07-01 20:46:51.906810851 +0000 UTC m=+22.569884935" Jul 01 20:46:51.924241 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.924189 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bljqt" podStartSLOduration=4.158349004 podStartE2EDuration="22.92417125s" totalImagesPullingTime="18.765822246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:51.924131502 +0000 UTC m=+22.587205585" watchObservedRunningTime="2026-07-01 20:46:51.92417125 +0000 UTC m=+22.587245342" Jul 01 20:46:51.943842 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.943805 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x9gsc" podStartSLOduration=4.083051815 podStartE2EDuration="22.943791927s" totalImagesPullingTime="18.860740112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:51.943740082 +0000 UTC m=+22.606814164" watchObservedRunningTime="2026-07-01 20:46:51.943791927 +0000 UTC m=+22.606866010" Jul 01 20:46:51.960858 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:51.960815 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wgltw" podStartSLOduration=3.166537561 podStartE2EDuration="21.960790813s" totalImagesPullingTime="18.794253252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:51.960649969 +0000 UTC m=+22.623724051" watchObservedRunningTime="2026-07-01 20:46:51.960790813 +0000 UTC m=+22.623864899" Jul 01 20:46:52.018353 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.018313 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bk27w" podStartSLOduration=3.215323965 podStartE2EDuration="22.018298969s" totalImagesPullingTime="18.802975004s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:52.018070952 +0000 UTC m=+22.681145050" watchObservedRunningTime="2026-07-01 20:46:52.018298969 +0000 UTC m=+22.681373052" Jul 01 20:46:52.063477 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.063451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:46:52.155592 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.155465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:46:52.793255 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.793201 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:52.793355 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:52.793289 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:52.899635 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.899594 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rgcd4" event={"ID":"89cbe17e-2ec6-49c0-b419-40f82987d3fa","Type":"ContainerStarted","Data":"a9ddd57d263b5f599a9eb520d02458217dd43067af676c534b72f26230021ad3"} Jul 01 20:46:52.902202 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.902182 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 20:46:52.902540 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.902520 2562 generic.go:356] "Generic (PLEG): container finished" podID="585c90c3-db8e-4c3e-aec5-7064332e682e" containerID="c2688e28e43475aa15e714a22c8efc2888fb9fb33d9d855c3bed1a2ce692c37c" exitCode=1 Jul 01 20:46:52.902604 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.902583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerDied","Data":"c2688e28e43475aa15e714a22c8efc2888fb9fb33d9d855c3bed1a2ce692c37c"} Jul 01 20:46:52.902658 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.902643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"2e3b624ede8951710f22e1475bebb9a611e9f2ef2a6abeeee625d1005ace606b"} Jul 01 20:46:52.902704 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.902680 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"0b2f6b7738f22100d0d09b1d0fba4bbac83a15d89bc539137ebe27d3a4ba9697"} Jul 01 20:46:52.902751 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.902715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"3ea38dc1829a1b4515074a1be8d1c646df8974fe3ce7360003b5722be1247c8d"} Jul 01 20:46:52.903949 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.903926 2562 generic.go:356] "Generic (PLEG): container finished" podID="d68195ee-0a76-4dd3-a690-f6f0f8833221" containerID="dbbdfdae7387d0c688f0a52823ceed9650ae87e6fc513893e3b05b5b34f5a018" exitCode=0 Jul 01 20:46:52.904037 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.904022 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerDied","Data":"dbbdfdae7387d0c688f0a52823ceed9650ae87e6fc513893e3b05b5b34f5a018"} Jul 01 20:46:52.916610 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:52.916579 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rgcd4" podStartSLOduration=4.14994757 podStartE2EDuration="22.916567509s" totalImagesPullingTime="18.766619939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:52.916391354 +0000 UTC m=+23.579465437" watchObservedRunningTime="2026-07-01 20:46:52.916567509 +0000 UTC m=+23.579641592" Jul 01 20:46:53.040551 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.040530 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:46:53.141640 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.141611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:46:53.190811 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.190789 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:53.199060 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.199041 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 20:46:53.793820 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.793707 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T20:46:53.199054758Z","UUID":"ba3b1ea8-765d-4b28-9def-9ffbd8c78937","Handler":null,"Name":"","Endpoint":""} Jul 01 20:46:53.795718 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.795694 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 20:46:53.795853 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.795737 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 20:46:53.798528 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.798427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:53.798528 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.798441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:53.798698 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:53.798543 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:53.798916 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:53.798878 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:53.909426 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:53.909383 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" event={"ID":"fd1b155c-d821-4452-a143-9f250688fdc7","Type":"ContainerStarted","Data":"49ab32696b9a87900c40060217bf0bf30fe5efe7fba8616bb420ac318df172d5"} Jul 01 20:46:54.144139 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:54.144038 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:46:54.242304 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:54.242278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:46:54.793158 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:54.793121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:54.793311 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:54.793218 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:54.915561 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:54.915535 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 20:46:54.915995 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:54.915969 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"aa80ead3cee4aa3e8781935a9b8b5c71831112a622d405abedf5db04a0d15bfd"} Jul 01 20:46:54.918314 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:54.918253 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" event={"ID":"fd1b155c-d821-4452-a143-9f250688fdc7","Type":"ContainerStarted","Data":"b02dd711327415752681bed455e6a86f848a52473f5c7953f5f389e9b0ca3a3d"} Jul 01 20:46:54.957786 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:54.957741 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pnf84" podStartSLOduration=5.016861204 podStartE2EDuration="25.957728143s" totalImagesPullingTime="20.940866939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:54.957722023 +0000 UTC m=+25.620796123" watchObservedRunningTime="2026-07-01 20:46:54.957728143 +0000 UTC m=+25.620802223" Jul 01 20:46:55.793835 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:55.793795 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:55.794017 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:55.793814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:55.794017 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:55.793925 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:55.794105 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:55.794043 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:56.729961 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:56.729929 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:56.730952 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:56.730930 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:56.792866 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:56.792836 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:56.793022 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:56.792938 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:56.923720 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:56.923509 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bljqt" Jul 01 20:46:57.023038 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.022951 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:46:57.793378 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.793350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:57.794028 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.793386 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:57.794028 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:57.793476 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:57.794028 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:57.793599 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:57.928359 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.928338 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 20:46:57.931957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.929145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"dd2f3a824c9f22c078f1f4f92a18eaa812882d2f466d5dca80ca528102d71460"} Jul 01 20:46:57.931957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.929868 2562 scope.go:117] "RemoveContainer" containerID="c2688e28e43475aa15e714a22c8efc2888fb9fb33d9d855c3bed1a2ce692c37c" Jul 01 20:46:57.931957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.930776 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:57.931957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.930875 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:57.931957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.930939 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:57.934649 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.934628 2562 generic.go:356] "Generic (PLEG): container finished" podID="d68195ee-0a76-4dd3-a690-f6f0f8833221" containerID="db92b1a0687983bbcd7f4ef41329dff21c211e0a16ad88a57e27b3a214d377a4" exitCode=0 Jul 01 20:46:57.934754 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.934715 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerDied","Data":"db92b1a0687983bbcd7f4ef41329dff21c211e0a16ad88a57e27b3a214d377a4"} Jul 01 20:46:57.949457 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.949436 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:57.949658 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:57.949589 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:46:58.793329 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:58.793309 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:58.793443 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:58.793398 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:58.940071 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:58.940003 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 20:46:58.940331 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:58.940310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" event={"ID":"585c90c3-db8e-4c3e-aec5-7064332e682e","Type":"ContainerStarted","Data":"d866bf1d2edf4701233ab0c0d18fd263ef28f3ecd2e9b90aaa0f774ff1becba7"} Jul 01 20:46:58.942434 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:58.942406 2562 generic.go:356] "Generic (PLEG): container finished" podID="d68195ee-0a76-4dd3-a690-f6f0f8833221" containerID="4ee6c818d0f1133028930d3cc9c5e1a4948742ace31bb9c647d654f27d45481e" exitCode=0 Jul 01 20:46:58.942570 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:58.942441 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerDied","Data":"4ee6c818d0f1133028930d3cc9c5e1a4948742ace31bb9c647d654f27d45481e"} Jul 01 20:46:58.971346 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:58.971312 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" podStartSLOduration=11.084693583 podStartE2EDuration="29.971300192s" totalImagesPullingTime="18.886606609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:46:58.970102925 +0000 UTC m=+29.633177009" watchObservedRunningTime="2026-07-01 20:46:58.971300192 +0000 UTC m=+29.634374275" Jul 01 20:46:59.624867 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:59.624581 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tqwnj"] Jul 01 20:46:59.624970 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:59.624873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:46:59.625054 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:59.624963 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:46:59.625345 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:59.625322 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xq79"] Jul 01 20:46:59.625448 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:59.625429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:46:59.625555 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:59.625534 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:46:59.627473 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:59.627449 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dfms9"] Jul 01 20:46:59.627587 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:59.627568 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:46:59.627704 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:46:59.627647 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:46:59.947276 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:59.947242 2562 generic.go:356] "Generic (PLEG): container finished" podID="d68195ee-0a76-4dd3-a690-f6f0f8833221" containerID="fbfe68cc1d881802c85c9b91f1307e820c189fb55c6ec40579f0380901fba3f1" exitCode=0 Jul 01 20:46:59.947662 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:46:59.947334 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerDied","Data":"fbfe68cc1d881802c85c9b91f1307e820c189fb55c6ec40579f0380901fba3f1"} Jul 01 20:47:01.267019 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:01.266933 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:01.383894 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:01.383866 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:01.793159 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:01.793122 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:47:01.793337 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:01.793144 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:47:01.793337 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:01.793250 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:47:01.793337 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:01.793256 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:47:01.793337 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:01.793326 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:47:01.793521 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:01.793390 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:47:02.345959 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:02.345925 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:02.487115 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:02.487067 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:03.135363 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:03.135334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:03.512777 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:03.512740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:47:03.513204 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.512876 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:47:03.513204 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.512943 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs podName:61593544-4ffb-4630-af39-740a84a89867 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:35.512927056 +0000 UTC m=+66.176001117 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs") pod "network-metrics-daemon-dfms9" (UID: "61593544-4ffb-4630-af39-740a84a89867") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 20:47:03.613254 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:03.613218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:47:03.613430 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.613379 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 20:47:03.613479 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.613440 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret podName:ce48a9f8-571d-4157-86e3-486076a847b0 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:35.613426364 +0000 UTC m=+66.276500425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret") pod "global-pull-secret-syncer-tqwnj" (UID: "ce48a9f8-571d-4157-86e3-486076a847b0") : object "kube-system"/"original-pull-secret" not registered Jul 01 20:47:03.714503 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:03.714459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:47:03.714690 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.714619 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 20:47:03.714690 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.714645 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 20:47:03.714690 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.714656 2562 projected.go:196] Error preparing data for projected volume kube-api-access-cmm2r for pod openshift-network-diagnostics/network-check-target-9xq79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:47:03.714824 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.714712 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r podName:342772b3-9eb3-4f40-96ce-ef458a91f7c0 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:35.714694568 +0000 UTC m=+66.377768641 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-cmm2r" (UniqueName: "kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r") pod "network-check-target-9xq79" (UID: "342772b3-9eb3-4f40-96ce-ef458a91f7c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 20:47:03.793566 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:03.793224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:47:03.793566 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:03.793257 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:47:03.793566 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:03.793224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:47:03.793566 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.793358 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqwnj" podUID="ce48a9f8-571d-4157-86e3-486076a847b0" Jul 01 20:47:03.793566 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.793445 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dfms9" podUID="61593544-4ffb-4630-af39-740a84a89867" Jul 01 20:47:03.793566 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:03.793553 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq79" podUID="342772b3-9eb3-4f40-96ce-ef458a91f7c0" Jul 01 20:47:04.653726 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.653563 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-25.ec2.internal" event="NodeReady" Jul 01 20:47:04.654002 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.653835 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 20:47:04.730440 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.730382 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-96mff"] Jul 01 20:47:04.749480 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.749452 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x8sfd"] Jul 01 20:47:04.749593 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.749574 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-96mff" Jul 01 20:47:04.754029 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.754005 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 20:47:04.754250 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.754233 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w7rxr\"" Jul 01 20:47:04.754327 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.754311 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 20:47:04.754374 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.754313 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 20:47:04.761476 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.761459 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-96mff"] Jul 01 20:47:04.761597 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.761582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.766271 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.766251 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 20:47:04.766468 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.766453 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 20:47:04.766700 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.766685 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4r2bh\"" Jul 01 20:47:04.767184 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.767146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x8sfd"] Jul 01 20:47:04.822556 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.822526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75899a10-8aeb-4575-898a-6323f46a1582-cert\") pod \"ingress-canary-96mff\" (UID: \"75899a10-8aeb-4575-898a-6323f46a1582\") " pod="openshift-ingress-canary/ingress-canary-96mff" Jul 01 20:47:04.822712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.822564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77eb2e46-7917-4363-bed8-f33f3469be1c-tmp-dir\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.822712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.822632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77eb2e46-7917-4363-bed8-f33f3469be1c-config-volume\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.822712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.822669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zz7v\" (UniqueName: \"kubernetes.io/projected/77eb2e46-7917-4363-bed8-f33f3469be1c-kube-api-access-8zz7v\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.822876 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.822750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.822876 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.822820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg9s5\" (UniqueName: \"kubernetes.io/projected/75899a10-8aeb-4575-898a-6323f46a1582-kube-api-access-cg9s5\") pod \"ingress-canary-96mff\" (UID: \"75899a10-8aeb-4575-898a-6323f46a1582\") " pod="openshift-ingress-canary/ingress-canary-96mff" Jul 01 20:47:04.923743 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.923702 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg9s5\" (UniqueName: \"kubernetes.io/projected/75899a10-8aeb-4575-898a-6323f46a1582-kube-api-access-cg9s5\") pod \"ingress-canary-96mff\" (UID: \"75899a10-8aeb-4575-898a-6323f46a1582\") " pod="openshift-ingress-canary/ingress-canary-96mff" Jul 01 20:47:04.923743 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.923736 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75899a10-8aeb-4575-898a-6323f46a1582-cert\") pod \"ingress-canary-96mff\" (UID: \"75899a10-8aeb-4575-898a-6323f46a1582\") " pod="openshift-ingress-canary/ingress-canary-96mff" Jul 01 20:47:04.923957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.923767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77eb2e46-7917-4363-bed8-f33f3469be1c-tmp-dir\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.923957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.923794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77eb2e46-7917-4363-bed8-f33f3469be1c-config-volume\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.923957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.923829 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zz7v\" (UniqueName: \"kubernetes.io/projected/77eb2e46-7917-4363-bed8-f33f3469be1c-kube-api-access-8zz7v\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.923957 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.923879 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.924142 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:04.923981 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:47:04.924142 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:04.924043 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls podName:77eb2e46-7917-4363-bed8-f33f3469be1c nodeName:}" failed. No retries permitted until 2026-07-01 20:47:05.424024612 +0000 UTC m=+36.087098685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls") pod "dns-default-x8sfd" (UID: "77eb2e46-7917-4363-bed8-f33f3469be1c") : secret "dns-default-metrics-tls" not found Jul 01 20:47:04.924142 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.924071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77eb2e46-7917-4363-bed8-f33f3469be1c-tmp-dir\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.924331 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.924311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77eb2e46-7917-4363-bed8-f33f3469be1c-config-volume\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.928108 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.928089 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/75899a10-8aeb-4575-898a-6323f46a1582-cert\") pod \"ingress-canary-96mff\" (UID: \"75899a10-8aeb-4575-898a-6323f46a1582\") " pod="openshift-ingress-canary/ingress-canary-96mff" Jul 01 20:47:04.935312 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.935286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg9s5\" (UniqueName: \"kubernetes.io/projected/75899a10-8aeb-4575-898a-6323f46a1582-kube-api-access-cg9s5\") pod \"ingress-canary-96mff\" (UID: \"75899a10-8aeb-4575-898a-6323f46a1582\") " pod="openshift-ingress-canary/ingress-canary-96mff" Jul 01 20:47:04.936100 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.936074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zz7v\" (UniqueName: \"kubernetes.io/projected/77eb2e46-7917-4363-bed8-f33f3469be1c-kube-api-access-8zz7v\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:04.961188 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.961168 2562 generic.go:356] "Generic (PLEG): container finished" podID="d68195ee-0a76-4dd3-a690-f6f0f8833221" containerID="94bf9edafb566a2a2988be0f6628614c776f59ba279bec7b9563e1a0d692bd38" exitCode=0 Jul 01 20:47:04.961265 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:04.961204 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerDied","Data":"94bf9edafb566a2a2988be0f6628614c776f59ba279bec7b9563e1a0d692bd38"} Jul 01 20:47:05.058913 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.058891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-96mff" Jul 01 20:47:05.244959 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.244931 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-96mff"] Jul 01 20:47:05.248770 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:05.248712 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75899a10_8aeb_4575_898a_6323f46a1582.slice/crio-1cf1c04c94a83f95fc57e744324ab4f012027dbc4af0a2d880a3d2f552f2c841 WatchSource:0}: Error finding container 1cf1c04c94a83f95fc57e744324ab4f012027dbc4af0a2d880a3d2f552f2c841: Status 404 returned error can't find the container with id 1cf1c04c94a83f95fc57e744324ab4f012027dbc4af0a2d880a3d2f552f2c841 Jul 01 20:47:05.427836 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.427645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:05.427970 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:05.427789 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:47:05.427970 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:05.427952 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls podName:77eb2e46-7917-4363-bed8-f33f3469be1c nodeName:}" failed. No retries permitted until 2026-07-01 20:47:06.427935868 +0000 UTC m=+37.091009946 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls") pod "dns-default-x8sfd" (UID: "77eb2e46-7917-4363-bed8-f33f3469be1c") : secret "dns-default-metrics-tls" not found Jul 01 20:47:05.793152 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.793123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:47:05.794098 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.793123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:47:05.794098 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.793123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:47:05.797210 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.797188 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 20:47:05.797332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.797232 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xhskk\"" Jul 01 20:47:05.797619 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.797600 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 20:47:05.797710 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.797672 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 20:47:05.797710 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.797690 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 20:47:05.798211 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.798192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tg27v\"" Jul 01 20:47:05.967288 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.967250 2562 generic.go:356] "Generic (PLEG): container finished" podID="d68195ee-0a76-4dd3-a690-f6f0f8833221" containerID="67246cf7f77bcd42682146ce6c385bedae32a48d7013d05d5e1dec3bfea1326f" exitCode=0 Jul 01 20:47:05.967515 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.967329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerDied","Data":"67246cf7f77bcd42682146ce6c385bedae32a48d7013d05d5e1dec3bfea1326f"} Jul 01 20:47:05.968419 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:05.968391 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-96mff" event={"ID":"75899a10-8aeb-4575-898a-6323f46a1582","Type":"ContainerStarted","Data":"1cf1c04c94a83f95fc57e744324ab4f012027dbc4af0a2d880a3d2f552f2c841"} Jul 01 20:47:06.436096 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:06.436059 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:06.436368 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:06.436192 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:47:06.436368 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:06.436253 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls podName:77eb2e46-7917-4363-bed8-f33f3469be1c nodeName:}" failed. No retries permitted until 2026-07-01 20:47:08.436240042 +0000 UTC m=+39.099314105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls") pod "dns-default-x8sfd" (UID: "77eb2e46-7917-4363-bed8-f33f3469be1c") : secret "dns-default-metrics-tls" not found Jul 01 20:47:06.975081 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:06.975044 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" event={"ID":"d68195ee-0a76-4dd3-a690-f6f0f8833221","Type":"ContainerStarted","Data":"0c2242ee7255db11ade7e6abfa1775377b29d370e672bc85150bbccb63477cf7"} Jul 01 20:47:07.004113 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:07.004066 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-kdj9r" podStartSLOduration=9.231516161 podStartE2EDuration="38.004045949s" totalImagesPullingTime="28.772529788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:29 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:07.002439078 +0000 UTC m=+37.665513204" watchObservedRunningTime="2026-07-01 20:47:07.004045949 +0000 UTC m=+37.667120012" Jul 01 20:47:07.085819 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:07.085771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:07.174617 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:07.174576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:07.311560 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:07.310355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:07.404950 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:07.404915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:07.978432 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:07.978350 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-96mff" event={"ID":"75899a10-8aeb-4575-898a-6323f46a1582","Type":"ContainerStarted","Data":"eb49d41b6fcee150938ee61f0b99462207495c1141293af4c201cf9798666dd1"} Jul 01 20:47:08.000003 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:07.999963 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-96mff" podStartSLOduration=1.596669746 podStartE2EDuration="3.999949571s" totalImagesPullingTime="2.403279825s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:07.998943527 +0000 UTC m=+38.662017610" watchObservedRunningTime="2026-07-01 20:47:07.999949571 +0000 UTC m=+38.663023654" Jul 01 20:47:08.449756 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:08.449722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:08.449909 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:08.449868 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:47:08.449953 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:08.449928 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls podName:77eb2e46-7917-4363-bed8-f33f3469be1c nodeName:}" failed. No retries permitted until 2026-07-01 20:47:12.449912676 +0000 UTC m=+43.112986737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls") pod "dns-default-x8sfd" (UID: "77eb2e46-7917-4363-bed8-f33f3469be1c") : secret "dns-default-metrics-tls" not found Jul 01 20:47:09.844666 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:09.844632 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:09.935740 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:09.935692 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:10.400152 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:10.400114 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:10.500950 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:10.500923 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:11.291695 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.291666 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5"] Jul 01 20:47:11.324796 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.324773 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw"] Jul 01 20:47:11.324951 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.324925 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5" Jul 01 20:47:11.329991 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.329966 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:47:11.330269 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.330252 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dqkzj\"" Jul 01 20:47:11.330555 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.330533 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 01 20:47:11.344926 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.344908 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5"] Jul 01 20:47:11.345040 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.344937 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw"] Jul 01 20:47:11.345100 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.345035 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:11.345478 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.345463 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4"] Jul 01 20:47:11.351109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.351093 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 01 20:47:11.351219 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.351144 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 01 20:47:11.351351 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.351330 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hh762\"" Jul 01 20:47:11.351351 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.351346 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 01 20:47:11.369737 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.369718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5vws\" (UniqueName: \"kubernetes.io/projected/a7fe89ea-4263-466b-8e11-e20d72075ffe-kube-api-access-m5vws\") pod \"volume-data-source-validator-69d9f679db-zndb5\" (UID: \"a7fe89ea-4263-466b-8e11-e20d72075ffe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5" Jul 01 20:47:11.369811 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.369745 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlm58\" (UniqueName: \"kubernetes.io/projected/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-kube-api-access-dlm58\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:11.369856 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.369840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:11.370889 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.370873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.372132 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.372115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4"] Jul 01 20:47:11.373654 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.373636 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 01 20:47:11.373852 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.373836 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 20:47:11.373929 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.373906 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 20:47:11.375529 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.375513 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 01 20:47:11.377470 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.377457 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tr8vl\"" Jul 01 20:47:11.419379 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.419354 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c86fcdcc5-2hv6m"] Jul 01 20:47:11.442867 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.442847 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c86fcdcc5-2hv6m"] Jul 01 20:47:11.442961 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.442946 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.445767 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.445751 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 20:47:11.445878 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.445780 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 20:47:11.446710 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.446680 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dgzdr\"" Jul 01 20:47:11.446873 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.446854 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 20:47:11.455556 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.455536 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 20:47:11.470420 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470395 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.470518 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470423 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-certificates\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.470518 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:11.470518 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0890ac18-afbd-49ea-ac63-e904ca9ff494-ca-trust-extracted\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.470677 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-image-registry-private-configuration\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.470677 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-installation-pull-secrets\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.470677 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.470562 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:47:11.470677 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/554351e4-bd8a-47b2-be1b-6ade48967d13-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.470677 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.470641 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls podName:589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be nodeName:}" failed. No retries permitted until 2026-07-01 20:47:11.970620808 +0000 UTC m=+42.633694876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-n96qw" (UID: "589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be") : secret "samples-operator-tls" not found Jul 01 20:47:11.470677 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr2x6\" (UniqueName: \"kubernetes.io/projected/554351e4-bd8a-47b2-be1b-6ade48967d13-kube-api-access-jr2x6\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.471026 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5vws\" (UniqueName: \"kubernetes.io/projected/a7fe89ea-4263-466b-8e11-e20d72075ffe-kube-api-access-m5vws\") pod \"volume-data-source-validator-69d9f679db-zndb5\" (UID: \"a7fe89ea-4263-466b-8e11-e20d72075ffe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5" Jul 01 20:47:11.471026 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470724 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlm58\" (UniqueName: \"kubernetes.io/projected/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-kube-api-access-dlm58\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:11.471026 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-bound-sa-token\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.471026 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2tfz\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-kube-api-access-n2tfz\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.471026 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.471026 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.470890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-trusted-ca\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.494776 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.494748 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5vws\" (UniqueName: \"kubernetes.io/projected/a7fe89ea-4263-466b-8e11-e20d72075ffe-kube-api-access-m5vws\") pod \"volume-data-source-validator-69d9f679db-zndb5\" (UID: \"a7fe89ea-4263-466b-8e11-e20d72075ffe\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5" Jul 01 20:47:11.502429 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.502409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlm58\" (UniqueName: \"kubernetes.io/projected/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-kube-api-access-dlm58\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:11.523598 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.523578 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fnsdn"] Jul 01 20:47:11.547037 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.546991 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.550324 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.550306 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 01 20:47:11.550463 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.550448 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 20:47:11.550644 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.550605 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 20:47:11.550825 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.550799 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 01 20:47:11.553611 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.553591 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-8xffg\"" Jul 01 20:47:11.561102 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.561086 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 01 20:47:11.571499 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.571464 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-trusted-ca\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.571624 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.571511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68955a3f-ae9c-43ce-bb16-370512e1075b-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.571624 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.571533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.571624 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.571549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-certificates\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.571624 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.571586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0890ac18-afbd-49ea-ac63-e904ca9ff494-ca-trust-extracted\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.571624 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.571610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-image-registry-private-configuration\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.571954 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.571742 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:11.571954 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.571863 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls podName:554351e4-bd8a-47b2-be1b-6ade48967d13 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:12.071839145 +0000 UTC m=+42.734913220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-67ft4" (UID: "554351e4-bd8a-47b2-be1b-6ade48967d13") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:11.572211 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-installation-pull-secrets\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.572281 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572222 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0890ac18-afbd-49ea-ac63-e904ca9ff494-ca-trust-extracted\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.572340 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572250 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-certificates\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.572580 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68955a3f-ae9c-43ce-bb16-370512e1075b-snapshots\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.572661 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68955a3f-ae9c-43ce-bb16-370512e1075b-service-ca-bundle\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.572721 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/554351e4-bd8a-47b2-be1b-6ade48967d13-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.572942 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jr2x6\" (UniqueName: \"kubernetes.io/projected/554351e4-bd8a-47b2-be1b-6ade48967d13-kube-api-access-jr2x6\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.572942 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-bound-sa-token\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.572942 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-trusted-ca\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.572942 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2tfz\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-kube-api-access-n2tfz\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.572942 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68955a3f-ae9c-43ce-bb16-370512e1075b-tmp\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.572942 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc8r9\" (UniqueName: \"kubernetes.io/projected/68955a3f-ae9c-43ce-bb16-370512e1075b-kube-api-access-sc8r9\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.572942 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68955a3f-ae9c-43ce-bb16-370512e1075b-serving-cert\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.572942 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.572943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.573364 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.573341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/554351e4-bd8a-47b2-be1b-6ade48967d13-telemetry-config\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.573556 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.573540 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:47:11.573556 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.573558 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c86fcdcc5-2hv6m: secret "image-registry-tls" not found Jul 01 20:47:11.573686 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.573597 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls podName:0890ac18-afbd-49ea-ac63-e904ca9ff494 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:12.073586946 +0000 UTC m=+42.736661007 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls") pod "image-registry-5c86fcdcc5-2hv6m" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494") : secret "image-registry-tls" not found Jul 01 20:47:11.574256 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.574231 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-image-registry-private-configuration\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.574764 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.574745 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-installation-pull-secrets\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.579296 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.579274 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fnsdn"] Jul 01 20:47:11.613873 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.613855 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-58cfc75779-7flpw"] Jul 01 20:47:11.615762 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.615740 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2tfz\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-kube-api-access-n2tfz\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.617236 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.617214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr2x6\" (UniqueName: \"kubernetes.io/projected/554351e4-bd8a-47b2-be1b-6ade48967d13-kube-api-access-jr2x6\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:11.630707 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.630688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-bound-sa-token\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:11.634542 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.634525 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5" Jul 01 20:47:11.649167 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.649148 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58cfc75779-7flpw"] Jul 01 20:47:11.649255 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.649222 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.652120 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.652105 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 01 20:47:11.652184 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.652135 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 01 20:47:11.652563 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.652544 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-69ldn\"" Jul 01 20:47:11.652675 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.652656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 01 20:47:11.653046 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.653031 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 20:47:11.653180 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.653166 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 01 20:47:11.653256 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.653244 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 20:47:11.674618 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674600 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-default-certificate\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.674712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68955a3f-ae9c-43ce-bb16-370512e1075b-snapshots\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.674712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-stats-auth\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.674788 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpc4g\" (UniqueName: \"kubernetes.io/projected/4e30d86c-6418-4e88-af26-7934f1156333-kube-api-access-zpc4g\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.674788 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68955a3f-ae9c-43ce-bb16-370512e1075b-tmp\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.674788 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.674910 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.674943 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68955a3f-ae9c-43ce-bb16-370512e1075b-service-ca-bundle\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.674975 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.674954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68955a3f-ae9c-43ce-bb16-370512e1075b-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.675029 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.675013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc8r9\" (UniqueName: \"kubernetes.io/projected/68955a3f-ae9c-43ce-bb16-370512e1075b-kube-api-access-sc8r9\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.675083 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.675041 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68955a3f-ae9c-43ce-bb16-370512e1075b-serving-cert\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.675275 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.675259 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68955a3f-ae9c-43ce-bb16-370512e1075b-tmp\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.675332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.675314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/68955a3f-ae9c-43ce-bb16-370512e1075b-snapshots\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.675542 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.675523 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68955a3f-ae9c-43ce-bb16-370512e1075b-service-ca-bundle\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.675836 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.675816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/68955a3f-ae9c-43ce-bb16-370512e1075b-trusted-ca-bundle\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.677305 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.677290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68955a3f-ae9c-43ce-bb16-370512e1075b-serving-cert\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.681103 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.681081 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:11.689531 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.689506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc8r9\" (UniqueName: \"kubernetes.io/projected/68955a3f-ae9c-43ce-bb16-370512e1075b-kube-api-access-sc8r9\") pod \"insights-operator-5f67b55555-fnsdn\" (UID: \"68955a3f-ae9c-43ce-bb16-370512e1075b\") " pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.776061 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.776031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-default-certificate\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.776219 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.776069 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-stats-auth\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.776219 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.776096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpc4g\" (UniqueName: \"kubernetes.io/projected/4e30d86c-6418-4e88-af26-7934f1156333-kube-api-access-zpc4g\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.776219 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.776129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.776384 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.776233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.776384 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.776243 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:12.276229799 +0000 UTC m=+42.939303860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : configmap references non-existent config key: service-ca.crt Jul 01 20:47:11.776524 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.776389 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:47:11.776524 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.776460 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:12.276442225 +0000 UTC m=+42.939516285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : secret "router-metrics-certs-default" not found Jul 01 20:47:11.787901 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.787876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-default-certificate\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.788014 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.787881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-stats-auth\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.788014 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.787971 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:11.798362 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.798298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpc4g\" (UniqueName: \"kubernetes.io/projected/4e30d86c-6418-4e88-af26-7934f1156333-kube-api-access-zpc4g\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:11.798630 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.798599 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5"] Jul 01 20:47:11.803056 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:11.803037 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7fe89ea_4263_466b_8e11_e20d72075ffe.slice/crio-659d6fd6bc266e109acacf092e243312b6b053a1e34c55a2e4152c7895158944 WatchSource:0}: Error finding container 659d6fd6bc266e109acacf092e243312b6b053a1e34c55a2e4152c7895158944: Status 404 returned error can't find the container with id 659d6fd6bc266e109acacf092e243312b6b053a1e34c55a2e4152c7895158944 Jul 01 20:47:11.855127 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.855104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5f67b55555-fnsdn" Jul 01 20:47:11.885835 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.885807 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:11.977890 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.977862 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:11.978007 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.977996 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:47:11.978066 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:11.978056 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls podName:589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be nodeName:}" failed. No retries permitted until 2026-07-01 20:47:12.978040875 +0000 UTC m=+43.641114936 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-n96qw" (UID: "589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be") : secret "samples-operator-tls" not found Jul 01 20:47:11.989985 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.989954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5" event={"ID":"a7fe89ea-4263-466b-8e11-e20d72075ffe","Type":"ContainerStarted","Data":"659d6fd6bc266e109acacf092e243312b6b053a1e34c55a2e4152c7895158944"} Jul 01 20:47:11.991413 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:11.991392 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:12.003891 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.003868 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5f67b55555-fnsdn"] Jul 01 20:47:12.005142 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:12.005122 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68955a3f_ae9c_43ce_bb16_370512e1075b.slice/crio-e81765e0f010ae4c21306be013fd397ccbc6655adedafda34852f6e70fc1dc67 WatchSource:0}: Error finding container e81765e0f010ae4c21306be013fd397ccbc6655adedafda34852f6e70fc1dc67: Status 404 returned error can't find the container with id e81765e0f010ae4c21306be013fd397ccbc6655adedafda34852f6e70fc1dc67 Jul 01 20:47:12.078550 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.078480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:12.078550 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.078539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:12.078668 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.078621 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:12.078668 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.078626 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:47:12.078668 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.078641 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c86fcdcc5-2hv6m: secret "image-registry-tls" not found Jul 01 20:47:12.078668 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.078664 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls podName:554351e4-bd8a-47b2-be1b-6ade48967d13 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:13.078651912 +0000 UTC m=+43.741725973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-67ft4" (UID: "554351e4-bd8a-47b2-be1b-6ade48967d13") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:12.078791 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.078682 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls podName:0890ac18-afbd-49ea-ac63-e904ca9ff494 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:13.078670403 +0000 UTC m=+43.741744465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls") pod "image-registry-5c86fcdcc5-2hv6m" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494") : secret "image-registry-tls" not found Jul 01 20:47:12.280398 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.280372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:12.280398 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.280400 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:12.280575 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.280526 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:47:12.280575 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.280542 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:13.280527605 +0000 UTC m=+43.943601669 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : configmap references non-existent config key: service-ca.crt Jul 01 20:47:12.280575 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.280565 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:13.280554491 +0000 UTC m=+43.943628552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : secret "router-metrics-certs-default" not found Jul 01 20:47:12.482783 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.482746 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:12.483196 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.482915 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:47:12.483196 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.482982 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls podName:77eb2e46-7917-4363-bed8-f33f3469be1c nodeName:}" failed. No retries permitted until 2026-07-01 20:47:20.482962204 +0000 UTC m=+51.146036265 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls") pod "dns-default-x8sfd" (UID: "77eb2e46-7917-4363-bed8-f33f3469be1c") : secret "dns-default-metrics-tls" not found Jul 01 20:47:12.770234 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.770082 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:12.841104 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.841067 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:12.986332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.986300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:12.986476 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.986420 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:47:12.986476 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:12.986469 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls podName:589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be nodeName:}" failed. No retries permitted until 2026-07-01 20:47:14.986456086 +0000 UTC m=+45.649530147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-n96qw" (UID: "589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be") : secret "samples-operator-tls" not found Jul 01 20:47:12.992855 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:12.992824 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fnsdn" event={"ID":"68955a3f-ae9c-43ce-bb16-370512e1075b","Type":"ContainerStarted","Data":"e81765e0f010ae4c21306be013fd397ccbc6655adedafda34852f6e70fc1dc67"} Jul 01 20:47:13.087653 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:13.087591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:13.087769 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:13.087650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:13.087769 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:13.087746 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:47:13.087769 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:13.087762 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:13.087925 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:13.087829 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls podName:554351e4-bd8a-47b2-be1b-6ade48967d13 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:15.087809254 +0000 UTC m=+45.750883332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-67ft4" (UID: "554351e4-bd8a-47b2-be1b-6ade48967d13") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:13.087925 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:13.087766 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c86fcdcc5-2hv6m: secret "image-registry-tls" not found Jul 01 20:47:13.087925 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:13.087883 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls podName:0890ac18-afbd-49ea-ac63-e904ca9ff494 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:15.087872913 +0000 UTC m=+45.750946988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls") pod "image-registry-5c86fcdcc5-2hv6m" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494") : secret "image-registry-tls" not found Jul 01 20:47:13.289907 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:13.289885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:13.290007 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:13.289917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:13.290066 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:13.290038 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:15.290018457 +0000 UTC m=+45.953092538 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : configmap references non-existent config key: service-ca.crt Jul 01 20:47:13.290135 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:13.290117 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:47:13.290187 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:13.290177 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:15.290158802 +0000 UTC m=+45.953232868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : secret "router-metrics-certs-default" not found Jul 01 20:47:13.997143 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:13.997106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5" event={"ID":"a7fe89ea-4263-466b-8e11-e20d72075ffe","Type":"ContainerStarted","Data":"8bf0249409d3e4b3907e4b531d3c21f58178bb819fabb8a56ee6bfb1de8b9aea"} Jul 01 20:47:14.017920 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:14.017867 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-69d9f679db-zndb5" podStartSLOduration=1.572361251 podStartE2EDuration="3.01784688s" totalImagesPullingTime="1.445485629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:14.016644988 +0000 UTC m=+44.679719098" watchObservedRunningTime="2026-07-01 20:47:14.01784688 +0000 UTC m=+44.680920966" Jul 01 20:47:14.178224 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:14.178191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:14.275516 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:14.275402 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:15.001092 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:15.001061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fnsdn" event={"ID":"68955a3f-ae9c-43ce-bb16-370512e1075b","Type":"ContainerStarted","Data":"192eb2265d4fe79500de185d919c7cd6db99c8dee812d9bcbedd63eaecf3857f"} Jul 01 20:47:15.003714 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:15.003694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:15.003805 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.003783 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:47:15.003856 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.003826 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls podName:589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be nodeName:}" failed. No retries permitted until 2026-07-01 20:47:19.003814667 +0000 UTC m=+49.666888728 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-n96qw" (UID: "589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be") : secret "samples-operator-tls" not found Jul 01 20:47:15.026852 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:15.026809 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5f67b55555-fnsdn" podStartSLOduration=1.388657067 podStartE2EDuration="4.026786955s" totalImagesPullingTime="2.638129888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:15.02573645 +0000 UTC m=+45.688810534" watchObservedRunningTime="2026-07-01 20:47:15.026786955 +0000 UTC m=+45.689861037" Jul 01 20:47:15.104572 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:15.104546 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:15.104678 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.104640 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:47:15.104678 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.104650 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c86fcdcc5-2hv6m: secret "image-registry-tls" not found Jul 01 20:47:15.104757 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.104694 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls podName:0890ac18-afbd-49ea-ac63-e904ca9ff494 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:19.104682033 +0000 UTC m=+49.767756093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls") pod "image-registry-5c86fcdcc5-2hv6m" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494") : secret "image-registry-tls" not found Jul 01 20:47:15.104757 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:15.104723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:15.104964 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.104947 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:15.105068 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.104999 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls podName:554351e4-bd8a-47b2-be1b-6ade48967d13 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:19.10498464 +0000 UTC m=+49.768058708 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-67ft4" (UID: "554351e4-bd8a-47b2-be1b-6ade48967d13") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:15.305724 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:15.305673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:15.305724 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:15.305699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:15.305842 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.305786 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:47:15.305842 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.305802 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:19.305789437 +0000 UTC m=+49.968863498 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : configmap references non-existent config key: service-ca.crt Jul 01 20:47:15.305842 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:15.305822 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:19.305813312 +0000 UTC m=+49.968887373 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : secret "router-metrics-certs-default" not found Jul 01 20:47:16.046148 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.046114 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tff4z"] Jul 01 20:47:16.069293 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.069271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.069418 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.069388 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tff4z"] Jul 01 20:47:16.073829 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.073808 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vcwf4\"" Jul 01 20:47:16.073949 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.073848 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 20:47:16.074820 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.074791 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 20:47:16.086397 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.086373 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:16.113646 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.113625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4449b3ee-b2a4-4082-b4fe-c73f384e3829-crio-socket\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.113737 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.113709 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4449b3ee-b2a4-4082-b4fe-c73f384e3829-data-volume\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.113800 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.113755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.113800 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.113788 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjdps\" (UniqueName: \"kubernetes.io/projected/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-api-access-vjdps\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.113922 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.113898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.215014 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.214986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.215139 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.215121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4449b3ee-b2a4-4082-b4fe-c73f384e3829-crio-socket\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.215184 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:16.215134 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:47:16.215184 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.215176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4449b3ee-b2a4-4082-b4fe-c73f384e3829-data-volume\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.215244 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:16.215198 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:16.715181331 +0000 UTC m=+47.378255392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : secret "insights-runtime-extractor-tls" not found Jul 01 20:47:16.215285 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.215240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.215285 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.215255 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4449b3ee-b2a4-4082-b4fe-c73f384e3829-crio-socket\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.215285 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.215274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjdps\" (UniqueName: \"kubernetes.io/projected/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-api-access-vjdps\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.215372 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:16.215310 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:47:16.215372 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:16.215353 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:16.71534063 +0000 UTC m=+47.378414692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : configmap "kube-rbac-proxy" not found Jul 01 20:47:16.215429 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.215383 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4449b3ee-b2a4-4082-b4fe-c73f384e3829-data-volume\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.232566 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.232540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjdps\" (UniqueName: \"kubernetes.io/projected/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-api-access-vjdps\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.297407 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.297352 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:16.399270 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.399243 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:16.498438 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.498409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:16.719978 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.719955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.720063 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:16.719995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:16.720115 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:16.720067 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:47:16.720115 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:16.720092 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:47:16.720171 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:16.720133 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:17.720120066 +0000 UTC m=+48.383194127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : configmap "kube-rbac-proxy" not found Jul 01 20:47:16.720211 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:16.720171 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:17.720139868 +0000 UTC m=+48.383213928 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : secret "insights-runtime-extractor-tls" not found Jul 01 20:47:17.378362 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:17.378325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:17.470734 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:17.470676 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:17.727496 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:17.727465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:17.727628 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:17.727586 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:47:17.727628 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:17.727617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:17.727697 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:17.727638 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:19.727624498 +0000 UTC m=+50.390698559 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : secret "insights-runtime-extractor-tls" not found Jul 01 20:47:17.727697 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:17.727665 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:47:17.727768 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:17.727709 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:19.727697494 +0000 UTC m=+50.390771557 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : configmap "kube-rbac-proxy" not found Jul 01 20:47:17.993935 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:17.993865 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x9gsc_1e097ef9-805e-4b23-b57b-8b74ac8ede72/dns-node-resolver/0.log" Jul 01 20:47:18.585464 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:18.585412 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:18.693567 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:18.693536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:18.793102 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:18.793066 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:19.022306 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.022282 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:19.037290 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.037263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:19.037418 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.037402 2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 01 20:47:19.037480 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.037470 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls podName:589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be nodeName:}" failed. No retries permitted until 2026-07-01 20:47:27.037456188 +0000 UTC m=+57.700530249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls") pod "cluster-samples-operator-9ddc5ff76-n96qw" (UID: "589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be") : secret "samples-operator-tls" not found Jul 01 20:47:19.090534 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.090513 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:19.138195 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.138171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:19.138289 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.138214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:19.138337 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.138309 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:47:19.138337 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.138326 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c86fcdcc5-2hv6m: secret "image-registry-tls" not found Jul 01 20:47:19.138416 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.138343 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:19.138416 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.138375 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls podName:0890ac18-afbd-49ea-ac63-e904ca9ff494 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:27.138361752 +0000 UTC m=+57.801435813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls") pod "image-registry-5c86fcdcc5-2hv6m" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494") : secret "image-registry-tls" not found Jul 01 20:47:19.138416 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.138392 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls podName:554351e4-bd8a-47b2-be1b-6ade48967d13 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:27.138380656 +0000 UTC m=+57.801454718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-67ft4" (UID: "554351e4-bd8a-47b2-be1b-6ade48967d13") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:19.189396 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.189379 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk27w_fe82e58f-51df-4cb6-8c7f-855599d57966/node-ca/0.log" Jul 01 20:47:19.293817 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.293743 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:19.340159 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.340133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:19.340268 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.340172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:19.340336 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.340280 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:27.340264331 +0000 UTC m=+58.003338395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : configmap references non-existent config key: service-ca.crt Jul 01 20:47:19.340336 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.340302 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:47:19.340434 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.340372 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:27.340356667 +0000 UTC m=+58.003430747 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : secret "router-metrics-certs-default" not found Jul 01 20:47:19.388686 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.388647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:19.743762 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.743735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:19.744095 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.743842 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:19.744095 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.743878 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:47:19.744095 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.743902 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:47:19.744095 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.743937 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:23.743923291 +0000 UTC m=+54.406997352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : secret "insights-runtime-extractor-tls" not found Jul 01 20:47:19.744095 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:19.743951 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:23.743944771 +0000 UTC m=+54.407018832 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : configmap "kube-rbac-proxy" not found Jul 01 20:47:19.812705 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.812679 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-96mff_75899a10-8aeb-4575-898a-6323f46a1582/serve-healthcheck-canary/0.log" Jul 01 20:47:19.852444 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.852412 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:19.953263 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:19.953238 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:20.549360 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:20.549334 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:20.549535 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:20.549465 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 20:47:20.549585 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:20.549556 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls podName:77eb2e46-7917-4363-bed8-f33f3469be1c nodeName:}" failed. No retries permitted until 2026-07-01 20:47:36.549540165 +0000 UTC m=+67.212614226 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls") pod "dns-default-x8sfd" (UID: "77eb2e46-7917-4363-bed8-f33f3469be1c") : secret "dns-default-metrics-tls" not found Jul 01 20:47:20.918646 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:20.918616 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:20.977960 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:20.977932 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:22.148670 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:22.148640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:23.774290 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:23.774247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:23.774747 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:23.774397 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:47:23.774747 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:23.774411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:23.774747 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:23.774454 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:31.774439994 +0000 UTC m=+62.437514060 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : secret "insights-runtime-extractor-tls" not found Jul 01 20:47:23.774747 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:23.774533 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 20:47:23.774747 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:23.774593 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:31.774580711 +0000 UTC m=+62.437654772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : configmap "kube-rbac-proxy" not found Jul 01 20:47:24.995808 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:24.995774 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:25.251918 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:25.251835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:25.357441 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:25.357411 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:25.727164 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:25.727133 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:26.547526 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:26.547496 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:26.704497 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:26.704455 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:26.905357 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:26.905331 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:27.100094 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.100060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:27.102511 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.102470 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be-samples-operator-tls\") pod \"cluster-samples-operator-9ddc5ff76-n96qw\" (UID: \"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:27.200755 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.200699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:27.200755 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.200737 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:27.200907 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:27.200834 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 01 20:47:27.200907 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:27.200849 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:27.200907 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:27.200850 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c86fcdcc5-2hv6m: secret "image-registry-tls" not found Jul 01 20:47:27.200907 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:27.200904 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls podName:0890ac18-afbd-49ea-ac63-e904ca9ff494 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:43.200886526 +0000 UTC m=+73.863960589 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls") pod "image-registry-5c86fcdcc5-2hv6m" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494") : secret "image-registry-tls" not found Jul 01 20:47:27.201043 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:27.200925 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls podName:554351e4-bd8a-47b2-be1b-6ade48967d13 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:43.200913932 +0000 UTC m=+73.863987993 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-54cb84584-67ft4" (UID: "554351e4-bd8a-47b2-be1b-6ade48967d13") : secret "cluster-monitoring-operator-tls" not found Jul 01 20:47:27.252674 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.252651 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" Jul 01 20:47:27.309027 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.308981 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:27.382223 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.382198 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw"] Jul 01 20:47:27.403176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.403153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:27.403268 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.403182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:27.403351 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:27.403334 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:43.403315172 +0000 UTC m=+74.066389254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : configmap references non-existent config key: service-ca.crt Jul 01 20:47:27.403392 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:27.403340 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 01 20:47:27.403392 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:27.403379 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs podName:4e30d86c-6418-4e88-af26-7934f1156333 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:43.403369254 +0000 UTC m=+74.066443337 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs") pod "router-default-58cfc75779-7flpw" (UID: "4e30d86c-6418-4e88-af26-7934f1156333") : secret "router-metrics-certs-default" not found Jul 01 20:47:27.502317 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.502292 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:27.905668 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:27.905634 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:28.032979 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:28.032953 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" event={"ID":"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be","Type":"ContainerStarted","Data":"d17ec13241f2d67bd3f183547bb605e3125447889ef486190a54795257c19009"} Jul 01 20:47:28.509477 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:28.509437 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:28.723812 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:28.723772 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:28.945175 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:28.945147 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:29.138975 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:29.138934 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:29.311758 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:29.311681 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:29.425473 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:29.425443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:29.559526 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:29.559502 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:29.957541 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:29.957512 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-h7bpx" Jul 01 20:47:30.035062 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:30.035041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:30.040476 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:30.040448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" event={"ID":"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be","Type":"ContainerStarted","Data":"673a6d5a268ea590d650c3c2d412e88ed85717e55aad7952148fab74fe27fece"} Jul 01 20:47:30.040623 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:30.040508 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" event={"ID":"589fb2b4-5a8c-42e6-baf8-7f2c62f9d3be","Type":"ContainerStarted","Data":"31dbf144ab1f06b867bb29d13577421c90e6dd1125c8fb9a1a8aadbbe1698a3e"} Jul 01 20:47:30.092219 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:30.092166 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9ddc5ff76-n96qw" podStartSLOduration=17.022855692 podStartE2EDuration="19.09215218s" totalImagesPullingTime="2.069296488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:30.091474466 +0000 UTC m=+60.754548551" watchObservedRunningTime="2026-07-01 20:47:30.09215218 +0000 UTC m=+60.755226254" Jul 01 20:47:30.238653 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:30.238564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:30.528699 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:30.528610 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:31.120963 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:31.120936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:31.319412 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:31.319374 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:31.534177 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:31.534132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:31.662379 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:31.662340 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:31.784955 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:31.784892 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:31.836599 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:31.836569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:31.836705 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:31.836613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:31.836771 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:31.836754 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 20:47:31.836824 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:31.836799 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls podName:4449b3ee-b2a4-4082-b4fe-c73f384e3829 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:47.83678707 +0000 UTC m=+78.499861130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tff4z" (UID: "4449b3ee-b2a4-4082-b4fe-c73f384e3829") : secret "insights-runtime-extractor-tls" not found Jul 01 20:47:31.837132 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:31.837112 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4449b3ee-b2a4-4082-b4fe-c73f384e3829-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:32.948992 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:32.948931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:33.130305 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:33.130270 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:33.340650 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:33.340563 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:33.528188 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:33.528159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:33.762535 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:33.762473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:34.742235 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:34.742200 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:34.959866 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:34.959823 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:35.121124 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.121046 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:35.516860 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.516827 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:35.564162 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.564133 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:47:35.571591 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.571572 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 20:47:35.576871 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.576854 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/61593544-4ffb-4630-af39-740a84a89867-metrics-certs\") pod \"network-metrics-daemon-dfms9\" (UID: \"61593544-4ffb-4630-af39-740a84a89867\") " pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:47:35.665442 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.665415 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:47:35.668431 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.668418 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 20:47:35.677965 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.677942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ce48a9f8-571d-4157-86e3-486076a847b0-original-pull-secret\") pod \"global-pull-secret-syncer-tqwnj\" (UID: \"ce48a9f8-571d-4157-86e3-486076a847b0\") " pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:47:35.732324 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.732295 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:35.766541 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.766520 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:47:35.771135 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.771094 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 20:47:35.779763 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.779745 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 20:47:35.789832 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.789809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmm2r\" (UniqueName: \"kubernetes.io/projected/342772b3-9eb3-4f40-96ce-ef458a91f7c0-kube-api-access-cmm2r\") pod \"network-check-target-9xq79\" (UID: \"342772b3-9eb3-4f40-96ce-ef458a91f7c0\") " pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:47:35.808383 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.808365 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xhskk\"" Jul 01 20:47:35.815749 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.815735 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dfms9" Jul 01 20:47:35.815831 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.815750 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tg27v\"" Jul 01 20:47:35.818899 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.818886 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqwnj" Jul 01 20:47:35.822968 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.822958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:47:35.959435 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:35.959182 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:36.023508 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.023422 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tqwnj"] Jul 01 20:47:36.026601 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:36.026573 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce48a9f8_571d_4157_86e3_486076a847b0.slice/crio-96e34227455115d1146b0baca3636dc81f5b103e1c6c51f380f045d63796d746 WatchSource:0}: Error finding container 96e34227455115d1146b0baca3636dc81f5b103e1c6c51f380f045d63796d746: Status 404 returned error can't find the container with id 96e34227455115d1146b0baca3636dc81f5b103e1c6c51f380f045d63796d746 Jul 01 20:47:36.029002 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.028974 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dfms9"] Jul 01 20:47:36.032123 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:36.032102 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61593544_4ffb_4630_af39_740a84a89867.slice/crio-a777bc481b4822ce5fa05b6e745b56e5c1fdb5a501ebd35da63adf4e2e0d3463 WatchSource:0}: Error finding container a777bc481b4822ce5fa05b6e745b56e5c1fdb5a501ebd35da63adf4e2e0d3463: Status 404 returned error can't find the container with id a777bc481b4822ce5fa05b6e745b56e5c1fdb5a501ebd35da63adf4e2e0d3463 Jul 01 20:47:36.048919 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.048887 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xq79"] Jul 01 20:47:36.051098 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:36.051080 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod342772b3_9eb3_4f40_96ce_ef458a91f7c0.slice/crio-545a0ef9cdd31e350be39f32ec14ffaf7e3c5c997fdaebeba65c006d89b64870 WatchSource:0}: Error finding container 545a0ef9cdd31e350be39f32ec14ffaf7e3c5c997fdaebeba65c006d89b64870: Status 404 returned error can't find the container with id 545a0ef9cdd31e350be39f32ec14ffaf7e3c5c997fdaebeba65c006d89b64870 Jul 01 20:47:36.064686 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.064663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tqwnj" event={"ID":"ce48a9f8-571d-4157-86e3-486076a847b0","Type":"ContainerStarted","Data":"96e34227455115d1146b0baca3636dc81f5b103e1c6c51f380f045d63796d746"} Jul 01 20:47:36.065795 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.065765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xq79" event={"ID":"342772b3-9eb3-4f40-96ce-ef458a91f7c0","Type":"ContainerStarted","Data":"545a0ef9cdd31e350be39f32ec14ffaf7e3c5c997fdaebeba65c006d89b64870"} Jul 01 20:47:36.066825 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.066764 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfms9" event={"ID":"61593544-4ffb-4630-af39-740a84a89867","Type":"ContainerStarted","Data":"a777bc481b4822ce5fa05b6e745b56e5c1fdb5a501ebd35da63adf4e2e0d3463"} Jul 01 20:47:36.573328 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.573289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:36.579048 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.579016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77eb2e46-7917-4363-bed8-f33f3469be1c-metrics-tls\") pod \"dns-default-x8sfd\" (UID: \"77eb2e46-7917-4363-bed8-f33f3469be1c\") " pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:36.811381 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.811321 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:36.873389 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.873315 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4r2bh\"" Jul 01 20:47:36.880140 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.880115 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:36.923040 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:36.923006 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:37.053640 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:37.053597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:37.239283 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:37.239215 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x8sfd"] Jul 01 20:47:37.244667 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:37.244638 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77eb2e46_7917_4363_bed8_f33f3469be1c.slice/crio-54bc0351516613200e7549b88610c12f9d5956d1aa43ddc9fd1db9950f5e6019 WatchSource:0}: Error finding container 54bc0351516613200e7549b88610c12f9d5956d1aa43ddc9fd1db9950f5e6019: Status 404 returned error can't find the container with id 54bc0351516613200e7549b88610c12f9d5956d1aa43ddc9fd1db9950f5e6019 Jul 01 20:47:37.259448 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:37.259382 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:37.361835 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:37.361810 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:37.482677 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:37.482637 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:37.849627 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:37.849548 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:37.926108 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:37.926071 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:38.077987 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:38.077945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfms9" event={"ID":"61593544-4ffb-4630-af39-740a84a89867","Type":"ContainerStarted","Data":"f6e6387ed949b65c33971355bf81ea9e544eee145a49567fa6730f6949bef488"} Jul 01 20:47:38.078172 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:38.078017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dfms9" event={"ID":"61593544-4ffb-4630-af39-740a84a89867","Type":"ContainerStarted","Data":"987c503dad191f48c38321423f80f79920b521e0b0a6d16da9cf8084c3b8adb0"} Jul 01 20:47:38.080000 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:38.079938 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8sfd" event={"ID":"77eb2e46-7917-4363-bed8-f33f3469be1c","Type":"ContainerStarted","Data":"54bc0351516613200e7549b88610c12f9d5956d1aa43ddc9fd1db9950f5e6019"} Jul 01 20:47:38.100594 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:38.100461 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dfms9" podStartSLOduration=68.030380099 podStartE2EDuration="1m9.100438848s" totalImagesPullingTime="1.070058749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:46:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:38.098405669 +0000 UTC m=+68.761479756" watchObservedRunningTime="2026-07-01 20:47:38.100438848 +0000 UTC m=+68.763512932" Jul 01 20:47:38.226619 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:38.226588 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:38.640387 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:38.640345 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:38.838991 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:38.838956 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:39.055650 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:39.055613 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:39.142090 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:39.142057 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:39.219234 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:39.219207 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:39.480471 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:39.480436 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:39.598478 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:39.598443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:41.712873 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:41.712834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:41.790534 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:41.790504 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:42.099577 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.099500 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8sfd" event={"ID":"77eb2e46-7917-4363-bed8-f33f3469be1c","Type":"ContainerStarted","Data":"3a0d911db3780807cd0936d5b3992291e7a42ad5568c748315d96e33812cee0a"} Jul 01 20:47:42.099577 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.099556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x8sfd" event={"ID":"77eb2e46-7917-4363-bed8-f33f3469be1c","Type":"ContainerStarted","Data":"f9fc471079d73a37da2a2b23ccec9b040b5916528da65abf447dd1c1af3a746c"} Jul 01 20:47:42.099768 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.099589 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:42.100939 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.100912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tqwnj" event={"ID":"ce48a9f8-571d-4157-86e3-486076a847b0","Type":"ContainerStarted","Data":"7234b648169dc6a826b28442e7ff79ee18414fdf7f0c1cce95c6df0b807c23e5"} Jul 01 20:47:42.102337 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.102317 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xq79" event={"ID":"342772b3-9eb3-4f40-96ce-ef458a91f7c0","Type":"ContainerStarted","Data":"0779744af1c7ab7f6ba913128429afd20defc625f637c3e809b0e87b43df8556"} Jul 01 20:47:42.102448 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.102438 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:47:42.122845 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.122804 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x8sfd" podStartSLOduration=34.244656972 podStartE2EDuration="38.122790521s" totalImagesPullingTime="3.878133549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:42.12128372 +0000 UTC m=+72.784357828" watchObservedRunningTime="2026-07-01 20:47:42.122790521 +0000 UTC m=+72.785864603" Jul 01 20:47:42.141858 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.141817 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tqwnj" podStartSLOduration=67.033323112 podStartE2EDuration="1m12.141805355s" totalImagesPullingTime="5.108482243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:42.141573641 +0000 UTC m=+72.804647724" watchObservedRunningTime="2026-07-01 20:47:42.141805355 +0000 UTC m=+72.804879438" Jul 01 20:47:42.161069 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:42.161033 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9xq79" podStartSLOduration=67.088133304 podStartE2EDuration="1m12.16101965s" totalImagesPullingTime="5.072886346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:46:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:42.15992344 +0000 UTC m=+72.822997522" watchObservedRunningTime="2026-07-01 20:47:42.16101965 +0000 UTC m=+72.824093732" Jul 01 20:47:43.226610 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.226578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:43.227024 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.226757 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:43.229088 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.229064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"image-registry-5c86fcdcc5-2hv6m\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:43.229211 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.229070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/554351e4-bd8a-47b2-be1b-6ade48967d13-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-54cb84584-67ft4\" (UID: \"554351e4-bd8a-47b2-be1b-6ade48967d13\") " pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:43.242456 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.242427 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c86fcdcc5-2hv6m"] Jul 01 20:47:43.245038 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.245021 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dgzdr\"" Jul 01 20:47:43.253310 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.253291 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:43.322651 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.322622 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-lcxdx"] Jul 01 20:47:43.326025 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.326004 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-lcxdx" Jul 01 20:47:43.328542 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.328522 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 20:47:43.328644 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.328540 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hfhd2\"" Jul 01 20:47:43.328730 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.328717 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 20:47:43.345106 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.345075 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-lcxdx"] Jul 01 20:47:43.427856 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.427821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:43.427856 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.427857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:43.428050 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.427890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btgpj\" (UniqueName: \"kubernetes.io/projected/83fb83f5-a7d8-486d-b145-5bae328ba014-kube-api-access-btgpj\") pod \"downloads-5499b6fb8f-lcxdx\" (UID: \"83fb83f5-a7d8-486d-b145-5bae328ba014\") " pod="openshift-console/downloads-5499b6fb8f-lcxdx" Jul 01 20:47:43.428439 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.428420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e30d86c-6418-4e88-af26-7934f1156333-service-ca-bundle\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:43.430188 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.430170 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e30d86c-6418-4e88-af26-7934f1156333-metrics-certs\") pod \"router-default-58cfc75779-7flpw\" (UID: \"4e30d86c-6418-4e88-af26-7934f1156333\") " pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:43.432622 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.432596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:43.437249 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.437225 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c86fcdcc5-2hv6m"] Jul 01 20:47:43.442160 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:43.442140 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0890ac18_afbd_49ea_ac63_e904ca9ff494.slice/crio-e399d0be9ed6697553be81c167f1108d50ed59421d61a618f75fb1f664ff967b WatchSource:0}: Error finding container e399d0be9ed6697553be81c167f1108d50ed59421d61a618f75fb1f664ff967b: Status 404 returned error can't find the container with id e399d0be9ed6697553be81c167f1108d50ed59421d61a618f75fb1f664ff967b Jul 01 20:47:43.454765 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.454742 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cf44b5c99-khfv6"] Jul 01 20:47:43.458320 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.458306 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.465578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.465562 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-69ldn\"" Jul 01 20:47:43.468547 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.468530 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:43.482611 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.482592 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tr8vl\"" Jul 01 20:47:43.487875 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.487854 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf44b5c99-khfv6"] Jul 01 20:47:43.489685 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.489664 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.529933 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-installation-pull-secrets\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.529976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-registry-tls\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.530022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-trusted-ca\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.530046 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-image-registry-private-configuration\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.530070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-ca-trust-extracted\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.530090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z4hn\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-kube-api-access-5z4hn\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.530154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-bound-sa-token\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.530176 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgpj\" (UniqueName: \"kubernetes.io/projected/83fb83f5-a7d8-486d-b145-5bae328ba014-kube-api-access-btgpj\") pod \"downloads-5499b6fb8f-lcxdx\" (UID: \"83fb83f5-a7d8-486d-b145-5bae328ba014\") " pod="openshift-console/downloads-5499b6fb8f-lcxdx" Jul 01 20:47:43.530240 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.530197 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-registry-certificates\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.548067 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.548038 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btgpj\" (UniqueName: \"kubernetes.io/projected/83fb83f5-a7d8-486d-b145-5bae328ba014-kube-api-access-btgpj\") pod \"downloads-5499b6fb8f-lcxdx\" (UID: \"83fb83f5-a7d8-486d-b145-5bae328ba014\") " pod="openshift-console/downloads-5499b6fb8f-lcxdx" Jul 01 20:47:43.625864 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.625828 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-58cfc75779-7flpw"] Jul 01 20:47:43.629359 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:43.629331 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e30d86c_6418_4e88_af26_7934f1156333.slice/crio-4d7532ef767790e9d7b16997ee0a31370af4ed4f455e312c81c377d9c59c2731 WatchSource:0}: Error finding container 4d7532ef767790e9d7b16997ee0a31370af4ed4f455e312c81c377d9c59c2731: Status 404 returned error can't find the container with id 4d7532ef767790e9d7b16997ee0a31370af4ed4f455e312c81c377d9c59c2731 Jul 01 20:47:43.630606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.630583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-bound-sa-token\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.630763 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.630636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-registry-certificates\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.630828 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.630800 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:43.630828 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.630816 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-installation-pull-secrets\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.630933 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.630857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-registry-tls\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.630933 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.630917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-trusted-ca\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.631049 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.630964 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-image-registry-private-configuration\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.631049 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.631026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-ca-trust-extracted\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.631205 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.631058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z4hn\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-kube-api-access-5z4hn\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.631426 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.631404 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-registry-certificates\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.631966 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.631863 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-ca-trust-extracted\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.632080 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.631994 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-trusted-ca\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.633384 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.633365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-installation-pull-secrets\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.633606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.633579 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-registry-tls\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.633727 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.633707 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-image-registry-private-configuration\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.637582 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.637559 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-lcxdx" Jul 01 20:47:43.641823 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.641799 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4"] Jul 01 20:47:43.646162 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:43.646138 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod554351e4_bd8a_47b2_be1b_6ade48967d13.slice/crio-6e9c9a0965ee1710ae8e5fc4935ed95ef12a98b55df3c144c1eecc19d6863f2a WatchSource:0}: Error finding container 6e9c9a0965ee1710ae8e5fc4935ed95ef12a98b55df3c144c1eecc19d6863f2a: Status 404 returned error can't find the container with id 6e9c9a0965ee1710ae8e5fc4935ed95ef12a98b55df3c144c1eecc19d6863f2a Jul 01 20:47:43.654271 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.654245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-bound-sa-token\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.659760 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.659699 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z4hn\" (UniqueName: \"kubernetes.io/projected/7ef2ddb0-c830-4bd5-9382-ac8a282d059f-kube-api-access-5z4hn\") pod \"image-registry-6cf44b5c99-khfv6\" (UID: \"7ef2ddb0-c830-4bd5-9382-ac8a282d059f\") " pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.781378 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.781287 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:43.805734 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.805697 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:43.808439 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.808412 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-lcxdx"] Jul 01 20:47:43.811573 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:43.811548 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83fb83f5_a7d8_486d_b145_5bae328ba014.slice/crio-3083cfa3e5797dcdcfec2427356ad024363e45dec6507a4567bcfd03e985efe6 WatchSource:0}: Error finding container 3083cfa3e5797dcdcfec2427356ad024363e45dec6507a4567bcfd03e985efe6: Status 404 returned error can't find the container with id 3083cfa3e5797dcdcfec2427356ad024363e45dec6507a4567bcfd03e985efe6 Jul 01 20:47:43.968081 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.968045 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cf44b5c99-khfv6"] Jul 01 20:47:43.968913 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:43.968887 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:43.971232 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:43.971209 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef2ddb0_c830_4bd5_9382_ac8a282d059f.slice/crio-d55b0be2546af6306c125f3adb85eceeb123fd02961f237a6bc1ea3d40a0930e WatchSource:0}: Error finding container d55b0be2546af6306c125f3adb85eceeb123fd02961f237a6bc1ea3d40a0930e: Status 404 returned error can't find the container with id d55b0be2546af6306c125f3adb85eceeb123fd02961f237a6bc1ea3d40a0930e Jul 01 20:47:44.081668 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.081563 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:44.110362 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.110318 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" event={"ID":"554351e4-bd8a-47b2-be1b-6ade48967d13","Type":"ContainerStarted","Data":"6e9c9a0965ee1710ae8e5fc4935ed95ef12a98b55df3c144c1eecc19d6863f2a"} Jul 01 20:47:44.111829 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.111801 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58cfc75779-7flpw" event={"ID":"4e30d86c-6418-4e88-af26-7934f1156333","Type":"ContainerStarted","Data":"b8fa0d8b1a052d745b932d4c4ebb413aa542c6e146a02fb9130dfb221ea6336f"} Jul 01 20:47:44.111965 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.111849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-58cfc75779-7flpw" event={"ID":"4e30d86c-6418-4e88-af26-7934f1156333","Type":"ContainerStarted","Data":"4d7532ef767790e9d7b16997ee0a31370af4ed4f455e312c81c377d9c59c2731"} Jul 01 20:47:44.113524 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.113476 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" event={"ID":"7ef2ddb0-c830-4bd5-9382-ac8a282d059f","Type":"ContainerStarted","Data":"41e506bc5c30f33d4067d01d1811248a22045332171d14b1a1a0cba7a4122072"} Jul 01 20:47:44.113623 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.113541 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" event={"ID":"7ef2ddb0-c830-4bd5-9382-ac8a282d059f","Type":"ContainerStarted","Data":"d55b0be2546af6306c125f3adb85eceeb123fd02961f237a6bc1ea3d40a0930e"} Jul 01 20:47:44.113623 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.113577 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:47:44.114764 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.114739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-lcxdx" event={"ID":"83fb83f5-a7d8-486d-b145-5bae328ba014","Type":"ContainerStarted","Data":"3083cfa3e5797dcdcfec2427356ad024363e45dec6507a4567bcfd03e985efe6"} Jul 01 20:47:44.116375 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.116354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" event={"ID":"0890ac18-afbd-49ea-ac63-e904ca9ff494","Type":"ContainerStarted","Data":"9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42"} Jul 01 20:47:44.116467 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.116389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" event={"ID":"0890ac18-afbd-49ea-ac63-e904ca9ff494","Type":"ContainerStarted","Data":"e399d0be9ed6697553be81c167f1108d50ed59421d61a618f75fb1f664ff967b"} Jul 01 20:47:44.116536 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.116507 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:47:44.143381 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.143335 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-58cfc75779-7flpw" podStartSLOduration=33.143316992 podStartE2EDuration="33.143316992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:44.142243568 +0000 UTC m=+74.805317687" watchObservedRunningTime="2026-07-01 20:47:44.143316992 +0000 UTC m=+74.806391053" Jul 01 20:47:44.189345 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.189285 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" podStartSLOduration=33.189265331 podStartE2EDuration="33.189265331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:44.185615358 +0000 UTC m=+74.848689438" watchObservedRunningTime="2026-07-01 20:47:44.189265331 +0000 UTC m=+74.852339416" Jul 01 20:47:44.240042 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.239523 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" podStartSLOduration=1.239502936 podStartE2EDuration="1.239502936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:44.233208438 +0000 UTC m=+74.896282547" watchObservedRunningTime="2026-07-01 20:47:44.239502936 +0000 UTC m=+74.902577017" Jul 01 20:47:44.470052 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.469965 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:44.473047 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:44.473017 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:45.121650 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:45.121618 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:45.123275 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:45.123245 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-58cfc75779-7flpw" Jul 01 20:47:45.272710 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:45.272621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:45.376720 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:45.376639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:45.448020 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:45.447975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:45.968813 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:45.968769 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:46.068888 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:46.068807 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:46.127945 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:46.127537 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" event={"ID":"554351e4-bd8a-47b2-be1b-6ade48967d13","Type":"ContainerStarted","Data":"c11cfd5552c1d3c1385f8f81050ddaf5d50d55e1c41eb18819ee5ce6d074b113"} Jul 01 20:47:46.149044 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:46.148988 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-54cb84584-67ft4" podStartSLOduration=33.299709835 podStartE2EDuration="35.148969382s" totalImagesPullingTime="1.849259547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:47:46.147688072 +0000 UTC m=+76.810762177" watchObservedRunningTime="2026-07-01 20:47:46.148969382 +0000 UTC m=+76.812043466" Jul 01 20:47:46.177172 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:46.177132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:46.273013 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:46.272935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:46.509571 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:46.509471 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:46.604606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:46.604510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:47.471911 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.471877 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9c7476d6d-wqg9n"] Jul 01 20:47:47.477888 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.477865 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.480461 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.480441 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 20:47:47.481963 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.481749 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 20:47:47.481963 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.481792 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-86w5c\"" Jul 01 20:47:47.481963 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.481801 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 20:47:47.481963 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.481870 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 20:47:47.482906 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.482540 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 20:47:47.483908 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.483795 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:47.489278 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.489259 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 20:47:47.490578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.490559 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c7476d6d-wqg9n"] Jul 01 20:47:47.557016 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.556986 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:47.565355 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.565327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-trusted-ca-bundle\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.565518 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.565364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-oauth-config\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.565518 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.565402 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-serving-cert\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.565518 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.565510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-service-ca\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.565683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.565589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-config\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.565683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.565634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-oauth-serving-cert\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.565683 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.565665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlrkq\" (UniqueName: \"kubernetes.io/projected/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-kube-api-access-wlrkq\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.666423 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.666383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlrkq\" (UniqueName: \"kubernetes.io/projected/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-kube-api-access-wlrkq\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.666619 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.666450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-trusted-ca-bundle\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.666619 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.666477 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-oauth-config\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.666619 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.666611 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-serving-cert\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.666781 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.666638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-service-ca\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.666781 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.666716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-config\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.666781 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.666742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-oauth-serving-cert\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.667395 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.667371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-oauth-serving-cert\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.667537 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.667502 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-trusted-ca-bundle\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.667618 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.667480 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-service-ca\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.667723 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.667699 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-config\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.669415 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.669392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-oauth-config\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.669575 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.669551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-serving-cert\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.682015 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.681991 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlrkq\" (UniqueName: \"kubernetes.io/projected/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-kube-api-access-wlrkq\") pod \"console-9c7476d6d-wqg9n\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.789203 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.789127 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:47:47.868532 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.868470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:47.871260 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.871234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4449b3ee-b2a4-4082-b4fe-c73f384e3829-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tff4z\" (UID: \"4449b3ee-b2a4-4082-b4fe-c73f384e3829\") " pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:47.881015 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.880993 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vcwf4\"" Jul 01 20:47:47.889113 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.889055 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tff4z" Jul 01 20:47:47.946269 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:47.945781 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9c7476d6d-wqg9n"] Jul 01 20:47:47.950022 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:47.949991 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9463a6d9_bd06_4ea8_888a_7f81aa6650a7.slice/crio-17225e5ddf032b1e9a66a41b096fb592ce6176e225dd27c0f9db7d60276d5a05 WatchSource:0}: Error finding container 17225e5ddf032b1e9a66a41b096fb592ce6176e225dd27c0f9db7d60276d5a05: Status 404 returned error can't find the container with id 17225e5ddf032b1e9a66a41b096fb592ce6176e225dd27c0f9db7d60276d5a05 Jul 01 20:47:48.044171 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:48.044097 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tff4z"] Jul 01 20:47:48.047886 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:47:48.047863 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4449b3ee_b2a4_4082_b4fe_c73f384e3829.slice/crio-7cad3de584d7ba42c080163a9f3d8a3211ac6b268d5755f0ec4ad436b77ceb62 WatchSource:0}: Error finding container 7cad3de584d7ba42c080163a9f3d8a3211ac6b268d5755f0ec4ad436b77ceb62: Status 404 returned error can't find the container with id 7cad3de584d7ba42c080163a9f3d8a3211ac6b268d5755f0ec4ad436b77ceb62 Jul 01 20:47:48.140612 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:48.140567 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tff4z" event={"ID":"4449b3ee-b2a4-4082-b4fe-c73f384e3829","Type":"ContainerStarted","Data":"7cad3de584d7ba42c080163a9f3d8a3211ac6b268d5755f0ec4ad436b77ceb62"} Jul 01 20:47:48.141965 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:48.141933 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c7476d6d-wqg9n" event={"ID":"9463a6d9-bd06-4ea8-888a-7f81aa6650a7","Type":"ContainerStarted","Data":"17225e5ddf032b1e9a66a41b096fb592ce6176e225dd27c0f9db7d60276d5a05"} Jul 01 20:47:52.108984 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:52.108843 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x8sfd" Jul 01 20:47:52.294778 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:52.294643 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:52.357185 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:52.357147 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:52.927699 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:52.927662 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:52.989138 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:52.989101 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:53.221392 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:53.221266 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:53.324156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:53.324124 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:53.925502 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:53.925444 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:54.867754 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:54.867712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:56.047547 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:56.047505 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:58.510308 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.510159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:58.630053 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.630015 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:58.819106 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.819027 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:58.854002 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.853976 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr"] Jul 01 20:47:58.899601 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.899573 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr"] Jul 01 20:47:58.899758 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.899684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:58.903531 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.903507 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 01 20:47:58.903669 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.903556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 01 20:47:58.904351 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.904328 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-j97mm"] Jul 01 20:47:58.904449 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.904334 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 20:47:58.904521 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.904340 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7mlbn\"" Jul 01 20:47:58.922898 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.922879 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:58.928255 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.928234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 01 20:47:58.929182 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.929155 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-h2p4g\"" Jul 01 20:47:58.929458 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.929438 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 01 20:47:58.929458 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.929454 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 01 20:47:58.937472 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.937451 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-j97mm"] Jul 01 20:47:58.965507 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:58.965659 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965536 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59zbh\" (UniqueName: \"kubernetes.io/projected/8e9e0680-ab6e-4e23-bbbb-6158ce897022-kube-api-access-59zbh\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:58.965659 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965583 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e9e0680-ab6e-4e23-bbbb-6158ce897022-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:58.965659 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp985\" (UniqueName: \"kubernetes.io/projected/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-api-access-tp985\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:58.965659 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bdbb885c-77f0-4973-869e-8ce4226ae2b1-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:58.965867 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965667 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdbb885c-77f0-4973-869e-8ce4226ae2b1-metrics-client-ca\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:58.965867 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:58.965867 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965751 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:58.965867 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965784 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e9e0680-ab6e-4e23-bbbb-6158ce897022-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:58.965867 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:58.965839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e9e0680-ab6e-4e23-bbbb-6158ce897022-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.001034 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.001002 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-52xbg"] Jul 01 20:47:59.018049 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.018022 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:59.020936 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.020912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.024210 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.024188 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 20:47:59.024210 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.024204 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 20:47:59.024512 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.024479 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xzbn8\"" Jul 01 20:47:59.024961 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.024940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 20:47:59.066231 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59zbh\" (UniqueName: \"kubernetes.io/projected/8e9e0680-ab6e-4e23-bbbb-6158ce897022-kube-api-access-59zbh\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.066231 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-sys\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.066427 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e9e0680-ab6e-4e23-bbbb-6158ce897022-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.066427 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066290 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-textfile\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.066427 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.066427 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066347 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp985\" (UniqueName: \"kubernetes.io/projected/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-api-access-tp985\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.066427 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-root\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.066427 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066397 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bdbb885c-77f0-4973-869e-8ce4226ae2b1-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.066427 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdbb885c-77f0-4973-869e-8ce4226ae2b1-metrics-client-ca\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.066776 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-accelerators-collector-config\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.066776 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-tls\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.066776 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.066776 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.066969 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e9e0680-ab6e-4e23-bbbb-6158ce897022-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.067035 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.066971 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bdbb885c-77f0-4973-869e-8ce4226ae2b1-volume-directive-shadow\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.067096 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.067042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-wtmp\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.068176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.067194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e9e0680-ab6e-4e23-bbbb-6158ce897022-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.068176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.067241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5217c598-572f-4edf-aa19-390a6761dfa5-metrics-client-ca\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.068176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.067271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8fz5\" (UniqueName: \"kubernetes.io/projected/5217c598-572f-4edf-aa19-390a6761dfa5-kube-api-access-d8fz5\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.068176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.067306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.068176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.067323 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bdbb885c-77f0-4973-869e-8ce4226ae2b1-metrics-client-ca\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.068176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.067353 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.068176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.068134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e9e0680-ab6e-4e23-bbbb-6158ce897022-metrics-client-ca\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.069655 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.069604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8e9e0680-ab6e-4e23-bbbb-6158ce897022-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.069757 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.069669 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8e9e0680-ab6e-4e23-bbbb-6158ce897022-openshift-state-metrics-tls\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.069757 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.069704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-tls\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.069934 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.069909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.080555 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.080530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59zbh\" (UniqueName: \"kubernetes.io/projected/8e9e0680-ab6e-4e23-bbbb-6158ce897022-kube-api-access-59zbh\") pod \"openshift-state-metrics-57f99c8b49-tr7wr\" (UID: \"8e9e0680-ab6e-4e23-bbbb-6158ce897022\") " pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.080754 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.080734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp985\" (UniqueName: \"kubernetes.io/projected/bdbb885c-77f0-4973-869e-8ce4226ae2b1-kube-api-access-tp985\") pod \"kube-state-metrics-845b954455-j97mm\" (UID: \"bdbb885c-77f0-4973-869e-8ce4226ae2b1\") " pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.117032 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.116972 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:59.167931 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.167902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5217c598-572f-4edf-aa19-390a6761dfa5-metrics-client-ca\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168076 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.167935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8fz5\" (UniqueName: \"kubernetes.io/projected/5217c598-572f-4edf-aa19-390a6761dfa5-kube-api-access-d8fz5\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168076 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.167974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-sys\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168076 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-textfile\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168076 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168076 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-root\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168076 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-accelerators-collector-config\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-sys\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168241 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-root\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-tls\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168360 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-wtmp\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:59.168443 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:47:59.168514 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-tls podName:5217c598-572f-4edf-aa19-390a6761dfa5 nodeName:}" failed. No retries permitted until 2026-07-01 20:47:59.668479541 +0000 UTC m=+90.331553604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-tls") pod "node-exporter-52xbg" (UID: "5217c598-572f-4edf-aa19-390a6761dfa5") : secret "node-exporter-tls" not found Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168559 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-wtmp\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5217c598-572f-4edf-aa19-390a6761dfa5-metrics-client-ca\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.168613 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168611 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-accelerators-collector-config\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.169261 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.168966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-textfile\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.171303 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.171219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.186156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.186136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8fz5\" (UniqueName: \"kubernetes.io/projected/5217c598-572f-4edf-aa19-390a6761dfa5-kube-api-access-d8fz5\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.210952 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.210929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" Jul 01 20:47:59.218354 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.218329 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:59.233206 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.233184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" Jul 01 20:47:59.383818 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.383740 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:59.485255 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.485167 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:59.615812 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.615752 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:59.674216 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.674192 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-tls\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.677074 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.677046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5217c598-572f-4edf-aa19-390a6761dfa5-node-exporter-tls\") pod \"node-exporter-52xbg\" (UID: \"5217c598-572f-4edf-aa19-390a6761dfa5\") " pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:47:59.797434 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.797324 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:47:59.931334 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:47:59.931249 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-52xbg" Jul 01 20:48:00.004334 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:00.004301 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:00.289426 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:00.289348 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:00.435480 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:00.435443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:01.180861 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.180833 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8"] Jul 01 20:48:01.199538 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.199516 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.210452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.209175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 01 20:48:01.210452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.209215 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 01 20:48:01.210452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.209572 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-q5vbz\"" Jul 01 20:48:01.210452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.209932 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 01 20:48:01.210452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.210195 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 01 20:48:01.211072 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.211055 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 01 20:48:01.211173 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.211084 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-acu2jrcm6n8es\"" Jul 01 20:48:01.231248 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.231229 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8"] Jul 01 20:48:01.288124 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.288100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.288261 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.288138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.288261 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.288165 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-tls\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.288261 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.288189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmrk7\" (UniqueName: \"kubernetes.io/projected/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-kube-api-access-wmrk7\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.288437 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.288267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.288437 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.288296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-grpc-tls\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.288437 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.288318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.288437 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.288373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-metrics-client-ca\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.389500 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.389449 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-metrics-client-ca\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.389644 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.389510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.389644 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.389567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.389644 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.389612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-tls\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.389644 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.389637 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmrk7\" (UniqueName: \"kubernetes.io/projected/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-kube-api-access-wmrk7\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.389803 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.389690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.389803 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.389719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-grpc-tls\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.389803 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.389749 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.390251 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.390201 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-metrics-client-ca\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.392433 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.392399 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.392578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.392450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-grpc-tls\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.392735 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.392714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.392817 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.392798 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.393147 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.393130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-tls\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.393226 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.393204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.403331 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.403305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmrk7\" (UniqueName: \"kubernetes.io/projected/84fc2d6e-68cf-48b3-a6e6-01eb25a2582f-kube-api-access-wmrk7\") pod \"thanos-querier-6cd4cc8769-k5gf8\" (UID: \"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f\") " pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.513954 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.513586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:01.613837 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.613657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:01.706285 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.706221 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr"] Jul 01 20:48:01.718506 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:48:01.718459 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e9e0680_ab6e_4e23_bbbb_6158ce897022.slice/crio-654941d47d2895186597a3d6fb61b34cd8125c49c9403d5600994da4c08cb4f4 WatchSource:0}: Error finding container 654941d47d2895186597a3d6fb61b34cd8125c49c9403d5600994da4c08cb4f4: Status 404 returned error can't find the container with id 654941d47d2895186597a3d6fb61b34cd8125c49c9403d5600994da4c08cb4f4 Jul 01 20:48:01.743675 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.743648 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-845b954455-j97mm"] Jul 01 20:48:01.745628 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:48:01.745605 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdbb885c_77f0_4973_869e_8ce4226ae2b1.slice/crio-74044440967d489df5b050317e7a6f7796204bc3ee832a57164d6a54a89b51a1 WatchSource:0}: Error finding container 74044440967d489df5b050317e7a6f7796204bc3ee832a57164d6a54a89b51a1: Status 404 returned error can't find the container with id 74044440967d489df5b050317e7a6f7796204bc3ee832a57164d6a54a89b51a1 Jul 01 20:48:01.753996 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.752979 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8"] Jul 01 20:48:01.754209 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:48:01.754138 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84fc2d6e_68cf_48b3_a6e6_01eb25a2582f.slice/crio-75ce2b231eaeab95eee5e8ae449f2197284acdcaedf3c1f95af62faf21ddebf1 WatchSource:0}: Error finding container 75ce2b231eaeab95eee5e8ae449f2197284acdcaedf3c1f95af62faf21ddebf1: Status 404 returned error can't find the container with id 75ce2b231eaeab95eee5e8ae449f2197284acdcaedf3c1f95af62faf21ddebf1 Jul 01 20:48:01.897788 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:01.897756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:02.153919 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.153819 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:02.207770 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.207190 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tff4z" event={"ID":"4449b3ee-b2a4-4082-b4fe-c73f384e3829","Type":"ContainerStarted","Data":"5c897fe0d1e85b32c8a0b70d42dd670ede2216f7cb5cf03d21e78883e6acbe22"} Jul 01 20:48:02.212913 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.212219 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c7476d6d-wqg9n" event={"ID":"9463a6d9-bd06-4ea8-888a-7f81aa6650a7","Type":"ContainerStarted","Data":"d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba"} Jul 01 20:48:02.214799 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.214771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" event={"ID":"bdbb885c-77f0-4973-869e-8ce4226ae2b1","Type":"ContainerStarted","Data":"74044440967d489df5b050317e7a6f7796204bc3ee832a57164d6a54a89b51a1"} Jul 01 20:48:02.216304 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.216258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" event={"ID":"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f","Type":"ContainerStarted","Data":"75ce2b231eaeab95eee5e8ae449f2197284acdcaedf3c1f95af62faf21ddebf1"} Jul 01 20:48:02.220807 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.220766 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-lcxdx" event={"ID":"83fb83f5-a7d8-486d-b145-5bae328ba014","Type":"ContainerStarted","Data":"78bd05734c6c4bee07767b0e330b9f2c441bb62b9a3f986e5efaf205700ade62"} Jul 01 20:48:02.222577 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.222520 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-lcxdx" Jul 01 20:48:02.226547 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.226394 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" event={"ID":"8e9e0680-ab6e-4e23-bbbb-6158ce897022","Type":"ContainerStarted","Data":"2c774582fabf522cb72e89ded0d2af5df3769bc1a8df09d8d2a237a929ab6c72"} Jul 01 20:48:02.226547 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.226450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" event={"ID":"8e9e0680-ab6e-4e23-bbbb-6158ce897022","Type":"ContainerStarted","Data":"b7ca784bcb18df1f699f0ba9925696240ea15e385d0d62638f811d7b0d56231f"} Jul 01 20:48:02.226547 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.226477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" event={"ID":"8e9e0680-ab6e-4e23-bbbb-6158ce897022","Type":"ContainerStarted","Data":"654941d47d2895186597a3d6fb61b34cd8125c49c9403d5600994da4c08cb4f4"} Jul 01 20:48:02.228139 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.228083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52xbg" event={"ID":"5217c598-572f-4edf-aa19-390a6761dfa5","Type":"ContainerStarted","Data":"59a8599285165f55d56feffda41df45fa72061d07f09fe8bc65d8fb31f3a699c"} Jul 01 20:48:02.230665 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.230622 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-lcxdx" Jul 01 20:48:02.316348 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.316287 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9c7476d6d-wqg9n" podStartSLOduration=1.8210414639999999 podStartE2EDuration="15.31626285s" totalImagesPullingTime="13.495221386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:02.251834816 +0000 UTC m=+92.914908885" watchObservedRunningTime="2026-07-01 20:48:02.31626285 +0000 UTC m=+92.979336938" Jul 01 20:48:02.316733 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.316689 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-lcxdx" podStartSLOduration=1.627210145 podStartE2EDuration="19.316675726s" totalImagesPullingTime="17.689465581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:02.31520463 +0000 UTC m=+92.978278738" watchObservedRunningTime="2026-07-01 20:48:02.316675726 +0000 UTC m=+92.979749812" Jul 01 20:48:02.372820 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.372790 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:02.600052 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.599959 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:02.805800 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:02.805751 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:03.626239 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:03.626092 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:03.823278 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:03.823198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:03.972129 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:03.972092 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:04.125793 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:04.125479 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:48:04.247524 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:04.246762 2562 generic.go:356] "Generic (PLEG): container finished" podID="5217c598-572f-4edf-aa19-390a6761dfa5" containerID="09a156e8e8d779bfea06be1e28273ae4f378c36653715dfa9cb5ce63c28687bd" exitCode=0 Jul 01 20:48:04.247699 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:04.247587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52xbg" event={"ID":"5217c598-572f-4edf-aa19-390a6761dfa5","Type":"ContainerDied","Data":"09a156e8e8d779bfea06be1e28273ae4f378c36653715dfa9cb5ce63c28687bd"} Jul 01 20:48:04.254787 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:04.254716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tff4z" event={"ID":"4449b3ee-b2a4-4082-b4fe-c73f384e3829","Type":"ContainerStarted","Data":"24a01ae7c7e616fd8d3fd3627565403ca1dd514bafa4e55e3e1607e9c9086a57"} Jul 01 20:48:04.919921 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:04.919856 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9c7476d6d-wqg9n"] Jul 01 20:48:04.945558 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:04.945191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:04.982066 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:04.982037 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86dbdc7fc8-kg7s4"] Jul 01 20:48:05.005699 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.005674 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.021593 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.021555 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86dbdc7fc8-kg7s4"] Jul 01 20:48:05.033275 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.033242 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-serving-cert\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.033406 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.033286 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-console-config\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.033406 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.033347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-oauth-config\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.033549 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.033389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-trusted-ca-bundle\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.033549 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.033443 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-oauth-serving-cert\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.033660 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.033564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-service-ca\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.033660 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.033593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/85daacb3-1ccf-43a1-8a96-990eca864547-kube-api-access-xgsz8\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.100052 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.100023 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:05.129322 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.128774 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6cf44b5c99-khfv6" Jul 01 20:48:05.135455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.135051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-serving-cert\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.135455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.135087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-console-config\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.135455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.135117 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-oauth-config\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.135455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.135144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-trusted-ca-bundle\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.135455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.135172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-oauth-serving-cert\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.135455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.135229 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-service-ca\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.135455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.135252 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/85daacb3-1ccf-43a1-8a96-990eca864547-kube-api-access-xgsz8\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.136870 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.136847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-trusted-ca-bundle\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.137210 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.137188 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-console-config\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.137628 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.137364 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-oauth-serving-cert\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.138222 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.137759 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-service-ca\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.139725 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.139705 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-oauth-config\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.140476 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.140457 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-serving-cert\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.148430 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.148388 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/85daacb3-1ccf-43a1-8a96-990eca864547-kube-api-access-xgsz8\") pod \"console-86dbdc7fc8-kg7s4\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.320435 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.320146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:05.416253 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.416214 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:05.613466 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.613384 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:05.834587 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:05.834284 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:06.495561 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:06.495530 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86dbdc7fc8-kg7s4"] Jul 01 20:48:07.274618 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:07.274578 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52xbg" event={"ID":"5217c598-572f-4edf-aa19-390a6761dfa5","Type":"ContainerStarted","Data":"dce0ea4a354d31cb51fcd23d9cf19d003a81ce83b139e33f3f295ae47ea4bd78"} Jul 01 20:48:07.657363 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:07.657282 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:07.757974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:07.757941 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:07.789980 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:07.789920 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:48:08.285444 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.285166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-52xbg" event={"ID":"5217c598-572f-4edf-aa19-390a6761dfa5","Type":"ContainerStarted","Data":"bccc3e3ba22a87d531f7817dcd5f6ed5619cac99c059a177f7b8eef51ef8aeeb"} Jul 01 20:48:08.288396 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.287796 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" event={"ID":"bdbb885c-77f0-4973-869e-8ce4226ae2b1","Type":"ContainerStarted","Data":"3374e3c2ae3886550d185b8a56b4b863611287361ad7a327c9b3ce9e1d89ad80"} Jul 01 20:48:08.293408 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.293329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" event={"ID":"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f","Type":"ContainerStarted","Data":"521327b82eadc8ca754babd001902086341fd15b90432b46df1f9cb80d23f1a0"} Jul 01 20:48:08.297919 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.296919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dbdc7fc8-kg7s4" event={"ID":"85daacb3-1ccf-43a1-8a96-990eca864547","Type":"ContainerStarted","Data":"0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f"} Jul 01 20:48:08.297919 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.296961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dbdc7fc8-kg7s4" event={"ID":"85daacb3-1ccf-43a1-8a96-990eca864547","Type":"ContainerStarted","Data":"b00095f3913b410c8d4a41836b530c0dfbc8099b878b31cf2c2229735dfa55f6"} Jul 01 20:48:08.301591 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.300947 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" event={"ID":"8e9e0680-ab6e-4e23-bbbb-6158ce897022","Type":"ContainerStarted","Data":"b5875893fb36b379f28665114e7850749fa49ca07a31b26d5e1f57c22d60d09d"} Jul 01 20:48:08.331470 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.330902 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-52xbg" podStartSLOduration=8.543289711 podStartE2EDuration="10.33088044s" totalImagesPullingTime="1.651372002s" totalInitContainerRuntime="136.218727ms" isStatefulPod=true podCreationTimestamp="2026-07-01 20:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:08.328713105 +0000 UTC m=+98.991787239" watchObservedRunningTime="2026-07-01 20:48:08.33088044 +0000 UTC m=+98.993954525" Jul 01 20:48:08.358947 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.357310 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86dbdc7fc8-kg7s4" podStartSLOduration=4.3572883749999995 podStartE2EDuration="4.357288375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:48:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:08.356335587 +0000 UTC m=+99.019409878" watchObservedRunningTime="2026-07-01 20:48:08.357288375 +0000 UTC m=+99.020362458" Jul 01 20:48:08.404147 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:08.404091 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-57f99c8b49-tr7wr" podStartSLOduration=5.9260936730000005 podStartE2EDuration="10.40407124s" totalImagesPullingTime="4.477977567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:08.399567976 +0000 UTC m=+99.062642056" watchObservedRunningTime="2026-07-01 20:48:08.40407124 +0000 UTC m=+99.067145324" Jul 01 20:48:09.136424 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.136373 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" podUID="0890ac18-afbd-49ea-ac63-e904ca9ff494" containerName="registry" containerID="cri-o://9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42" gracePeriod=30 Jul 01 20:48:09.188920 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.188886 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:09.289473 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.289398 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86dbdc7fc8-kg7s4"] Jul 01 20:48:09.289899 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.289864 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:09.308881 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.308851 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tff4z" event={"ID":"4449b3ee-b2a4-4082-b4fe-c73f384e3829","Type":"ContainerStarted","Data":"bd4e2cda59be38e7bb7bd436a96605760ae13e780a74b6670a88728916aa0b97"} Jul 01 20:48:09.311374 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.311336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" event={"ID":"bdbb885c-77f0-4973-869e-8ce4226ae2b1","Type":"ContainerStarted","Data":"26b11fdb4fe910ba46510991d0779e3324e4986fb6948a63ae616055ac11a9a2"} Jul 01 20:48:09.311560 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.311401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" event={"ID":"bdbb885c-77f0-4973-869e-8ce4226ae2b1","Type":"ContainerStarted","Data":"22ebac88e4f1fb3560786d0d10417871f12efdb068b92306fb884c57ebe04142"} Jul 01 20:48:09.313924 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.313899 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" event={"ID":"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f","Type":"ContainerStarted","Data":"3514476686e67fa9da047926eabc5295dd5ab251d2b824439f8d2df247d7f90e"} Jul 01 20:48:09.314020 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.313972 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" event={"ID":"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f","Type":"ContainerStarted","Data":"82f9923c92f59a999962f211b7738e310bbfe575a91f5312b47b52ae6823a15a"} Jul 01 20:48:09.328396 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.328371 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69568c74b6-k5cgq"] Jul 01 20:48:09.334553 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.334472 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tff4z" podStartSLOduration=33.477996134 podStartE2EDuration="53.334455786s" totalImagesPullingTime="19.856459652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 20:47:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:09.333008513 +0000 UTC m=+99.996082621" watchObservedRunningTime="2026-07-01 20:48:09.334455786 +0000 UTC m=+99.997529870" Jul 01 20:48:09.351958 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.351932 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69568c74b6-k5cgq"] Jul 01 20:48:09.352096 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.352075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.398524 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.398458 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-845b954455-j97mm" podStartSLOduration=6.819352617 podStartE2EDuration="11.398436901s" totalImagesPullingTime="4.579084284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:47:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:09.365692782 +0000 UTC m=+100.028766876" watchObservedRunningTime="2026-07-01 20:48:09.398436901 +0000 UTC m=+100.061510986" Jul 01 20:48:09.475817 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.475785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-service-ca\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.475971 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.475851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-oauth-config\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.475971 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.475883 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-serving-cert\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.475971 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.475905 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-oauth-serving-cert\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.475971 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.475932 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c58p7\" (UniqueName: \"kubernetes.io/projected/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-kube-api-access-c58p7\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.476176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.476013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-trusted-ca-bundle\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.476176 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.476055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-config\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.517082 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.517047 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:48:09.577156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577105 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") pod \"0890ac18-afbd-49ea-ac63-e904ca9ff494\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " Jul 01 20:48:09.577156 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577149 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-installation-pull-secrets\") pod \"0890ac18-afbd-49ea-ac63-e904ca9ff494\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " Jul 01 20:48:09.577332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577180 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-certificates\") pod \"0890ac18-afbd-49ea-ac63-e904ca9ff494\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " Jul 01 20:48:09.577332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577224 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2tfz\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-kube-api-access-n2tfz\") pod \"0890ac18-afbd-49ea-ac63-e904ca9ff494\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " Jul 01 20:48:09.577332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577259 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-image-registry-private-configuration\") pod \"0890ac18-afbd-49ea-ac63-e904ca9ff494\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " Jul 01 20:48:09.577332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577284 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-trusted-ca\") pod \"0890ac18-afbd-49ea-ac63-e904ca9ff494\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " Jul 01 20:48:09.577332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577315 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-bound-sa-token\") pod \"0890ac18-afbd-49ea-ac63-e904ca9ff494\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " Jul 01 20:48:09.577610 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577353 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0890ac18-afbd-49ea-ac63-e904ca9ff494-ca-trust-extracted\") pod \"0890ac18-afbd-49ea-ac63-e904ca9ff494\" (UID: \"0890ac18-afbd-49ea-ac63-e904ca9ff494\") " Jul 01 20:48:09.577610 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577516 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0890ac18-afbd-49ea-ac63-e904ca9ff494" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:09.577610 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-service-ca\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.577610 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-oauth-config\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.577817 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-serving-cert\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.577817 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-oauth-serving-cert\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.577817 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c58p7\" (UniqueName: \"kubernetes.io/projected/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-kube-api-access-c58p7\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.577817 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-trusted-ca-bundle\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.577817 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-config\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.578056 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577887 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-certificates\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:09.578056 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.577967 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0890ac18-afbd-49ea-ac63-e904ca9ff494" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:09.578998 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.578850 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-service-ca\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.580165 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.580034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-config\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.580741 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.580718 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-trusted-ca-bundle\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.581110 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.580978 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0890ac18-afbd-49ea-ac63-e904ca9ff494" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:48:09.581110 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.581074 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0890ac18-afbd-49ea-ac63-e904ca9ff494" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:48:09.581501 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.581422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-serving-cert\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.581675 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.581654 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-oauth-serving-cert\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.583144 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.583117 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-oauth-config\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.583237 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.583201 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-kube-api-access-n2tfz" (OuterVolumeSpecName: "kube-api-access-n2tfz") pod "0890ac18-afbd-49ea-ac63-e904ca9ff494" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494"). InnerVolumeSpecName "kube-api-access-n2tfz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:48:09.584657 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.584580 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0890ac18-afbd-49ea-ac63-e904ca9ff494" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:48:09.585042 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.585015 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0890ac18-afbd-49ea-ac63-e904ca9ff494" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:48:09.591550 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.591524 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0890ac18-afbd-49ea-ac63-e904ca9ff494-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0890ac18-afbd-49ea-ac63-e904ca9ff494" (UID: "0890ac18-afbd-49ea-ac63-e904ca9ff494"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 20:48:09.626329 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.626299 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c58p7\" (UniqueName: \"kubernetes.io/projected/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-kube-api-access-c58p7\") pod \"console-69568c74b6-k5cgq\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.664388 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.664359 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:09.678782 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.678755 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-registry-tls\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:09.678782 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.678785 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-installation-pull-secrets\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:09.678916 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.678795 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2tfz\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-kube-api-access-n2tfz\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:09.678916 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.678804 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0890ac18-afbd-49ea-ac63-e904ca9ff494-image-registry-private-configuration\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:09.678916 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.678813 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0890ac18-afbd-49ea-ac63-e904ca9ff494-trusted-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:09.678916 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.678826 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0890ac18-afbd-49ea-ac63-e904ca9ff494-bound-sa-token\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:09.678916 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.678839 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0890ac18-afbd-49ea-ac63-e904ca9ff494-ca-trust-extracted\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:09.854408 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.854372 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:09.920502 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:48:09.920460 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c1cd3ce_d85c_424f_ab92_ba4226a0e784.slice/crio-57b4fc24aff75eea764df87ae9eb1a2c587dc4a8459cd7845507caca15dc9fb8 WatchSource:0}: Error finding container 57b4fc24aff75eea764df87ae9eb1a2c587dc4a8459cd7845507caca15dc9fb8: Status 404 returned error can't find the container with id 57b4fc24aff75eea764df87ae9eb1a2c587dc4a8459cd7845507caca15dc9fb8 Jul 01 20:48:09.923161 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.923074 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69568c74b6-k5cgq"] Jul 01 20:48:09.955235 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:09.955122 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:10.320534 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.320472 2562 generic.go:356] "Generic (PLEG): container finished" podID="0890ac18-afbd-49ea-ac63-e904ca9ff494" containerID="9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42" exitCode=0 Jul 01 20:48:10.320974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.320543 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" Jul 01 20:48:10.320974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.320556 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" event={"ID":"0890ac18-afbd-49ea-ac63-e904ca9ff494","Type":"ContainerDied","Data":"9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42"} Jul 01 20:48:10.320974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.320651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c86fcdcc5-2hv6m" event={"ID":"0890ac18-afbd-49ea-ac63-e904ca9ff494","Type":"ContainerDied","Data":"e399d0be9ed6697553be81c167f1108d50ed59421d61a618f75fb1f664ff967b"} Jul 01 20:48:10.320974 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.320684 2562 scope.go:117] "RemoveContainer" containerID="9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42" Jul 01 20:48:10.323458 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.323430 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69568c74b6-k5cgq" event={"ID":"3c1cd3ce-d85c-424f-ab92-ba4226a0e784","Type":"ContainerStarted","Data":"014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611"} Jul 01 20:48:10.323590 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.323478 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69568c74b6-k5cgq" event={"ID":"3c1cd3ce-d85c-424f-ab92-ba4226a0e784","Type":"ContainerStarted","Data":"57b4fc24aff75eea764df87ae9eb1a2c587dc4a8459cd7845507caca15dc9fb8"} Jul 01 20:48:10.327362 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.327336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" event={"ID":"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f","Type":"ContainerStarted","Data":"97a1ce32160687b8e90b4055afbe67fa0d91007edb0c71f411119b77af186a66"} Jul 01 20:48:10.327505 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.327426 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:10.327505 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.327466 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" event={"ID":"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f","Type":"ContainerStarted","Data":"f1f87c19541a6b7f6d311337f809c453e4ae0829f641f395b1cff28197b9cf72"} Jul 01 20:48:10.327633 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.327520 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" event={"ID":"84fc2d6e-68cf-48b3-a6e6-01eb25a2582f","Type":"ContainerStarted","Data":"ce7ba06fe7c8565b8cb7eb6b0aab66b5d6121a50e9b0d978316f50bc244dc61f"} Jul 01 20:48:10.331710 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.331648 2562 scope.go:117] "RemoveContainer" containerID="9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42" Jul 01 20:48:10.332962 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:48:10.332164 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42\": container with ID starting with 9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42 not found: ID does not exist" containerID="9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42" Jul 01 20:48:10.332962 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.332200 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42"} err="failed to get container status \"9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42\": rpc error: code = NotFound desc = could not find container \"9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42\": container with ID starting with 9d2662dadbdb92e931a8544a6b5e275854e77d8a90520a22571c467dd99cfa42 not found: ID does not exist" Jul 01 20:48:10.353766 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.353705 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69568c74b6-k5cgq" podStartSLOduration=1.353693175 podStartE2EDuration="1.353693175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:48:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:10.352456819 +0000 UTC m=+101.015530918" watchObservedRunningTime="2026-07-01 20:48:10.353693175 +0000 UTC m=+101.016767257" Jul 01 20:48:10.374286 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.374264 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c86fcdcc5-2hv6m"] Jul 01 20:48:10.377580 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.377560 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c86fcdcc5-2hv6m"] Jul 01 20:48:10.407708 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.407669 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" podStartSLOduration=3.541213853 podStartE2EDuration="9.407652269s" totalImagesPullingTime="5.866438416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:48:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:48:10.406459084 +0000 UTC m=+101.069533190" watchObservedRunningTime="2026-07-01 20:48:10.407652269 +0000 UTC m=+101.070726378" Jul 01 20:48:10.528382 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:10.528352 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:11.799016 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:11.798987 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0890ac18-afbd-49ea-ac63-e904ca9ff494" path="/var/lib/kubelet/pods/0890ac18-afbd-49ea-ac63-e904ca9ff494/volumes" Jul 01 20:48:13.108498 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:13.108467 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9xq79" Jul 01 20:48:15.133135 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:15.133100 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:15.233887 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:15.233827 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:15.320446 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:15.320417 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:16.340022 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:16.339993 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6cd4cc8769-k5gf8" Jul 01 20:48:18.439587 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:18.439557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:18.541966 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:18.541939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:19.665311 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:19.665280 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:19.665799 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:19.665359 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:19.670053 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:19.670033 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:20.373959 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:20.373934 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:48:20.530479 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:20.530449 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:20.632568 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:20.632437 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:20.690370 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:20.690342 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:24.134201 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:24.134167 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:24.186308 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:24.186280 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:29.949892 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:29.949835 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-9c7476d6d-wqg9n" podUID="9463a6d9-bd06-4ea8-888a-7f81aa6650a7" containerName="console" containerID="cri-o://d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba" gracePeriod=15 Jul 01 20:48:30.184831 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.184810 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:48:30.327713 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.327631 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-trusted-ca-bundle\") pod \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " Jul 01 20:48:30.327713 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.327681 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-serving-cert\") pod \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " Jul 01 20:48:30.327713 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.327707 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-oauth-serving-cert\") pod \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " Jul 01 20:48:30.327977 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.327822 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-config\") pod \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " Jul 01 20:48:30.327977 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.327858 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-oauth-config\") pod \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " Jul 01 20:48:30.327977 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.327881 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-service-ca\") pod \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " Jul 01 20:48:30.328119 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.327995 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlrkq\" (UniqueName: \"kubernetes.io/projected/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-kube-api-access-wlrkq\") pod \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\" (UID: \"9463a6d9-bd06-4ea8-888a-7f81aa6650a7\") " Jul 01 20:48:30.328174 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.328138 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9463a6d9-bd06-4ea8-888a-7f81aa6650a7" (UID: "9463a6d9-bd06-4ea8-888a-7f81aa6650a7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:30.328233 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.328197 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-service-ca" (OuterVolumeSpecName: "service-ca") pod "9463a6d9-bd06-4ea8-888a-7f81aa6650a7" (UID: "9463a6d9-bd06-4ea8-888a-7f81aa6650a7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:30.328233 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.328146 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9463a6d9-bd06-4ea8-888a-7f81aa6650a7" (UID: "9463a6d9-bd06-4ea8-888a-7f81aa6650a7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:30.328314 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.328232 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-config" (OuterVolumeSpecName: "console-config") pod "9463a6d9-bd06-4ea8-888a-7f81aa6650a7" (UID: "9463a6d9-bd06-4ea8-888a-7f81aa6650a7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:30.328314 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.328266 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-oauth-serving-cert\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:30.328314 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.328285 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:30.328314 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.328299 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-trusted-ca-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:30.330126 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.330101 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9463a6d9-bd06-4ea8-888a-7f81aa6650a7" (UID: "9463a6d9-bd06-4ea8-888a-7f81aa6650a7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:48:30.330227 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.330155 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9463a6d9-bd06-4ea8-888a-7f81aa6650a7" (UID: "9463a6d9-bd06-4ea8-888a-7f81aa6650a7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:48:30.330227 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.330179 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-kube-api-access-wlrkq" (OuterVolumeSpecName: "kube-api-access-wlrkq") pod "9463a6d9-bd06-4ea8-888a-7f81aa6650a7" (UID: "9463a6d9-bd06-4ea8-888a-7f81aa6650a7"). InnerVolumeSpecName "kube-api-access-wlrkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:48:30.408428 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.408400 2562 generic.go:356] "Generic (PLEG): container finished" podID="9463a6d9-bd06-4ea8-888a-7f81aa6650a7" containerID="d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba" exitCode=0 Jul 01 20:48:30.408567 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.408449 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9c7476d6d-wqg9n" Jul 01 20:48:30.408567 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.408451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c7476d6d-wqg9n" event={"ID":"9463a6d9-bd06-4ea8-888a-7f81aa6650a7","Type":"ContainerDied","Data":"d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba"} Jul 01 20:48:30.408642 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.408574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9c7476d6d-wqg9n" event={"ID":"9463a6d9-bd06-4ea8-888a-7f81aa6650a7","Type":"ContainerDied","Data":"17225e5ddf032b1e9a66a41b096fb592ce6176e225dd27c0f9db7d60276d5a05"} Jul 01 20:48:30.408642 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.408599 2562 scope.go:117] "RemoveContainer" containerID="d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba" Jul 01 20:48:30.418454 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.418425 2562 scope.go:117] "RemoveContainer" containerID="d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba" Jul 01 20:48:30.418949 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:48:30.418919 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba\": container with ID starting with d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba not found: ID does not exist" containerID="d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba" Jul 01 20:48:30.419040 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.418958 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba"} err="failed to get container status \"d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba\": rpc error: code = NotFound desc = could not find container \"d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba\": container with ID starting with d1ded5466da0cbe06e6cc0a882f0e55e2e48889587ae098e4ef569ff7059d4ba not found: ID does not exist" Jul 01 20:48:30.428872 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.428852 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-serving-cert\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:30.428872 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.428869 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:30.428988 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.428879 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-console-oauth-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:30.428988 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.428887 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlrkq\" (UniqueName: \"kubernetes.io/projected/9463a6d9-bd06-4ea8-888a-7f81aa6650a7-kube-api-access-wlrkq\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:30.433431 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.433409 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9c7476d6d-wqg9n"] Jul 01 20:48:30.437087 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:30.437059 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9c7476d6d-wqg9n"] Jul 01 20:48:31.798084 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:31.798048 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9463a6d9-bd06-4ea8-888a-7f81aa6650a7" path="/var/lib/kubelet/pods/9463a6d9-bd06-4ea8-888a-7f81aa6650a7/volumes" Jul 01 20:48:34.146455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:34.146424 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:34.247202 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:34.247170 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:34.303340 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:34.303312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:35.039609 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.039574 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:35.348169 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.348085 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86dbdc7fc8-kg7s4" podUID="85daacb3-1ccf-43a1-8a96-990eca864547" containerName="console" containerID="cri-o://0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f" gracePeriod=15 Jul 01 20:48:35.625759 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.625695 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:35.768612 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.768585 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-serving-cert\") pod \"85daacb3-1ccf-43a1-8a96-990eca864547\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " Jul 01 20:48:35.768737 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.768616 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-service-ca\") pod \"85daacb3-1ccf-43a1-8a96-990eca864547\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " Jul 01 20:48:35.768737 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.768643 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/85daacb3-1ccf-43a1-8a96-990eca864547-kube-api-access-xgsz8\") pod \"85daacb3-1ccf-43a1-8a96-990eca864547\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " Jul 01 20:48:35.768737 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.768666 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-console-config\") pod \"85daacb3-1ccf-43a1-8a96-990eca864547\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " Jul 01 20:48:35.768737 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.768680 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-trusted-ca-bundle\") pod \"85daacb3-1ccf-43a1-8a96-990eca864547\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " Jul 01 20:48:35.768891 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.768850 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-oauth-config\") pod \"85daacb3-1ccf-43a1-8a96-990eca864547\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " Jul 01 20:48:35.768943 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.768889 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-oauth-serving-cert\") pod \"85daacb3-1ccf-43a1-8a96-990eca864547\" (UID: \"85daacb3-1ccf-43a1-8a96-990eca864547\") " Jul 01 20:48:35.769026 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.769004 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-service-ca" (OuterVolumeSpecName: "service-ca") pod "85daacb3-1ccf-43a1-8a96-990eca864547" (UID: "85daacb3-1ccf-43a1-8a96-990eca864547"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:35.769091 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.769064 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-console-config" (OuterVolumeSpecName: "console-config") pod "85daacb3-1ccf-43a1-8a96-990eca864547" (UID: "85daacb3-1ccf-43a1-8a96-990eca864547"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:35.769246 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.769225 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:35.769339 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.769250 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-console-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:35.769339 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.769293 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "85daacb3-1ccf-43a1-8a96-990eca864547" (UID: "85daacb3-1ccf-43a1-8a96-990eca864547"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:35.769646 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.769391 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "85daacb3-1ccf-43a1-8a96-990eca864547" (UID: "85daacb3-1ccf-43a1-8a96-990eca864547"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:48:35.770917 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.770894 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "85daacb3-1ccf-43a1-8a96-990eca864547" (UID: "85daacb3-1ccf-43a1-8a96-990eca864547"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:48:35.771004 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.770940 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "85daacb3-1ccf-43a1-8a96-990eca864547" (UID: "85daacb3-1ccf-43a1-8a96-990eca864547"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:48:35.771004 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.770979 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85daacb3-1ccf-43a1-8a96-990eca864547-kube-api-access-xgsz8" (OuterVolumeSpecName: "kube-api-access-xgsz8") pod "85daacb3-1ccf-43a1-8a96-990eca864547" (UID: "85daacb3-1ccf-43a1-8a96-990eca864547"). InnerVolumeSpecName "kube-api-access-xgsz8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:48:35.869693 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.869664 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgsz8\" (UniqueName: \"kubernetes.io/projected/85daacb3-1ccf-43a1-8a96-990eca864547-kube-api-access-xgsz8\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:35.869693 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.869689 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-trusted-ca-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:35.869828 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.869702 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-oauth-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:35.869828 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.869714 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85daacb3-1ccf-43a1-8a96-990eca864547-oauth-serving-cert\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:35.869828 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:35.869726 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85daacb3-1ccf-43a1-8a96-990eca864547-console-serving-cert\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:48:36.432960 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.432921 2562 generic.go:356] "Generic (PLEG): container finished" podID="85daacb3-1ccf-43a1-8a96-990eca864547" containerID="0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f" exitCode=0 Jul 01 20:48:36.433379 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.432973 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86dbdc7fc8-kg7s4" Jul 01 20:48:36.433379 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.433003 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dbdc7fc8-kg7s4" event={"ID":"85daacb3-1ccf-43a1-8a96-990eca864547","Type":"ContainerDied","Data":"0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f"} Jul 01 20:48:36.433379 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.433058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86dbdc7fc8-kg7s4" event={"ID":"85daacb3-1ccf-43a1-8a96-990eca864547","Type":"ContainerDied","Data":"b00095f3913b410c8d4a41836b530c0dfbc8099b878b31cf2c2229735dfa55f6"} Jul 01 20:48:36.433379 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.433079 2562 scope.go:117] "RemoveContainer" containerID="0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f" Jul 01 20:48:36.441578 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.441559 2562 scope.go:117] "RemoveContainer" containerID="0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f" Jul 01 20:48:36.441846 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:48:36.441826 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f\": container with ID starting with 0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f not found: ID does not exist" containerID="0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f" Jul 01 20:48:36.441895 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.441854 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f"} err="failed to get container status \"0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f\": rpc error: code = NotFound desc = could not find container \"0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f\": container with ID starting with 0dd2605c0b8008d421b5d5cba89bea8215e81474e9979d71c959f21bc8a2aa9f not found: ID does not exist" Jul 01 20:48:36.449147 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.449125 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86dbdc7fc8-kg7s4"] Jul 01 20:48:36.452546 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:36.452526 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86dbdc7fc8-kg7s4"] Jul 01 20:48:37.798462 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:37.798426 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85daacb3-1ccf-43a1-8a96-990eca864547" path="/var/lib/kubelet/pods/85daacb3-1ccf-43a1-8a96-990eca864547/volumes" Jul 01 20:48:39.132598 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:39.132566 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:39.196214 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:39.196184 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:42.639397 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:42.639369 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:48:45.468130 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:45.468103 2562 generic.go:356] "Generic (PLEG): container finished" podID="68955a3f-ae9c-43ce-bb16-370512e1075b" containerID="192eb2265d4fe79500de185d919c7cd6db99c8dee812d9bcbedd63eaecf3857f" exitCode=0 Jul 01 20:48:45.468433 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:45.468173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fnsdn" event={"ID":"68955a3f-ae9c-43ce-bb16-370512e1075b","Type":"ContainerDied","Data":"192eb2265d4fe79500de185d919c7cd6db99c8dee812d9bcbedd63eaecf3857f"} Jul 01 20:48:45.468523 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:45.468505 2562 scope.go:117] "RemoveContainer" containerID="192eb2265d4fe79500de185d919c7cd6db99c8dee812d9bcbedd63eaecf3857f" Jul 01 20:48:46.473523 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:48:46.473472 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5f67b55555-fnsdn" event={"ID":"68955a3f-ae9c-43ce-bb16-370512e1075b","Type":"ContainerStarted","Data":"f45f5729253290248d89e42edc8d4f2b2d2dcf1119e61248fa8a183cc6525607"} Jul 01 20:49:12.059032 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:12.059001 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:15.560501 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:15.560456 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:15.618744 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:15.618707 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:23.982372 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:23.982268 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:24.040539 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:24.040470 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:24.118773 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:24.118738 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:24.181692 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:24.181660 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:24.770189 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:24.770159 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:24.843226 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:24.843197 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:27.508954 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:27.508925 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:27.606766 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:27.606726 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:34.676827 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:34.676792 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69568c74b6-k5cgq"] Jul 01 20:49:34.778516 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:34.778457 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:34.832265 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:34.832233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:34.894934 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:34.894903 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:39.139530 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:39.139476 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:39.238964 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:39.238926 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:49:59.699091 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:59.699019 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69568c74b6-k5cgq" podUID="3c1cd3ce-d85c-424f-ab92-ba4226a0e784" containerName="console" containerID="cri-o://014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611" gracePeriod=15 Jul 01 20:49:59.954853 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:49:59.954783 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:50:00.023064 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023033 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-service-ca\") pod \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " Jul 01 20:50:00.023253 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023075 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c58p7\" (UniqueName: \"kubernetes.io/projected/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-kube-api-access-c58p7\") pod \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " Jul 01 20:50:00.023253 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023103 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-oauth-config\") pod \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " Jul 01 20:50:00.023253 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023128 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-oauth-serving-cert\") pod \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " Jul 01 20:50:00.023253 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023200 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-serving-cert\") pod \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " Jul 01 20:50:00.023253 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023242 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-trusted-ca-bundle\") pod \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " Jul 01 20:50:00.023527 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023264 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-config\") pod \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\" (UID: \"3c1cd3ce-d85c-424f-ab92-ba4226a0e784\") " Jul 01 20:50:00.023686 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023647 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-service-ca" (OuterVolumeSpecName: "service-ca") pod "3c1cd3ce-d85c-424f-ab92-ba4226a0e784" (UID: "3c1cd3ce-d85c-424f-ab92-ba4226a0e784"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:50:00.023810 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023675 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3c1cd3ce-d85c-424f-ab92-ba4226a0e784" (UID: "3c1cd3ce-d85c-424f-ab92-ba4226a0e784"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:50:00.023810 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023777 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3c1cd3ce-d85c-424f-ab92-ba4226a0e784" (UID: "3c1cd3ce-d85c-424f-ab92-ba4226a0e784"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:50:00.024090 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.023867 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-config" (OuterVolumeSpecName: "console-config") pod "3c1cd3ce-d85c-424f-ab92-ba4226a0e784" (UID: "3c1cd3ce-d85c-424f-ab92-ba4226a0e784"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 20:50:00.025461 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.025430 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3c1cd3ce-d85c-424f-ab92-ba4226a0e784" (UID: "3c1cd3ce-d85c-424f-ab92-ba4226a0e784"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:50:00.025606 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.025512 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-kube-api-access-c58p7" (OuterVolumeSpecName: "kube-api-access-c58p7") pod "3c1cd3ce-d85c-424f-ab92-ba4226a0e784" (UID: "3c1cd3ce-d85c-424f-ab92-ba4226a0e784"). InnerVolumeSpecName "kube-api-access-c58p7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 20:50:00.025656 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.025625 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3c1cd3ce-d85c-424f-ab92-ba4226a0e784" (UID: "3c1cd3ce-d85c-424f-ab92-ba4226a0e784"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 20:50:00.123840 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.123790 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-serving-cert\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:50:00.123840 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.123834 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-trusted-ca-bundle\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:50:00.123840 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.123845 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:50:00.123840 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.123853 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-service-ca\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:50:00.123840 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.123861 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c58p7\" (UniqueName: \"kubernetes.io/projected/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-kube-api-access-c58p7\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:50:00.124138 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.123871 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-console-oauth-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:50:00.124138 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.123881 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3c1cd3ce-d85c-424f-ab92-ba4226a0e784-oauth-serving-cert\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 20:50:00.763002 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.762967 2562 generic.go:356] "Generic (PLEG): container finished" podID="3c1cd3ce-d85c-424f-ab92-ba4226a0e784" containerID="014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611" exitCode=0 Jul 01 20:50:00.763452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.763023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69568c74b6-k5cgq" event={"ID":"3c1cd3ce-d85c-424f-ab92-ba4226a0e784","Type":"ContainerDied","Data":"014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611"} Jul 01 20:50:00.763452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.763033 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69568c74b6-k5cgq" Jul 01 20:50:00.763452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.763089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69568c74b6-k5cgq" event={"ID":"3c1cd3ce-d85c-424f-ab92-ba4226a0e784","Type":"ContainerDied","Data":"57b4fc24aff75eea764df87ae9eb1a2c587dc4a8459cd7845507caca15dc9fb8"} Jul 01 20:50:00.763452 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.763109 2562 scope.go:117] "RemoveContainer" containerID="014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611" Jul 01 20:50:00.772273 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.772251 2562 scope.go:117] "RemoveContainer" containerID="014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611" Jul 01 20:50:00.772548 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:50:00.772529 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611\": container with ID starting with 014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611 not found: ID does not exist" containerID="014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611" Jul 01 20:50:00.772630 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.772556 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611"} err="failed to get container status \"014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611\": rpc error: code = NotFound desc = could not find container \"014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611\": container with ID starting with 014a5ea98ad80daa052464252394547a11d2a9367d112b957ab40684ccdb1611 not found: ID does not exist" Jul 01 20:50:00.787638 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.787604 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69568c74b6-k5cgq"] Jul 01 20:50:00.792855 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:00.792827 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69568c74b6-k5cgq"] Jul 01 20:50:01.797705 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:01.797674 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c1cd3ce-d85c-424f-ab92-ba4226a0e784" path="/var/lib/kubelet/pods/3c1cd3ce-d85c-424f-ab92-ba4226a0e784/volumes" Jul 01 20:50:11.363620 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:11.363584 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:11.446266 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:11.446220 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:16.326635 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:16.326598 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:16.395312 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:16.395273 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:33.571602 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:33.571562 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:33.729212 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:33.729172 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:39.272685 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:39.272636 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:39.751655 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:39.751619 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:39.897280 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:39.897242 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:40.019458 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.019367 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:40.189047 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189013 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9"] Jul 01 20:50:40.189314 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189302 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9463a6d9-bd06-4ea8-888a-7f81aa6650a7" containerName="console" Jul 01 20:50:40.189356 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189316 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9463a6d9-bd06-4ea8-888a-7f81aa6650a7" containerName="console" Jul 01 20:50:40.189356 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189332 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c1cd3ce-d85c-424f-ab92-ba4226a0e784" containerName="console" Jul 01 20:50:40.189356 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189338 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c1cd3ce-d85c-424f-ab92-ba4226a0e784" containerName="console" Jul 01 20:50:40.189356 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189349 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0890ac18-afbd-49ea-ac63-e904ca9ff494" containerName="registry" Jul 01 20:50:40.189356 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189355 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0890ac18-afbd-49ea-ac63-e904ca9ff494" containerName="registry" Jul 01 20:50:40.189535 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189362 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85daacb3-1ccf-43a1-8a96-990eca864547" containerName="console" Jul 01 20:50:40.189535 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189368 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="85daacb3-1ccf-43a1-8a96-990eca864547" containerName="console" Jul 01 20:50:40.189535 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189413 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c1cd3ce-d85c-424f-ab92-ba4226a0e784" containerName="console" Jul 01 20:50:40.189535 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189421 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="85daacb3-1ccf-43a1-8a96-990eca864547" containerName="console" Jul 01 20:50:40.189535 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189426 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0890ac18-afbd-49ea-ac63-e904ca9ff494" containerName="registry" Jul 01 20:50:40.189535 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.189433 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9463a6d9-bd06-4ea8-888a-7f81aa6650a7" containerName="console" Jul 01 20:50:40.192012 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.191992 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.197360 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.197337 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 01 20:50:40.198940 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.198508 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 01 20:50:40.198940 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.198545 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 01 20:50:40.199291 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.199273 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-lsp57\"" Jul 01 20:50:40.199291 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.199281 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 01 20:50:40.199430 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.199326 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 01 20:50:40.219239 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.219203 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:40.223450 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.223410 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9"] Jul 01 20:50:40.345432 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.345339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-certificates\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.345432 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.345391 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdcz2\" (UniqueName: \"kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-kube-api-access-xdcz2\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.345871 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.345456 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8d739259-e7da-4318-aa6a-6ada661decf2-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.446529 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.446468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-certificates\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.446706 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.446548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdcz2\" (UniqueName: \"kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-kube-api-access-xdcz2\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.446706 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.446585 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8d739259-e7da-4318-aa6a-6ada661decf2-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.446706 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:50:40.446634 2562 secret.go:281] references non-existent secret key: tls.crt Jul 01 20:50:40.446706 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:50:40.446653 2562 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: tls.crt Jul 01 20:50:40.446706 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:50:40.446671 2562 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9: references non-existent secret key: tls.crt Jul 01 20:50:40.446868 ip-10-0-129-25 kubenswrapper[2562]: E0701 20:50:40.446752 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-certificates podName:8d739259-e7da-4318-aa6a-6ada661decf2 nodeName:}" failed. No retries permitted until 2026-07-01 20:50:40.94673462 +0000 UTC m=+251.609808682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-certificates") pod "keda-metrics-apiserver-559f75f947-2bgr9" (UID: "8d739259-e7da-4318-aa6a-6ada661decf2") : references non-existent secret key: tls.crt Jul 01 20:50:40.447004 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.446984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/8d739259-e7da-4318-aa6a-6ada661decf2-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.465950 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.465912 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdcz2\" (UniqueName: \"kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-kube-api-access-xdcz2\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.740538 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.740480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:40.746079 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.746056 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vgrf5"] Jul 01 20:50:40.748234 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.748219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:40.752472 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.752451 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 01 20:50:40.770955 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.770929 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vgrf5"] Jul 01 20:50:40.850809 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.850772 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9be35e27-ef1a-4803-8025-5a553e1b7dc8-certificates\") pod \"keda-admission-5fbd5c4644-vgrf5\" (UID: \"9be35e27-ef1a-4803-8025-5a553e1b7dc8\") " pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:40.851001 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.850858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxm5\" (UniqueName: \"kubernetes.io/projected/9be35e27-ef1a-4803-8025-5a553e1b7dc8-kube-api-access-6kxm5\") pod \"keda-admission-5fbd5c4644-vgrf5\" (UID: \"9be35e27-ef1a-4803-8025-5a553e1b7dc8\") " pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:40.868399 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.868358 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:40.951794 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.951758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-certificates\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.951996 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.951916 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxm5\" (UniqueName: \"kubernetes.io/projected/9be35e27-ef1a-4803-8025-5a553e1b7dc8-kube-api-access-6kxm5\") pod \"keda-admission-5fbd5c4644-vgrf5\" (UID: \"9be35e27-ef1a-4803-8025-5a553e1b7dc8\") " pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:40.952058 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.952000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9be35e27-ef1a-4803-8025-5a553e1b7dc8-certificates\") pod \"keda-admission-5fbd5c4644-vgrf5\" (UID: \"9be35e27-ef1a-4803-8025-5a553e1b7dc8\") " pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:40.954501 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.954461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/8d739259-e7da-4318-aa6a-6ada661decf2-certificates\") pod \"keda-metrics-apiserver-559f75f947-2bgr9\" (UID: \"8d739259-e7da-4318-aa6a-6ada661decf2\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:40.954613 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.954551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/9be35e27-ef1a-4803-8025-5a553e1b7dc8-certificates\") pod \"keda-admission-5fbd5c4644-vgrf5\" (UID: \"9be35e27-ef1a-4803-8025-5a553e1b7dc8\") " pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:40.961541 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.961513 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxm5\" (UniqueName: \"kubernetes.io/projected/9be35e27-ef1a-4803-8025-5a553e1b7dc8-kube-api-access-6kxm5\") pod \"keda-admission-5fbd5c4644-vgrf5\" (UID: \"9be35e27-ef1a-4803-8025-5a553e1b7dc8\") " pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:40.969202 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:40.969127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:41.058509 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.058386 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:41.102674 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.102363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:41.169219 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.169116 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:41.212195 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.212040 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-vgrf5"] Jul 01 20:50:41.215518 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:50:41.215464 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9be35e27_ef1a_4803_8025_5a553e1b7dc8.slice/crio-194de430e9e03530de29cc8902c322e0937f6a9bdad7d9b3d58afe07b783b59a WatchSource:0}: Error finding container 194de430e9e03530de29cc8902c322e0937f6a9bdad7d9b3d58afe07b783b59a: Status 404 returned error can't find the container with id 194de430e9e03530de29cc8902c322e0937f6a9bdad7d9b3d58afe07b783b59a Jul 01 20:50:41.265273 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.265242 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9"] Jul 01 20:50:41.268222 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:50:41.268198 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d739259_e7da_4318_aa6a_6ada661decf2.slice/crio-07139b67bd042ba85237cfb3b232e174e970db5ebd6b14a61db6afe0eb6b1477 WatchSource:0}: Error finding container 07139b67bd042ba85237cfb3b232e174e970db5ebd6b14a61db6afe0eb6b1477: Status 404 returned error can't find the container with id 07139b67bd042ba85237cfb3b232e174e970db5ebd6b14a61db6afe0eb6b1477 Jul 01 20:50:41.359345 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.359235 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:41.576236 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.576199 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:41.678597 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.678564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:50:41.918349 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.918311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" event={"ID":"8d739259-e7da-4318-aa6a-6ada661decf2","Type":"ContainerStarted","Data":"07139b67bd042ba85237cfb3b232e174e970db5ebd6b14a61db6afe0eb6b1477"} Jul 01 20:50:41.919808 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:41.919774 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" event={"ID":"9be35e27-ef1a-4803-8025-5a553e1b7dc8","Type":"ContainerStarted","Data":"194de430e9e03530de29cc8902c322e0937f6a9bdad7d9b3d58afe07b783b59a"} Jul 01 20:50:44.934609 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:44.934569 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" event={"ID":"9be35e27-ef1a-4803-8025-5a553e1b7dc8","Type":"ContainerStarted","Data":"b00893d45a236f44ac56430068f56d42efe6f14f3ad31ac52b6b725bc1b64d4f"} Jul 01 20:50:44.935228 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:44.934746 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:50:44.956831 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:44.956778 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" podStartSLOduration=2.209244944 podStartE2EDuration="4.9567547s" totalImagesPullingTime="2.747509756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:50:44.955541862 +0000 UTC m=+255.618615966" watchObservedRunningTime="2026-07-01 20:50:44.9567547 +0000 UTC m=+255.619828783" Jul 01 20:50:45.939788 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:45.939741 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" event={"ID":"8d739259-e7da-4318-aa6a-6ada661decf2","Type":"ContainerStarted","Data":"c2b9e622dc5f2657882d73351f9c4ec6a90e0b59885b7d488954bb3660de9d8c"} Jul 01 20:50:45.940219 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:45.939893 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:56.948890 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:56.948860 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" Jul 01 20:50:56.966277 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:50:56.966218 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-2bgr9" podStartSLOduration=13.136407355 podStartE2EDuration="16.966199761s" totalImagesPullingTime="3.829792406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:50:45.974045118 +0000 UTC m=+256.637119202" watchObservedRunningTime="2026-07-01 20:50:56.966199761 +0000 UTC m=+267.629273888" Jul 01 20:51:02.792344 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:02.792301 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:51:02.852090 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:02.852048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:51:05.942403 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:05.942367 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-vgrf5" Jul 01 20:51:29.739796 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:29.739767 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 20:51:29.742201 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:29.742173 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 20:51:29.752655 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:29.752629 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 20:51:45.491366 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.491325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:51:45.561713 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.561680 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-w9lfz"] Jul 01 20:51:45.564340 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.564320 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:45.566753 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.566727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-m5x9q\"" Jul 01 20:51:45.567712 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.567691 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 01 20:51:45.567859 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.567721 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 01 20:51:45.567859 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.567740 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 01 20:51:45.575799 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.575774 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-w9lfz"] Jul 01 20:51:45.592038 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.592000 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-r4h4h"] Jul 01 20:51:45.595531 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.595506 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:45.597984 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.597959 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 01 20:51:45.598143 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.598044 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-vntfm\"" Jul 01 20:51:45.600344 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.600323 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-r4h4h"] Jul 01 20:51:45.664923 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.664885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7dbh\" (UniqueName: \"kubernetes.io/projected/2ed59c0a-cb65-46df-b21d-0f32059a6e86-kube-api-access-g7dbh\") pod \"llmisvc-controller-manager-67d95fdc48-w9lfz\" (UID: \"2ed59c0a-cb65-46df-b21d-0f32059a6e86\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:45.664923 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.664924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed59c0a-cb65-46df-b21d-0f32059a6e86-cert\") pod \"llmisvc-controller-manager-67d95fdc48-w9lfz\" (UID: \"2ed59c0a-cb65-46df-b21d-0f32059a6e86\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:45.665145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.664950 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27m6t\" (UniqueName: \"kubernetes.io/projected/42b711f9-b579-4aa6-9c64-9483187d8210-kube-api-access-27m6t\") pod \"seaweedfs-64568bcd49-r4h4h\" (UID: \"42b711f9-b579-4aa6-9c64-9483187d8210\") " pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:45.665145 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.665042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42b711f9-b579-4aa6-9c64-9483187d8210-data\") pod \"seaweedfs-64568bcd49-r4h4h\" (UID: \"42b711f9-b579-4aa6-9c64-9483187d8210\") " pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:45.766252 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.766161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27m6t\" (UniqueName: \"kubernetes.io/projected/42b711f9-b579-4aa6-9c64-9483187d8210-kube-api-access-27m6t\") pod \"seaweedfs-64568bcd49-r4h4h\" (UID: \"42b711f9-b579-4aa6-9c64-9483187d8210\") " pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:45.766252 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.766209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42b711f9-b579-4aa6-9c64-9483187d8210-data\") pod \"seaweedfs-64568bcd49-r4h4h\" (UID: \"42b711f9-b579-4aa6-9c64-9483187d8210\") " pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:45.766444 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.766265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7dbh\" (UniqueName: \"kubernetes.io/projected/2ed59c0a-cb65-46df-b21d-0f32059a6e86-kube-api-access-g7dbh\") pod \"llmisvc-controller-manager-67d95fdc48-w9lfz\" (UID: \"2ed59c0a-cb65-46df-b21d-0f32059a6e86\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:45.766444 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.766286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed59c0a-cb65-46df-b21d-0f32059a6e86-cert\") pod \"llmisvc-controller-manager-67d95fdc48-w9lfz\" (UID: \"2ed59c0a-cb65-46df-b21d-0f32059a6e86\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:45.766668 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.766647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42b711f9-b579-4aa6-9c64-9483187d8210-data\") pod \"seaweedfs-64568bcd49-r4h4h\" (UID: \"42b711f9-b579-4aa6-9c64-9483187d8210\") " pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:45.768928 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.768906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ed59c0a-cb65-46df-b21d-0f32059a6e86-cert\") pod \"llmisvc-controller-manager-67d95fdc48-w9lfz\" (UID: \"2ed59c0a-cb65-46df-b21d-0f32059a6e86\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:45.775307 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.775281 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7dbh\" (UniqueName: \"kubernetes.io/projected/2ed59c0a-cb65-46df-b21d-0f32059a6e86-kube-api-access-g7dbh\") pod \"llmisvc-controller-manager-67d95fdc48-w9lfz\" (UID: \"2ed59c0a-cb65-46df-b21d-0f32059a6e86\") " pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:45.775428 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.775360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27m6t\" (UniqueName: \"kubernetes.io/projected/42b711f9-b579-4aa6-9c64-9483187d8210-kube-api-access-27m6t\") pod \"seaweedfs-64568bcd49-r4h4h\" (UID: \"42b711f9-b579-4aa6-9c64-9483187d8210\") " pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:45.874608 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.874566 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:45.905716 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:45.905687 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:46.020922 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:46.020812 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-67d95fdc48-w9lfz"] Jul 01 20:51:46.025248 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:51:46.025217 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2ed59c0a_cb65_46df_b21d_0f32059a6e86.slice/crio-578eb4c44682cad695082076693a01f2b87ae1f25214d9f20043d89453fc9ab1 WatchSource:0}: Error finding container 578eb4c44682cad695082076693a01f2b87ae1f25214d9f20043d89453fc9ab1: Status 404 returned error can't find the container with id 578eb4c44682cad695082076693a01f2b87ae1f25214d9f20043d89453fc9ab1 Jul 01 20:51:46.026811 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:46.026789 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:51:46.048364 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:46.048342 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-r4h4h"] Jul 01 20:51:46.050466 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:51:46.050441 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b711f9_b579_4aa6_9c64_9483187d8210.slice/crio-4d12e230ea0bca1c3abd4ce86d7b4198226ec797c97e5913611068d4ac30b0ee WatchSource:0}: Error finding container 4d12e230ea0bca1c3abd4ce86d7b4198226ec797c97e5913611068d4ac30b0ee: Status 404 returned error can't find the container with id 4d12e230ea0bca1c3abd4ce86d7b4198226ec797c97e5913611068d4ac30b0ee Jul 01 20:51:46.174109 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:46.174074 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-r4h4h" event={"ID":"42b711f9-b579-4aa6-9c64-9483187d8210","Type":"ContainerStarted","Data":"4d12e230ea0bca1c3abd4ce86d7b4198226ec797c97e5913611068d4ac30b0ee"} Jul 01 20:51:46.175166 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:46.175143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" event={"ID":"2ed59c0a-cb65-46df-b21d-0f32059a6e86","Type":"ContainerStarted","Data":"578eb4c44682cad695082076693a01f2b87ae1f25214d9f20043d89453fc9ab1"} Jul 01 20:51:46.977908 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:46.977797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:51:48.185786 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:48.185747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" event={"ID":"2ed59c0a-cb65-46df-b21d-0f32059a6e86","Type":"ContainerStarted","Data":"170743506fdcb6fed90deec52d19c074cb83a8be5d0f1377f41f6fa27b8755f0"} Jul 01 20:51:48.186257 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:48.185873 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:51:48.205522 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:48.205450 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" podStartSLOduration=1.35840511 podStartE2EDuration="3.205429675s" totalImagesPullingTime="1.847024565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:51:48.203867149 +0000 UTC m=+318.866941256" watchObservedRunningTime="2026-07-01 20:51:48.205429675 +0000 UTC m=+318.868503759" Jul 01 20:51:50.199385 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:50.199348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-r4h4h" event={"ID":"42b711f9-b579-4aa6-9c64-9483187d8210","Type":"ContainerStarted","Data":"1daa0f3a1cd48d4b058bb0d59809b736d19a91961439ecd4eab573c0a0b6c4c4"} Jul 01 20:51:50.199812 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:50.199442 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:56.206084 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:56.206048 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-r4h4h" Jul 01 20:51:56.227677 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:51:56.227619 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-r4h4h" podStartSLOduration=7.690325704 podStartE2EDuration="11.227599694s" totalImagesPullingTime="3.53727399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:51:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:51:50.239331799 +0000 UTC m=+320.902405882" watchObservedRunningTime="2026-07-01 20:51:56.227599694 +0000 UTC m=+326.890673778" Jul 01 20:52:19.195555 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:52:19.195521 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-67d95fdc48-w9lfz" Jul 01 20:52:46.500644 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:52:46.500553 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:52:54.314400 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:52:54.314362 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:52:54.412906 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:52:54.412870 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:52:54.566318 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:52:54.566230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:52:54.824711 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:52:54.824635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:52:54.950594 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:52:54.950559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:52:55.005449 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:52:55.005421 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:53:09.950995 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.950962 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d8fb98fc-4qhrz"] Jul 01 20:53:09.953159 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.953143 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:09.956013 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.955993 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 01 20:53:09.956125 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.956095 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 01 20:53:09.957094 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.957071 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-86w5c\"" Jul 01 20:53:09.957198 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.957104 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 01 20:53:09.957198 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.957114 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 01 20:53:09.957198 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.957075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 01 20:53:09.961168 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.961146 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 01 20:53:09.967226 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:09.967206 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d8fb98fc-4qhrz"] Jul 01 20:53:10.009782 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.009760 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:53:10.030015 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.029990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-config\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.030104 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.030019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-oauth-serving-cert\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.030146 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.030101 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-trusted-ca-bundle\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.030146 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.030130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-oauth-config\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.030213 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.030159 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-serving-cert\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.030213 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.030176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-service-ca\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.030277 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.030221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpxqr\" (UniqueName: \"kubernetes.io/projected/e28af5e7-0324-49a7-8e61-46a27b9f9f70-kube-api-access-cpxqr\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.131455 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.131428 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-trusted-ca-bundle\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.131601 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.131466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-oauth-config\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.131601 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.131519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-serving-cert\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.131601 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.131544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-service-ca\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.131601 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.131584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpxqr\" (UniqueName: \"kubernetes.io/projected/e28af5e7-0324-49a7-8e61-46a27b9f9f70-kube-api-access-cpxqr\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.131800 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.131630 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-config\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.131800 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.131655 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-oauth-serving-cert\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.132324 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.132293 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-oauth-serving-cert\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.132413 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.132391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-trusted-ca-bundle\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.132459 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.132397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-config\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.132530 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.132507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e28af5e7-0324-49a7-8e61-46a27b9f9f70-service-ca\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.133952 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.133934 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-oauth-config\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.134068 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.134052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e28af5e7-0324-49a7-8e61-46a27b9f9f70-console-serving-cert\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.140952 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.140933 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpxqr\" (UniqueName: \"kubernetes.io/projected/e28af5e7-0324-49a7-8e61-46a27b9f9f70-kube-api-access-cpxqr\") pod \"console-75d8fb98fc-4qhrz\" (UID: \"e28af5e7-0324-49a7-8e61-46a27b9f9f70\") " pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.263866 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.263799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:10.392929 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.392902 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d8fb98fc-4qhrz"] Jul 01 20:53:10.395514 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:53:10.395465 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode28af5e7_0324_49a7_8e61_46a27b9f9f70.slice/crio-4dffedfa59fa08ea7facfea6e8c898601cc54a37695abff78fb31d0195d11969 WatchSource:0}: Error finding container 4dffedfa59fa08ea7facfea6e8c898601cc54a37695abff78fb31d0195d11969: Status 404 returned error can't find the container with id 4dffedfa59fa08ea7facfea6e8c898601cc54a37695abff78fb31d0195d11969 Jul 01 20:53:10.515101 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.515029 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d8fb98fc-4qhrz" event={"ID":"e28af5e7-0324-49a7-8e61-46a27b9f9f70","Type":"ContainerStarted","Data":"db686b2fa753f4e619bc4a44f5f079f71f09b0544348b334e22d917f21b88c55"} Jul 01 20:53:10.515101 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.515082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d8fb98fc-4qhrz" event={"ID":"e28af5e7-0324-49a7-8e61-46a27b9f9f70","Type":"ContainerStarted","Data":"4dffedfa59fa08ea7facfea6e8c898601cc54a37695abff78fb31d0195d11969"} Jul 01 20:53:10.532670 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:10.532628 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d8fb98fc-4qhrz" podStartSLOduration=1.532614021 podStartE2EDuration="1.532614021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:53:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:53:10.53130058 +0000 UTC m=+401.194374688" watchObservedRunningTime="2026-07-01 20:53:10.532614021 +0000 UTC m=+401.195688160" Jul 01 20:53:20.264298 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:20.264263 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:20.264760 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:20.264325 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:20.268682 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:20.268662 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:20.559015 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:20.558935 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d8fb98fc-4qhrz" Jul 01 20:53:20.715743 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:20.715713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:53:20.771041 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:20.771007 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:53:20.824852 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:20.824745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:53:48.232052 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:48.232017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:53:48.291100 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:53:48.291062 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:54:29.597316 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:54:29.597280 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:54:51.639636 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:54:51.639595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:54:51.970221 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:54:51.970188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:55:06.471447 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:55:06.471404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:55:06.572716 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:55:06.572681 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:55:14.101524 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:55:14.101473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:55:17.374514 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:55:17.374469 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:55:17.565079 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:55:17.565044 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:56:10.712995 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:56:10.712958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:56:29.772453 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:56:29.772423 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 20:56:29.772916 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:56:29.772902 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 20:57:02.697385 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:57:02.697348 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:57:04.067722 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:57:04.067688 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:57:31.900424 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:57:31.900387 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:57:46.132503 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:57:46.132463 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:57:53.483505 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:57:53.483465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:58:27.771409 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.771323 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:58:27.785690 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.785664 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt"] Jul 01 20:58:27.788079 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.788062 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:27.790747 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.790728 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 01 20:58:27.791815 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.791792 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-dp9dt\"" Jul 01 20:58:27.791895 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.791796 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 01 20:58:27.791895 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.791859 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-kube-rbac-proxy-sar-config\"" Jul 01 20:58:27.791895 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.791881 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"message-dumper-predictor-serving-cert\"" Jul 01 20:58:27.800564 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.800541 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt"] Jul 01 20:58:27.860725 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.860697 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:58:27.923428 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.923396 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:58:27.944445 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.944419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:27.944632 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.944460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:27.944632 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:27.944611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdf59\" (UniqueName: \"kubernetes.io/projected/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-api-access-bdf59\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:28.045050 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.044983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdf59\" (UniqueName: \"kubernetes.io/projected/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-api-access-bdf59\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:28.045050 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.045020 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:28.045050 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.045042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:28.045667 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.045647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-rbac-proxy-sar-config\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:28.047378 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.047359 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-proxy-tls\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:28.054332 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.054310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdf59\" (UniqueName: \"kubernetes.io/projected/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-api-access-bdf59\") pod \"message-dumper-predictor-6575bcfdfd-9c4gt\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:28.098678 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.098656 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:28.230306 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.230284 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt"] Jul 01 20:58:28.232506 ip-10-0-129-25 kubenswrapper[2562]: W0701 20:58:28.232463 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf2d9e0_3320_41cf_a7a7_14f40409c70a.slice/crio-a4a3e1c390d8d78c513034356118ff5ba823fc0855eca01990e81f9f10e2a70f WatchSource:0}: Error finding container a4a3e1c390d8d78c513034356118ff5ba823fc0855eca01990e81f9f10e2a70f: Status 404 returned error can't find the container with id a4a3e1c390d8d78c513034356118ff5ba823fc0855eca01990e81f9f10e2a70f Jul 01 20:58:28.234440 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.234425 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 20:58:28.756728 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:28.756692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" event={"ID":"9cf2d9e0-3320-41cf-a7a7-14f40409c70a","Type":"ContainerStarted","Data":"a4a3e1c390d8d78c513034356118ff5ba823fc0855eca01990e81f9f10e2a70f"} Jul 01 20:58:29.762052 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:29.762021 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" event={"ID":"9cf2d9e0-3320-41cf-a7a7-14f40409c70a","Type":"ContainerStarted","Data":"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264"} Jul 01 20:58:31.771420 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:31.771385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" event={"ID":"9cf2d9e0-3320-41cf-a7a7-14f40409c70a","Type":"ContainerStarted","Data":"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db"} Jul 01 20:58:31.771724 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:31.771540 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:31.771724 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:31.771596 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:31.773058 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:31.773038 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:31.790047 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:31.790008 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" podStartSLOduration=1.4224708449999999 podStartE2EDuration="4.789995148s" totalImagesPullingTime="3.367524303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 20:58:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 20:58:31.788396407 +0000 UTC m=+722.451470489" watchObservedRunningTime="2026-07-01 20:58:31.789995148 +0000 UTC m=+722.453069231" Jul 01 20:58:38.784001 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:38.783970 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 20:58:47.825682 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:47.825642 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 20:58:47.909685 ip-10-0-129-25 kubenswrapper[2562]: I0701 20:58:47.909648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:00:22.875649 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:22.875614 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_message-dumper-predictor-6575bcfdfd-9c4gt_9cf2d9e0-3320-41cf-a7a7-14f40409c70a/kserve-container/0.log" Jul 01 21:00:23.107348 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.107316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:00:23.204098 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.204069 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt"] Jul 01 21:00:23.204305 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.204280 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerName="kserve-container" containerID="cri-o://1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264" gracePeriod=30 Jul 01 21:00:23.204348 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.204312 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerName="kube-rbac-proxy" containerID="cri-o://2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db" gracePeriod=30 Jul 01 21:00:23.212589 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.212565 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:00:23.268118 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.268085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:00:23.453548 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.453520 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 21:00:23.465643 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.465590 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-proxy-tls\") pod \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " Jul 01 21:00:23.465761 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.465657 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-rbac-proxy-sar-config\") pod \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " Jul 01 21:00:23.465761 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.465718 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdf59\" (UniqueName: \"kubernetes.io/projected/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-api-access-bdf59\") pod \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\" (UID: \"9cf2d9e0-3320-41cf-a7a7-14f40409c70a\") " Jul 01 21:00:23.465996 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.465977 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9cf2d9e0-3320-41cf-a7a7-14f40409c70a" (UID: "9cf2d9e0-3320-41cf-a7a7-14f40409c70a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 01 21:00:23.467829 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.467800 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-api-access-bdf59" (OuterVolumeSpecName: "kube-api-access-bdf59") pod "9cf2d9e0-3320-41cf-a7a7-14f40409c70a" (UID: "9cf2d9e0-3320-41cf-a7a7-14f40409c70a"). InnerVolumeSpecName "kube-api-access-bdf59". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 21:00:23.467919 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.467899 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9cf2d9e0-3320-41cf-a7a7-14f40409c70a" (UID: "9cf2d9e0-3320-41cf-a7a7-14f40409c70a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 21:00:23.567183 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.567159 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdf59\" (UniqueName: \"kubernetes.io/projected/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-api-access-bdf59\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 21:00:23.567183 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.567180 2562 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-proxy-tls\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 21:00:23.567308 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.567193 2562 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf2d9e0-3320-41cf-a7a7-14f40409c70a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-129-25.ec2.internal\" DevicePath \"\"" Jul 01 21:00:23.680632 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:23.680607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:00:24.231332 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.231305 2562 generic.go:356] "Generic (PLEG): container finished" podID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerID="2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db" exitCode=2 Jul 01 21:00:24.231332 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.231329 2562 generic.go:356] "Generic (PLEG): container finished" podID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerID="1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264" exitCode=2 Jul 01 21:00:24.231767 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.231358 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" Jul 01 21:00:24.231767 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.231362 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" event={"ID":"9cf2d9e0-3320-41cf-a7a7-14f40409c70a","Type":"ContainerDied","Data":"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db"} Jul 01 21:00:24.231767 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.231471 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" event={"ID":"9cf2d9e0-3320-41cf-a7a7-14f40409c70a","Type":"ContainerDied","Data":"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264"} Jul 01 21:00:24.231767 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.231518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt" event={"ID":"9cf2d9e0-3320-41cf-a7a7-14f40409c70a","Type":"ContainerDied","Data":"a4a3e1c390d8d78c513034356118ff5ba823fc0855eca01990e81f9f10e2a70f"} Jul 01 21:00:24.231767 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.231551 2562 scope.go:117] "RemoveContainer" containerID="2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db" Jul 01 21:00:24.239888 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.239866 2562 scope.go:117] "RemoveContainer" containerID="1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264" Jul 01 21:00:24.247930 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.247912 2562 scope.go:117] "RemoveContainer" containerID="2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db" Jul 01 21:00:24.248227 ip-10-0-129-25 kubenswrapper[2562]: E0701 21:00:24.248200 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db\": container with ID starting with 2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db not found: ID does not exist" containerID="2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db" Jul 01 21:00:24.248368 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.248233 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db"} err="failed to get container status \"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db\": rpc error: code = NotFound desc = could not find container \"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db\": container with ID starting with 2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db not found: ID does not exist" Jul 01 21:00:24.248368 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.248250 2562 scope.go:117] "RemoveContainer" containerID="1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264" Jul 01 21:00:24.248559 ip-10-0-129-25 kubenswrapper[2562]: E0701 21:00:24.248537 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264\": container with ID starting with 1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264 not found: ID does not exist" containerID="1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264" Jul 01 21:00:24.248918 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.248567 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264"} err="failed to get container status \"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264\": rpc error: code = NotFound desc = could not find container \"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264\": container with ID starting with 1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264 not found: ID does not exist" Jul 01 21:00:24.248918 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.248619 2562 scope.go:117] "RemoveContainer" containerID="2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db" Jul 01 21:00:24.249040 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.249019 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db"} err="failed to get container status \"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db\": rpc error: code = NotFound desc = could not find container \"2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db\": container with ID starting with 2a589881e4dad4c175997b9e387431b096b4f350fd46ca976827f5ef45fe69db not found: ID does not exist" Jul 01 21:00:24.249091 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.249046 2562 scope.go:117] "RemoveContainer" containerID="1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264" Jul 01 21:00:24.249324 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.249300 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264"} err="failed to get container status \"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264\": rpc error: code = NotFound desc = could not find container \"1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264\": container with ID starting with 1bf8a9d67390c453339adce5c7873371f5181c62f30924dd953da04c48db5264 not found: ID does not exist" Jul 01 21:00:24.250507 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.250465 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt"] Jul 01 21:00:24.256255 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:24.256235 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/message-dumper-predictor-6575bcfdfd-9c4gt"] Jul 01 21:00:25.797937 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:25.797896 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" path="/var/lib/kubelet/pods/9cf2d9e0-3320-41cf-a7a7-14f40409c70a/volumes" Jul 01 21:00:38.573110 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:00:38.573075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:01:29.802152 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:01:29.802077 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 21:01:29.803589 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:01:29.803566 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 21:03:33.365165 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:03:33.365128 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:03:38.675241 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:03:38.675204 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:03:38.745585 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:03:38.745551 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:05:48.798874 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:05:48.798835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:05:53.823092 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:05:53.823006 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:05:53.909260 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:05:53.909230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:06:19.616051 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:06:19.616015 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:06:29.827002 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:06:29.826971 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 21:06:29.829538 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:06:29.829516 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 21:06:55.765818 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:06:55.765775 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:07:34.045579 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:07:34.045462 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:07:39.059330 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:07:39.059291 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:07:39.264031 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:07:39.263992 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:09:19.299086 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:09:19.299045 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:09:24.327948 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:09:24.327918 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:09:24.540805 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:09:24.540777 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:09:54.469466 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:09:54.469433 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:10:01.271875 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:01.271841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:10:01.369971 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:01.369941 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:10:29.465093 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.465044 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:10:29.605425 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.605396 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ct4wg/must-gather-7lr4q"] Jul 01 21:10:29.605727 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.605715 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerName="kube-rbac-proxy" Jul 01 21:10:29.605775 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.605729 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerName="kube-rbac-proxy" Jul 01 21:10:29.605775 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.605738 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerName="kserve-container" Jul 01 21:10:29.605775 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.605743 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerName="kserve-container" Jul 01 21:10:29.605864 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.605798 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerName="kube-rbac-proxy" Jul 01 21:10:29.605864 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.605808 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf2d9e0-3320-41cf-a7a7-14f40409c70a" containerName="kserve-container" Jul 01 21:10:29.608814 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.608798 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ct4wg/must-gather-7lr4q" Jul 01 21:10:29.611398 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.611377 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ct4wg\"/\"openshift-service-ca.crt\"" Jul 01 21:10:29.611565 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.611536 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ct4wg\"/\"kube-root-ca.crt\"" Jul 01 21:10:29.612386 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.612367 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ct4wg\"/\"default-dockercfg-nqgvv\"" Jul 01 21:10:29.617392 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.617364 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:10:29.617642 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.617627 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ct4wg/must-gather-7lr4q"] Jul 01 21:10:29.716654 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.716595 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:10:29.789209 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.789186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d6gz\" (UniqueName: \"kubernetes.io/projected/e1c858e3-b82d-48d8-b522-ddd84c113c09-kube-api-access-7d6gz\") pod \"must-gather-7lr4q\" (UID: \"e1c858e3-b82d-48d8-b522-ddd84c113c09\") " pod="openshift-must-gather-ct4wg/must-gather-7lr4q" Jul 01 21:10:29.789318 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.789252 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e1c858e3-b82d-48d8-b522-ddd84c113c09-must-gather-output\") pod \"must-gather-7lr4q\" (UID: \"e1c858e3-b82d-48d8-b522-ddd84c113c09\") " pod="openshift-must-gather-ct4wg/must-gather-7lr4q" Jul 01 21:10:29.890400 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.890371 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e1c858e3-b82d-48d8-b522-ddd84c113c09-must-gather-output\") pod \"must-gather-7lr4q\" (UID: \"e1c858e3-b82d-48d8-b522-ddd84c113c09\") " pod="openshift-must-gather-ct4wg/must-gather-7lr4q" Jul 01 21:10:29.890553 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.890404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7d6gz\" (UniqueName: \"kubernetes.io/projected/e1c858e3-b82d-48d8-b522-ddd84c113c09-kube-api-access-7d6gz\") pod \"must-gather-7lr4q\" (UID: \"e1c858e3-b82d-48d8-b522-ddd84c113c09\") " pod="openshift-must-gather-ct4wg/must-gather-7lr4q" Jul 01 21:10:29.890729 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.890708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e1c858e3-b82d-48d8-b522-ddd84c113c09-must-gather-output\") pod \"must-gather-7lr4q\" (UID: \"e1c858e3-b82d-48d8-b522-ddd84c113c09\") " pod="openshift-must-gather-ct4wg/must-gather-7lr4q" Jul 01 21:10:29.899428 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.899404 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ct4wg\"/\"kube-root-ca.crt\"" Jul 01 21:10:29.909735 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.909716 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ct4wg\"/\"openshift-service-ca.crt\"" Jul 01 21:10:29.920064 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.920046 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d6gz\" (UniqueName: \"kubernetes.io/projected/e1c858e3-b82d-48d8-b522-ddd84c113c09-kube-api-access-7d6gz\") pod \"must-gather-7lr4q\" (UID: \"e1c858e3-b82d-48d8-b522-ddd84c113c09\") " pod="openshift-must-gather-ct4wg/must-gather-7lr4q" Jul 01 21:10:29.929655 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.929638 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ct4wg\"/\"default-dockercfg-nqgvv\"" Jul 01 21:10:29.937816 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:29.937788 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ct4wg/must-gather-7lr4q" Jul 01 21:10:30.070952 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:30.070931 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ct4wg/must-gather-7lr4q"] Jul 01 21:10:30.073095 ip-10-0-129-25 kubenswrapper[2562]: W0701 21:10:30.073068 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1c858e3_b82d_48d8_b522_ddd84c113c09.slice/crio-4b0c6d1fced86a01baf18b75c77ad56cf256808e24080011211829ecdda3b8d1 WatchSource:0}: Error finding container 4b0c6d1fced86a01baf18b75c77ad56cf256808e24080011211829ecdda3b8d1: Status 404 returned error can't find the container with id 4b0c6d1fced86a01baf18b75c77ad56cf256808e24080011211829ecdda3b8d1 Jul 01 21:10:30.074866 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:30.074851 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 21:10:30.643282 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:30.643245 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct4wg/must-gather-7lr4q" event={"ID":"e1c858e3-b82d-48d8-b522-ddd84c113c09","Type":"ContainerStarted","Data":"4b0c6d1fced86a01baf18b75c77ad56cf256808e24080011211829ecdda3b8d1"} Jul 01 21:10:31.650276 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:31.650239 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct4wg/must-gather-7lr4q" event={"ID":"e1c858e3-b82d-48d8-b522-ddd84c113c09","Type":"ContainerStarted","Data":"ad0c3b48a25379db343d40492eeb0c76f0af88a9b7b86d1b49bc2189679ca7a4"} Jul 01 21:10:31.650787 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:31.650292 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct4wg/must-gather-7lr4q" event={"ID":"e1c858e3-b82d-48d8-b522-ddd84c113c09","Type":"ContainerStarted","Data":"35489a9fb14c2942da25f415c8b10a1ee23293a99997d5983fe76bd690ff2cb3"} Jul 01 21:10:31.669742 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:31.669193 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ct4wg/must-gather-7lr4q" podStartSLOduration=1.600181699 podStartE2EDuration="2.669171035s" totalImagesPullingTime="1.068989336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 21:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:10:31.667994079 +0000 UTC m=+1442.331068163" watchObservedRunningTime="2026-07-01 21:10:31.669171035 +0000 UTC m=+1442.332245120" Jul 01 21:10:32.631773 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:32.631686 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tqwnj_ce48a9f8-571d-4157-86e3-486076a847b0/global-pull-secret-syncer/0.log" Jul 01 21:10:32.684778 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:32.684751 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" Jul 01 21:10:32.795836 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:32.795813 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-25.ec2.internal_8e1ab4c0d6465e7f5a7a74878f3504c3/haproxy/0.log" Jul 01 21:10:35.045878 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:35.045835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:10:35.145604 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:35.145559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bljqt_81b95aae-fb93-4edf-8248-0b64dc342a2f/konnectivity-agent/0.log" limit=1024 Jul 01 21:10:37.098660 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.098619 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-54cb84584-67ft4_554351e4-bd8a-47b2-be1b-6ade48967d13/cluster-monitoring-operator/0.log" Jul 01 21:10:37.131425 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.131348 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-j97mm_bdbb885c-77f0-4973-869e-8ce4226ae2b1/kube-state-metrics/0.log" Jul 01 21:10:37.155693 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.155649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-j97mm_bdbb885c-77f0-4973-869e-8ce4226ae2b1/kube-rbac-proxy-main/0.log" Jul 01 21:10:37.181291 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.181263 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-845b954455-j97mm_bdbb885c-77f0-4973-869e-8ce4226ae2b1/kube-rbac-proxy-self/0.log" Jul 01 21:10:37.367588 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.367559 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52xbg_5217c598-572f-4edf-aa19-390a6761dfa5/node-exporter/0.log" Jul 01 21:10:37.389801 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.389727 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52xbg_5217c598-572f-4edf-aa19-390a6761dfa5/kube-rbac-proxy/0.log" Jul 01 21:10:37.412850 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.412825 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-52xbg_5217c598-572f-4edf-aa19-390a6761dfa5/init-textfile/0.log" Jul 01 21:10:37.520777 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.520749 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-tr7wr_8e9e0680-ab6e-4e23-bbbb-6158ce897022/kube-rbac-proxy-main/0.log" Jul 01 21:10:37.542775 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.542744 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-tr7wr_8e9e0680-ab6e-4e23-bbbb-6158ce897022/kube-rbac-proxy-self/0.log" Jul 01 21:10:37.566010 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.565982 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-57f99c8b49-tr7wr_8e9e0680-ab6e-4e23-bbbb-6158ce897022/openshift-state-metrics/0.log" Jul 01 21:10:37.943974 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.943896 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cd4cc8769-k5gf8_84fc2d6e-68cf-48b3-a6e6-01eb25a2582f/thanos-query/0.log" Jul 01 21:10:37.969390 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.969352 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cd4cc8769-k5gf8_84fc2d6e-68cf-48b3-a6e6-01eb25a2582f/kube-rbac-proxy-web/0.log" Jul 01 21:10:37.995410 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:37.995385 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cd4cc8769-k5gf8_84fc2d6e-68cf-48b3-a6e6-01eb25a2582f/kube-rbac-proxy/0.log" Jul 01 21:10:38.018462 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:38.018433 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cd4cc8769-k5gf8_84fc2d6e-68cf-48b3-a6e6-01eb25a2582f/prom-label-proxy/0.log" Jul 01 21:10:38.043393 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:38.043354 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cd4cc8769-k5gf8_84fc2d6e-68cf-48b3-a6e6-01eb25a2582f/kube-rbac-proxy-rules/0.log" Jul 01 21:10:38.077355 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:38.077319 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6cd4cc8769-k5gf8_84fc2d6e-68cf-48b3-a6e6-01eb25a2582f/kube-rbac-proxy-metrics/0.log" Jul 01 21:10:40.243217 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.243195 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75d8fb98fc-4qhrz_e28af5e7-0324-49a7-8e61-46a27b9f9f70/console/0.log" Jul 01 21:10:40.273036 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.273002 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-lcxdx_83fb83f5-a7d8-486d-b145-5bae328ba014/download-server/0.log" Jul 01 21:10:40.762267 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.762239 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-69d9f679db-zndb5_a7fe89ea-4263-466b-8e11-e20d72075ffe/volume-data-source-validator/0.log" Jul 01 21:10:40.953185 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.953149 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk"] Jul 01 21:10:40.959130 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.959099 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:40.967499 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.967454 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk"] Jul 01 21:10:40.990191 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.990158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-proc\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:40.990359 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.990218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-sys\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:40.990359 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.990261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdwgd\" (UniqueName: \"kubernetes.io/projected/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-kube-api-access-rdwgd\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:40.990359 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.990313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-lib-modules\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:40.990359 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:40.990356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-podres\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.091343 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.091246 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-sys\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.091343 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.091298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdwgd\" (UniqueName: \"kubernetes.io/projected/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-kube-api-access-rdwgd\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.091343 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.091336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-lib-modules\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.091656 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.091385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-podres\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.091656 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.091478 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-proc\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.091656 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.091619 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-proc\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.091820 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.091683 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-sys\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.092087 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.092060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-podres\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.092224 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.092059 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-lib-modules\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.100412 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.100385 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdwgd\" (UniqueName: \"kubernetes.io/projected/0444bb1c-9e87-47eb-bf7d-8a53ca2a4454-kube-api-access-rdwgd\") pod \"perf-node-gather-daemonset-92zjk\" (UID: \"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454\") " pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.273182 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.273141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.458245 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.458214 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk"] Jul 01 21:10:41.461726 ip-10-0-129-25 kubenswrapper[2562]: W0701 21:10:41.461702 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0444bb1c_9e87_47eb_bf7d_8a53ca2a4454.slice/crio-6ca2344e59a4df1c99e87e780162231a9de64b4b2c58f335af960d4a43fbe7eb WatchSource:0}: Error finding container 6ca2344e59a4df1c99e87e780162231a9de64b4b2c58f335af960d4a43fbe7eb: Status 404 returned error can't find the container with id 6ca2344e59a4df1c99e87e780162231a9de64b4b2c58f335af960d4a43fbe7eb Jul 01 21:10:41.708267 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.708224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" event={"ID":"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454","Type":"ContainerStarted","Data":"027c8d92cf5667e181459efe1876c7e5b5946596ced2e45515755ca0dea1fb1d"} Jul 01 21:10:41.708437 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.708292 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" event={"ID":"0444bb1c-9e87-47eb-bf7d-8a53ca2a4454","Type":"ContainerStarted","Data":"6ca2344e59a4df1c99e87e780162231a9de64b4b2c58f335af960d4a43fbe7eb"} Jul 01 21:10:41.708437 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.708329 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:41.726430 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.726382 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" podStartSLOduration=1.726367036 podStartE2EDuration="1.726367036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 21:10:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 21:10:41.725083267 +0000 UTC m=+1452.388157350" watchObservedRunningTime="2026-07-01 21:10:41.726367036 +0000 UTC m=+1452.389441119" Jul 01 21:10:41.813637 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.813604 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8sfd_77eb2e46-7917-4363-bed8-f33f3469be1c/dns/0.log" Jul 01 21:10:41.835839 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.835816 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x8sfd_77eb2e46-7917-4363-bed8-f33f3469be1c/kube-rbac-proxy/0.log" Jul 01 21:10:41.884458 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:41.884427 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x9gsc_1e097ef9-805e-4b23-b57b-8b74ac8ede72/dns-node-resolver/0.log" Jul 01 21:10:42.363587 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:42.363529 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6cf44b5c99-khfv6_7ef2ddb0-c830-4bd5-9382-ac8a282d059f/registry/0.log" Jul 01 21:10:42.435070 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:42.435039 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bk27w_fe82e58f-51df-4cb6-8c7f-855599d57966/node-ca/0.log" Jul 01 21:10:43.213162 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:43.213134 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-58cfc75779-7flpw_4e30d86c-6418-4e88-af26-7934f1156333/router/0.log" Jul 01 21:10:43.612207 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:43.612138 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-96mff_75899a10-8aeb-4575-898a-6323f46a1582/serve-healthcheck-canary/0.log" Jul 01 21:10:43.975059 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:43.975030 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-fnsdn_68955a3f-ae9c-43ce-bb16-370512e1075b/insights-operator/0.log" Jul 01 21:10:43.975279 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:43.975227 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5f67b55555-fnsdn_68955a3f-ae9c-43ce-bb16-370512e1075b/insights-operator/1.log" Jul 01 21:10:44.062259 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:44.062210 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tff4z_4449b3ee-b2a4-4082-b4fe-c73f384e3829/kube-rbac-proxy/0.log" Jul 01 21:10:44.086032 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:44.086010 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tff4z_4449b3ee-b2a4-4082-b4fe-c73f384e3829/exporter/0.log" Jul 01 21:10:44.107511 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:44.107462 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tff4z_4449b3ee-b2a4-4082-b4fe-c73f384e3829/extractor/0.log" Jul 01 21:10:46.212951 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:46.212910 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-67d95fdc48-w9lfz_2ed59c0a-cb65-46df-b21d-0f32059a6e86/manager/0.log" Jul 01 21:10:46.530978 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:46.530899 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-r4h4h_42b711f9-b579-4aa6-9c64-9483187d8210/seaweedfs/0.log" Jul 01 21:10:47.721738 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:47.721709 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ct4wg/perf-node-gather-daemonset-92zjk" Jul 01 21:10:51.758438 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:51.758414 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2rkvx_2c04c508-7598-453b-aaa3-541c09793ff9/kube-multus/0.log" Jul 01 21:10:51.931546 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:51.931521 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdj9r_d68195ee-0a76-4dd3-a690-f6f0f8833221/kube-multus-additional-cni-plugins/0.log" Jul 01 21:10:51.955166 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:51.955143 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdj9r_d68195ee-0a76-4dd3-a690-f6f0f8833221/egress-router-binary-copy/0.log" Jul 01 21:10:51.975551 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:51.975531 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdj9r_d68195ee-0a76-4dd3-a690-f6f0f8833221/cni-plugins/0.log" Jul 01 21:10:51.997541 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:51.997451 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdj9r_d68195ee-0a76-4dd3-a690-f6f0f8833221/bond-cni-plugin/0.log" Jul 01 21:10:52.019749 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:52.019687 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdj9r_d68195ee-0a76-4dd3-a690-f6f0f8833221/routeoverride-cni/0.log" Jul 01 21:10:52.042898 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:52.042869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdj9r_d68195ee-0a76-4dd3-a690-f6f0f8833221/whereabouts-cni-bincopy/0.log" Jul 01 21:10:52.066717 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:52.066694 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-kdj9r_d68195ee-0a76-4dd3-a690-f6f0f8833221/whereabouts-cni/0.log" Jul 01 21:10:52.410021 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:52.409998 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dfms9_61593544-4ffb-4630-af39-740a84a89867/network-metrics-daemon/0.log" Jul 01 21:10:52.433449 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:52.433430 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-dfms9_61593544-4ffb-4630-af39-740a84a89867/kube-rbac-proxy/0.log" Jul 01 21:10:53.372957 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.372927 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-controller/0.log" Jul 01 21:10:53.395534 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.395512 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/1.log" Jul 01 21:10:53.395776 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.395588 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovn-acl-logging/0.log" Jul 01 21:10:53.415572 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.415553 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/kube-rbac-proxy-node/0.log" Jul 01 21:10:53.437132 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.437107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/kube-rbac-proxy-ovn-metrics/0.log" Jul 01 21:10:53.454228 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.454205 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/northd/0.log" Jul 01 21:10:53.475100 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.475084 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/nbdb/0.log" Jul 01 21:10:53.497186 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.497165 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/sbdb/0.log" Jul 01 21:10:53.543915 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:53.543893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-h7bpx_585c90c3-db8e-4c3e-aec5-7064332e682e/ovnkube-controller/0.log" Jul 01 21:10:54.716675 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:54.716641 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-9xq79_342772b3-9eb3-4f40-96ce-ef458a91f7c0/network-check-target-container/0.log" Jul 01 21:10:55.585400 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:55.585367 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rgcd4_89cbe17e-2ec6-49c0-b419-40f82987d3fa/iptables-alerter/0.log" Jul 01 21:10:56.239758 ip-10-0-129-25 kubenswrapper[2562]: I0701 21:10:56.239703 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-wgltw_85654290-0922-4150-a3d2-742fd113fe07/tuned/0.log"