Jul 28 06:52:06.847437 ip-10-0-133-68 systemd[1]: Starting Kubernetes Kubelet... Jul 28 06:52:07.279331 ip-10-0-133-68 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:52:07.279331 ip-10-0-133-68 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 06:52:07.279331 ip-10-0-133-68 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:52:07.279331 ip-10-0-133-68 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 06:52:07.279331 ip-10-0-133-68 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:52:07.281916 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.281680 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289058 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289125 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289133 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289138 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289147 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289158 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289164 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289172 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:52:07.289137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289180 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289187 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289193 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289199 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289205 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289210 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289214 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289219 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289223 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289228 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289233 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289238 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289244 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289248 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289253 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289259 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289264 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289268 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289272 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289276 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:52:07.289916 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289279 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289283 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289287 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289291 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289295 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289299 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289304 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289310 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289316 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289325 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289331 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289336 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289341 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289347 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289354 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289360 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289365 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289371 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289378 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289383 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:52:07.290830 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289388 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289392 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289398 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289406 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289412 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289419 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289424 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289428 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289433 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289437 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289444 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289449 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289456 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289461 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289467 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289472 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289477 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289483 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289488 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:52:07.291889 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289493 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289500 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289504 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289509 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289515 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289519 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289526 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289532 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289537 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289541 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289547 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289553 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289559 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289564 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289569 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289576 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289584 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289589 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289594 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:52:07.292737 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289599 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289605 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289610 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289615 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289621 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289627 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289633 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289639 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289643 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289650 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289655 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289660 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.289667 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291423 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291458 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291467 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291473 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291481 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291487 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:52:07.293655 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291495 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291503 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291509 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291517 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291524 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291530 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291536 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291541 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291547 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291553 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291559 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291567 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291575 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291583 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291589 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291594 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291599 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291605 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291610 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291614 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:52:07.294723 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291619 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291625 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291630 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291636 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291641 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291649 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291654 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291663 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291669 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291674 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291680 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291685 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291725 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291732 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291737 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291742 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291747 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291753 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291758 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291765 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291769 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:52:07.295820 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291775 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291782 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291787 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291796 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291801 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291806 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291811 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291817 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291824 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291829 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291834 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291840 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291844 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291849 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291854 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291858 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291865 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291870 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291875 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:52:07.296594 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291881 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291886 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291892 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291897 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291903 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291910 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291915 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291919 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291924 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291928 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291936 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291941 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291948 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291953 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291959 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291963 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291969 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291978 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291983 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291989 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:52:07.297325 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291994 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.291999 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292005 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292010 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292014 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292019 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292025 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292032 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292037 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292043 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292049 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292054 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.292060 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293087 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293105 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293116 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293127 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293134 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293140 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293145 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:52:07.298018 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293151 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293156 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293161 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293167 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293172 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293177 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293182 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293187 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293194 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293201 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293207 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293213 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293218 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293223 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293228 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293233 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293238 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293243 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293247 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293253 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:52:07.298879 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293258 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293265 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293271 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293276 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293281 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293286 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293291 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293295 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293301 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293305 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293310 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293316 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293321 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293326 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293331 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293335 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293340 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293344 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293350 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293355 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293360 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:52:07.299963 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293364 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293371 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293376 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293381 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293386 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293390 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293397 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293404 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293409 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293415 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293419 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293428 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293444 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293450 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293456 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293462 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293466 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293471 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293476 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:52:07.300590 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293481 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293487 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293492 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293497 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293502 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293508 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293513 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293517 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293521 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293526 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293531 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293536 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293542 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293547 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293552 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293560 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293564 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293569 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293574 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:52:07.301273 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293577 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293583 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293587 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293592 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293596 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293600 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293608 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293617 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293623 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293628 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293632 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293637 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.293642 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293864 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293885 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293900 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293908 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293920 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293932 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293950 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293965 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 06:52:07.302035 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293972 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293979 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293987 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.293994 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294000 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294007 2562 flags.go:64] FLAG: --cgroup-root="" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294013 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294020 2562 flags.go:64] FLAG: --client-ca-file="" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294029 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294036 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294211 2562 flags.go:64] FLAG: --cluster-domain="" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294218 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294225 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294233 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294241 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294250 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294256 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294263 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294270 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294278 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294285 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294292 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294299 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294305 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 06:52:07.302711 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294321 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294328 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294334 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294340 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294346 2562 flags.go:64] FLAG: --enable-server="true" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294352 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294361 2562 flags.go:64] FLAG: --event-burst="100" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294367 2562 flags.go:64] FLAG: --event-qps="50" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294372 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294380 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294385 2562 flags.go:64] FLAG: --eviction-hard="" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294395 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294402 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294409 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294420 2562 flags.go:64] FLAG: --eviction-soft="" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294426 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294433 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294440 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294446 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294453 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294459 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294464 2562 flags.go:64] FLAG: --feature-gates="" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294472 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294493 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294499 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 06:52:07.303424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294506 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294514 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294520 2562 flags.go:64] FLAG: --help="false" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294527 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294533 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294539 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294544 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294558 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294566 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294572 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294578 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294584 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294589 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294595 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294600 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294606 2562 flags.go:64] FLAG: --kube-reserved="" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294613 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294618 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294623 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294629 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294635 2562 flags.go:64] FLAG: --lock-file="" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294641 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294647 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294653 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 06:52:07.304349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294668 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294676 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294683 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294714 2562 flags.go:64] FLAG: --logging-format="text" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294722 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294729 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294735 2562 flags.go:64] FLAG: --manifest-url="" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294740 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294752 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294759 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294768 2562 flags.go:64] FLAG: --max-pods="110" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294774 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294781 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294788 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294793 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294804 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294810 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294816 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294839 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294845 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294851 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294857 2562 flags.go:64] FLAG: --pod-cidr="" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294863 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 06:52:07.305128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294880 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294885 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294893 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294899 2562 flags.go:64] FLAG: --port="10250" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294906 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294912 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01ab5f1ddfd9a9a5d" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294920 2562 flags.go:64] FLAG: --qos-reserved="" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294926 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294933 2562 flags.go:64] FLAG: --register-node="true" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294976 2562 flags.go:64] FLAG: --register-with-taints="" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294988 2562 flags.go:64] FLAG: --registry-burst="10" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.294997 2562 flags.go:64] FLAG: --registry-qps="5" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295003 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295009 2562 flags.go:64] FLAG: --reserved-memory="" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295017 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295024 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295030 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295036 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295044 2562 flags.go:64] FLAG: --runonce="false" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295049 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295057 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295062 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295068 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295074 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295082 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295093 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 06:52:07.305846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295100 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295105 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295115 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295121 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295128 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295135 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295142 2562 flags.go:64] FLAG: --system-cgroups="" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295147 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295159 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295166 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295172 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295185 2562 flags.go:64] FLAG: --tls-min-version="" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295192 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295199 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295204 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295210 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295218 2562 flags.go:64] FLAG: --v="2" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295226 2562 flags.go:64] FLAG: --version="false" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295237 2562 flags.go:64] FLAG: --vmodule="" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295247 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.295254 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295555 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295566 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295579 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:52:07.306632 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295586 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295594 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295600 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295605 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295611 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295619 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295626 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295634 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295641 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295647 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295652 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295658 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295663 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295668 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295673 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295678 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295682 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295687 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295724 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:52:07.307542 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295730 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295735 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295741 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295746 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295752 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295757 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295762 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295768 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295775 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295781 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295786 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295791 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295802 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295807 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295813 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295817 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295822 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295828 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295833 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295838 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:52:07.308186 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295849 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295854 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295859 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295864 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295869 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295873 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295879 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295884 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295890 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295895 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295902 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295907 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295912 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295916 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295921 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295925 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295930 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295935 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295941 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295945 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:52:07.308919 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295950 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295957 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295962 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295967 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295978 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295984 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295992 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.295998 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296004 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296011 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296017 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296022 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296031 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296036 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296041 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296046 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296051 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296057 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296062 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:52:07.309605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296068 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296074 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296078 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296083 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296088 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296093 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296098 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296102 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296107 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296112 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296118 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296123 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296128 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296132 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296137 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296143 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296149 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:52:07.310935 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.296157 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.296855 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.309801 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.309845 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.310495 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.310508 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310621 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310655 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310660 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310667 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310672 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310676 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310680 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310684 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:52:07.311433 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310688 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310693 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310700 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310705 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310710 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310714 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310719 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310723 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310726 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310729 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310732 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310736 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310738 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310742 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310745 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310748 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310754 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310760 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310762 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310767 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:52:07.311930 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310773 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310776 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310780 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310783 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310786 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310790 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310793 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310796 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310799 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310803 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310806 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310809 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310812 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310816 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310819 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310823 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310827 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310830 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310833 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310835 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310838 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:52:07.312534 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310842 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310846 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310848 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310851 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310855 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310858 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310861 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310863 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310867 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310869 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310874 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310881 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310888 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310894 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310899 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310903 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310907 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310911 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310914 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:52:07.313221 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310919 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310922 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310924 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310928 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310931 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310934 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310938 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310941 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310945 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310949 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310952 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310955 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310959 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310964 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310968 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310973 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310978 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310980 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310984 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:52:07.314112 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310988 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310991 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.310994 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311000 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311003 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311006 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311011 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311014 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311018 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311022 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311025 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311029 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.311038 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311227 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311238 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:52:07.314682 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311242 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311246 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311250 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311253 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311257 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311261 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311265 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311267 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311270 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311273 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311276 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311279 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311282 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311284 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311287 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311290 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311295 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311301 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311305 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311308 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:52:07.315156 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311312 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311326 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311331 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311335 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311339 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311342 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311345 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311349 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311352 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311356 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311359 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311361 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311364 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311367 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311370 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311372 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311376 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311379 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311382 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:52:07.315802 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311386 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311389 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311391 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311394 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311397 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311401 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311404 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311407 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311411 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311414 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311417 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311420 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311425 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311427 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311431 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311436 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311440 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311443 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311447 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311450 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:52:07.316375 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311454 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311458 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311461 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311466 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311469 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311473 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311477 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311480 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311483 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311486 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311488 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311491 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311494 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311497 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311499 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311503 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311507 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311510 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311513 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311516 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:52:07.316997 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311519 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311522 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311525 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311528 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311531 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311534 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311539 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311543 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311548 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311553 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311556 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311559 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311562 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311567 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311570 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311573 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311575 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:52:07.317604 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:07.311578 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:52:07.318349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.311586 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:52:07.318349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.311897 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 06:52:07.318349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.316893 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 06:52:07.318636 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.318608 2562 server.go:1019] "Starting client certificate rotation" Jul 28 06:52:07.318806 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.318766 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 06:52:07.318901 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.318869 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 06:52:07.321686 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.321643 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 06:52:07.330720 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.330565 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 06:52:07.347005 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.346940 2562 log.go:25] "Validated CRI v1 runtime API" Jul 28 06:52:07.352430 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.352374 2562 log.go:25] "Validated CRI v1 image API" Jul 28 06:52:07.354010 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.353974 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 06:52:07.356615 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.356572 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 06:52:07.358151 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.358098 2562 fs.go:135] Filesystem UUIDs: map[0891304c-96ac-43b4-bdcd-365900cb1f3e:/dev/nvme0n1p3 2f8ce05a-f0c0-41a9-a50c-ae7f287db0ab:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 28 06:52:07.358383 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.358151 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 06:52:07.366155 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.365863 2562 manager.go:216] Machine: {Timestamp:2026-07-28 06:52:07.364150315 +0000 UTC m=+0.370200413 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099683 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29b8730b542e14d14b70d55c391731 SystemUUID:ec29b873-0b54-2e14-d14b-70d55c391731 BootID:d591c117-17ee-473e-a57f-d772f4d3bfac Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:13:93:4f:75:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:13:93:4f:75:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:e3:25:cc:e8:3c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 06:52:07.366155 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.366096 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 06:52:07.366563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.366375 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 06:52:07.370160 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.370071 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 06:52:07.370470 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.370164 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-68.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 06:52:07.371125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.371105 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 06:52:07.371182 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.371130 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 06:52:07.371182 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.371154 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 06:52:07.371867 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.371846 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 06:52:07.373106 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.373081 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 06:52:07.376832 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.376793 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 28 06:52:07.377033 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.376992 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vmqjf" Jul 28 06:52:07.377076 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.377066 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 06:52:07.377132 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.377122 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 28 06:52:07.377166 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.377143 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 06:52:07.377227 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.377179 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 06:52:07.377227 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.377198 2562 kubelet.go:398] "Adding apiserver pod source" Jul 28 06:52:07.377227 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.377217 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 06:52:07.378155 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.378134 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 06:52:07.378280 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.378248 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 06:52:07.381025 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.380991 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 06:52:07.384306 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.384278 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 06:52:07.384473 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.384318 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 06:52:07.386313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386279 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 06:52:07.386313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386313 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 06:52:07.386313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386324 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386334 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386350 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386359 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386390 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386398 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386408 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386417 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386443 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 06:52:07.386563 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.386452 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 06:52:07.387214 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.387201 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 06:52:07.387214 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.387216 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 06:52:07.388642 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.388589 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 06:52:07.388786 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.388638 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-68.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 06:52:07.389564 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.389541 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vmqjf" Jul 28 06:52:07.392062 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.392006 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-68.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 06:52:07.396148 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.396112 2562 server.go:1268] "Started kubelet" Jul 28 06:52:07.396334 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.396215 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 06:52:07.396397 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.396279 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 06:52:07.396446 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.396414 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 06:52:07.398352 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.398324 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 28 06:52:07.398772 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.398744 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 06:52:07.399179 ip-10-0-133-68 systemd[1]: Started Kubernetes Kubelet. Jul 28 06:52:07.404519 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.404462 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 06:52:07.408387 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.408329 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 06:52:07.408603 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.408353 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 06:52:07.408675 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.408568 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:07.409521 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.409243 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 06:52:07.409521 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.409270 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 06:52:07.409521 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.409308 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 06:52:07.410112 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.410093 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 28 06:52:07.410185 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.410114 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 28 06:52:07.411313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.411277 2562 factory.go:153] Registering CRI-O factory Jul 28 06:52:07.411313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.411311 2562 factory.go:223] Registration of the crio container factory successfully Jul 28 06:52:07.411493 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.411421 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 06:52:07.411493 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.411438 2562 factory.go:55] Registering systemd factory Jul 28 06:52:07.411493 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.411450 2562 factory.go:223] Registration of the systemd container factory successfully Jul 28 06:52:07.411639 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.411501 2562 factory.go:103] Registering Raw factory Jul 28 06:52:07.411639 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.411524 2562 manager.go:1196] Started watching for new ooms in manager Jul 28 06:52:07.411752 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.411647 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:52:07.412402 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.412377 2562 manager.go:349] Starting recovery of all containers Jul 28 06:52:07.415707 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.415636 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-68.ec2.internal\" not found" node="ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.424592 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.424516 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 06:52:07.430036 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.429983 2562 manager.go:354] Recovery completed Jul 28 06:52:07.436549 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.436475 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 28 06:52:07.442316 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.442275 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:52:07.446985 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.446936 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:52:07.447288 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.447013 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:52:07.447288 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.447037 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:52:07.448257 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.448217 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 06:52:07.448257 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.448253 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 06:52:07.448502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.448233 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:52:07.448502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.448309 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 28 06:52:07.449734 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.449704 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:52:07.449831 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.449753 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:52:07.449831 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.449769 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:52:07.451883 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.451855 2562 policy_none.go:49] "None policy: Start" Jul 28 06:52:07.451951 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.451904 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 06:52:07.451951 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.451929 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 06:52:07.454475 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.454445 2562 policy_none.go:47] "Start" Jul 28 06:52:07.509130 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.509072 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:07.511973 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.511947 2562 manager.go:337] "Starting Device Plugin manager" Jul 28 06:52:07.512138 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.512042 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 06:52:07.512138 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.512069 2562 server.go:87] "Starting device plugin registration server" Jul 28 06:52:07.512763 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.512744 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 06:52:07.512827 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.512769 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 06:52:07.512982 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.512956 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 06:52:07.513197 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.513173 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 06:52:07.513197 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.513190 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 06:52:07.514176 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.514138 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 06:52:07.514367 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.514228 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:07.613062 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.612970 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:52:07.615814 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.615069 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:52:07.615814 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.615139 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:52:07.615814 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.615171 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:52:07.615814 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.615262 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.625769 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.625685 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.626063 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.625792 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-68.ec2.internal\": node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:07.643109 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.643039 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:07.660331 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.660269 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 06:52:07.660590 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.660363 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 06:52:07.660590 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.660414 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 06:52:07.660730 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.660582 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 06:52:07.663313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.663204 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:52:07.745098 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.744972 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:07.761462 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.761381 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal"] Jul 28 06:52:07.761773 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.761634 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:52:07.764500 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.764462 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:52:07.764743 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.764524 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:52:07.764743 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.764546 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:52:07.767519 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.767489 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:52:07.767752 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.767721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.767846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.767792 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:52:07.769051 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.769014 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:52:07.769174 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.769058 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:52:07.769174 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.769071 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:52:07.769174 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.769014 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:52:07.769174 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.769156 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:52:07.769174 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.769173 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:52:07.771880 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.771839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.771880 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.771888 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:52:07.773410 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.773379 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:52:07.773549 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.773427 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:52:07.773549 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.773443 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:52:07.800246 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.800199 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-68.ec2.internal\" not found" node="ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.807927 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.807888 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-68.ec2.internal\" not found" node="ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.812144 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.812100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/652ec2025569d089187b9f40ad489f57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal\" (UID: \"652ec2025569d089187b9f40ad489f57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.812285 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.812162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/652ec2025569d089187b9f40ad489f57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal\" (UID: \"652ec2025569d089187b9f40ad489f57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.812285 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.812201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47b82ae00a4e61d8c8286ec65e9c9c5f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-68.ec2.internal\" (UID: \"47b82ae00a4e61d8c8286ec65e9c9c5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.846139 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.846046 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:07.913646 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.913454 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/652ec2025569d089187b9f40ad489f57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal\" (UID: \"652ec2025569d089187b9f40ad489f57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.913646 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.913538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47b82ae00a4e61d8c8286ec65e9c9c5f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-68.ec2.internal\" (UID: \"47b82ae00a4e61d8c8286ec65e9c9c5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.913646 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.913558 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/652ec2025569d089187b9f40ad489f57-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal\" (UID: \"652ec2025569d089187b9f40ad489f57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.913646 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.913581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/652ec2025569d089187b9f40ad489f57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal\" (UID: \"652ec2025569d089187b9f40ad489f57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.913646 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.913624 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/652ec2025569d089187b9f40ad489f57-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal\" (UID: \"652ec2025569d089187b9f40ad489f57\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.914046 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:07.913603 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/47b82ae00a4e61d8c8286ec65e9c9c5f-config\") pod \"kube-apiserver-proxy-ip-10-0-133-68.ec2.internal\" (UID: \"47b82ae00a4e61d8c8286ec65e9c9c5f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" Jul 28 06:52:07.948224 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:07.948142 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:08.050493 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:08.050385 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:08.107015 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.106947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:08.112438 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.112399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" Jul 28 06:52:08.151378 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:08.151279 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:08.253726 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:08.253486 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:08.318542 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.318094 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 06:52:08.319890 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.318830 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 06:52:08.319890 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.318831 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 06:52:08.355546 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:08.355473 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:08.398214 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.398136 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 06:47:08 +0000 UTC" deadline="2027-12-30 08:03:37.12582788 +0000 UTC" Jul 28 06:52:08.398214 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.398205 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12481h11m28.72763039s" Jul 28 06:52:08.411911 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.411847 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:52:08.455979 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:08.455915 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:08.557974 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:08.557897 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-68.ec2.internal\" not found" Jul 28 06:52:08.645389 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.645322 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:52:08.709773 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.709684 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" Jul 28 06:52:08.722084 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.722023 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 06:52:08.723264 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.723234 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" Jul 28 06:52:08.730229 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.730194 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 06:52:08.990137 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:08.990060 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652ec2025569d089187b9f40ad489f57.slice/crio-352c3a9e59259245c33af352e88cbb8c5bf5000a2d237513c164caec32fe49f5 WatchSource:0}: Error finding container 352c3a9e59259245c33af352e88cbb8c5bf5000a2d237513c164caec32fe49f5: Status 404 returned error can't find the container with id 352c3a9e59259245c33af352e88cbb8c5bf5000a2d237513c164caec32fe49f5 Jul 28 06:52:08.993857 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:08.993804 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b82ae00a4e61d8c8286ec65e9c9c5f.slice/crio-092099a011b25f1d5f9286a26a0e1da1b5fce12eb7693cc4c56e9e4598f424c1 WatchSource:0}: Error finding container 092099a011b25f1d5f9286a26a0e1da1b5fce12eb7693cc4c56e9e4598f424c1: Status 404 returned error can't find the container with id 092099a011b25f1d5f9286a26a0e1da1b5fce12eb7693cc4c56e9e4598f424c1 Jul 28 06:52:08.999507 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:08.999466 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 06:52:09.195674 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.195439 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:52:09.321656 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.321580 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:52:09.381598 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.381508 2562 apiserver.go:52] "Watching apiserver" Jul 28 06:52:09.390413 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.390346 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 06:52:09.391837 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.391765 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-5tlwf","kube-system/konnectivity-agent-67zqj","kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal","openshift-dns/node-resolver-gncth","openshift-image-registry/node-ca-wgq6z","openshift-multus/multus-82zfm","openshift-multus/multus-additional-cni-plugins-mlq4v","openshift-multus/network-metrics-daemon-6rm99","openshift-network-operator/iptables-alerter-c6sdc","kube-system/global-pull-secret-syncer-8mldq","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6","openshift-cluster-node-tuning-operator/tuned-lqdws","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal","openshift-network-diagnostics/network-check-target-7hjb9"] Jul 28 06:52:09.396778 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.396739 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.399860 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.399802 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 06:52:09.400149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.399802 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 06:52:09.400149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.399902 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 06:52:09.400149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.399803 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 06:52:09.400149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.399965 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5p9d5\"" Jul 28 06:52:09.400149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.399802 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 06:52:09.400634 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.400607 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.403032 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.403003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 06:52:09.403425 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.403372 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 06:52:09.403587 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.403427 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 06:52:09.403587 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.403573 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nskwg\"" Jul 28 06:52:09.403783 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.403761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:09.403930 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.403893 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:09.406487 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.406455 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.409076 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.409043 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 06:52:09.409376 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.409342 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.409914 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.409887 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jzx2n\"" Jul 28 06:52:09.410027 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.410000 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 06:52:09.410144 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.410126 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 06:52:09.411818 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.411790 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 06:52:09.411935 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.411903 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6fvzw\"" Jul 28 06:52:09.411935 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.411903 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 06:52:09.412179 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.412162 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.412538 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.412520 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 06:52:09.414490 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.414457 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 06:52:09.414739 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.414527 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rdsnw\"" Jul 28 06:52:09.415036 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.415014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.417736 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.417680 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 06:52:09.417922 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.417740 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:52:09.417922 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.417744 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 06:52:09.418053 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.417928 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fz4ds\"" Jul 28 06:52:09.418122 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.418098 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:09.418251 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.418224 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:09.421242 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421204 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:09.421696 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-socket-dir-parent\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.421871 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421707 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:09.421871 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421737 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-cnibin\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.421871 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-etc-kubernetes\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.421871 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-cnibin\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.421871 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.422094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421890 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-sys-fs\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.422094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.421979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-cni-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.422094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-kubelet\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.422998 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-multus-certs\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.422998 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t5wz\" (UniqueName: \"kubernetes.io/projected/9e288cb7-b593-40f4-b3cd-1a538587ffa0-kube-api-access-9t5wz\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.422998 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422706 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a84a191d-0b3a-460e-99fd-8cdba90483da-hosts-file\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.422998 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-cni-multus\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.422998 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-conf-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.422998 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-daemon-config\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.422998 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrw7s\" (UniqueName: \"kubernetes.io/projected/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-kube-api-access-mrw7s\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.422998 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.422997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-system-cni-dir\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-os-release\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-system-cni-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lpp9\" (UniqueName: \"kubernetes.io/projected/7a2220dc-5fbf-426c-8381-1af8a67762c5-kube-api-access-9lpp9\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-socket-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-device-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-os-release\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-hostroot\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.423502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b91febb1-5d61-4ade-9023-1e65088aabcb-serviceca\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-cni-binary-copy\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423560 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-cni-bin\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423636 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a84a191d-0b3a-460e-99fd-8cdba90483da-tmp-dir\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423779 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tstm\" (UniqueName: \"kubernetes.io/projected/a84a191d-0b3a-460e-99fd-8cdba90483da-kube-api-access-5tstm\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b91febb1-5d61-4ade-9023-1e65088aabcb-host\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9k4x\" (UniqueName: \"kubernetes.io/projected/b91febb1-5d61-4ade-9023-1e65088aabcb-kube-api-access-b9k4x\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-k8s-cni-cncf-io\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423918 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-netns\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.423967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.424077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.424005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-registration-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.426778 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.425623 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 06:52:09.426778 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.426140 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 06:52:09.426778 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.426360 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rx4fx\"" Jul 28 06:52:09.427170 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.426828 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 06:52:09.429001 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.428957 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.429248 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.429094 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:09.432939 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.432879 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.436015 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.435964 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 06:52:09.436306 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.435964 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 06:52:09.436306 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.436114 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 06:52:09.436306 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.436184 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 06:52:09.436958 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.436931 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 06:52:09.437132 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.436939 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 06:52:09.437132 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.437044 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qz4fg\"" Jul 28 06:52:09.438003 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.437955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.440677 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.440634 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 06:52:09.440677 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.440634 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:52:09.440677 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.440748 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bdwpw\"" Jul 28 06:52:09.448018 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.447833 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-msdb8" Jul 28 06:52:09.453589 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.453538 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-msdb8" Jul 28 06:52:09.510541 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.510474 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 06:52:09.524698 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.524648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-cni-multus\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.524698 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.524697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-conf-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.525125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.524777 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-conf-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.525125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.524782 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-cni-multus\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.525125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.524836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-daemon-config\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.525125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.524871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrw7s\" (UniqueName: \"kubernetes.io/projected/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-kube-api-access-mrw7s\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.525125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.524908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-system-cni-dir\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.525125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.524955 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-system-cni-dir\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.525125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lpp9\" (UniqueName: \"kubernetes.io/projected/7a2220dc-5fbf-426c-8381-1af8a67762c5-kube-api-access-9lpp9\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-device-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525183 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-kubelet-config\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-run-netns\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-var-lib-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-ovn\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-log-socket\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525322 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-device-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b91febb1-5d61-4ade-9023-1e65088aabcb-serviceca\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdec0f28-53c4-4c84-89a3-f9977886c34a-iptables-alerter-script\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.525514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5h2c\" (UniqueName: \"kubernetes.io/projected/535aec0a-57dd-45d7-9efd-d89e9019edc4-kube-api-access-l5h2c\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525555 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysctl-d\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a84a191d-0b3a-460e-99fd-8cdba90483da-tmp-dir\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525595 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525639 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tstm\" (UniqueName: \"kubernetes.io/projected/a84a191d-0b3a-460e-99fd-8cdba90483da-kube-api-access-5tstm\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9k4x\" (UniqueName: \"kubernetes.io/projected/b91febb1-5d61-4ade-9023-1e65088aabcb-kube-api-access-b9k4x\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525882 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysconfig\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525911 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-systemd\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-registration-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.525997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-dbus\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526051 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a84a191d-0b3a-460e-99fd-8cdba90483da-tmp-dir\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526057 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-daemon-config\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj4vz\" (UniqueName: \"kubernetes.io/projected/310c1d11-4f82-4d27-8a3e-1ddffae546c4-kube-api-access-vj4vz\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-lib-modules\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526214 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b09f7e56-0c1c-44e4-8397-c739ab48d145-tmp\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.526360 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526275 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-socket-dir-parent\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526329 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-cnibin\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526396 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-socket-dir-parent\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526406 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-registration-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-sys-fs\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-env-overrides\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cg5t\" (UniqueName: \"kubernetes.io/projected/b09f7e56-0c1c-44e4-8397-c739ab48d145-kube-api-access-6cg5t\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526466 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-cnibin\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526556 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-sys-fs\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526571 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-kubelet\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526468 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-etc-selinux\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t5wz\" (UniqueName: \"kubernetes.io/projected/9e288cb7-b593-40f4-b3cd-1a538587ffa0-kube-api-access-9t5wz\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-slash\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-os-release\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526677 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-kubelet\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.527245 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-socket-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-kubelet\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526737 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b91febb1-5d61-4ade-9023-1e65088aabcb-serviceca\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526794 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a2220dc-5fbf-426c-8381-1af8a67762c5-os-release\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-cni-bin\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovnkube-script-lib\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-system-cni-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-systemd\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526921 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-socket-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovn-node-metrics-cert\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526964 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-system-cni-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.526979 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-kubernetes\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-run\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-var-lib-kubelet\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-host\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-os-release\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.528322 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-hostroot\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-os-release\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dzk9\" (UniqueName: \"kubernetes.io/projected/bdec0f28-53c4-4c84-89a3-f9977886c34a-kube-api-access-7dzk9\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527315 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-hostroot\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527326 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20eb01e7-c7ef-47e7-85bc-e11eeac203c7-konnectivity-ca\") pod \"konnectivity-agent-67zqj\" (UID: \"20eb01e7-c7ef-47e7-85bc-e11eeac203c7\") " pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527372 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-cni-binary-copy\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527413 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-cni-bin\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527539 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b91febb1-5d61-4ade-9023-1e65088aabcb-host\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527571 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-var-lib-cni-bin\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-node-log\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527706 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b91febb1-5d61-4ade-9023-1e65088aabcb-host\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528028 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528175 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-cni-binary-copy\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528263 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a2220dc-5fbf-426c-8381-1af8a67762c5-cni-binary-copy\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.527663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-cni-netd\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-k8s-cni-cncf-io\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-netns\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528473 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-k8s-cni-cncf-io\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528479 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-netns\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528501 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovnkube-config\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528577 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysctl-conf\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-sys\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528630 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-tuned\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdec0f28-53c4-4c84-89a3-f9977886c34a-host-slash\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528659 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e288cb7-b593-40f4-b3cd-1a538587ffa0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20eb01e7-c7ef-47e7-85bc-e11eeac203c7-agent-certs\") pod \"konnectivity-agent-67zqj\" (UID: \"20eb01e7-c7ef-47e7-85bc-e11eeac203c7\") " pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528763 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-modprobe-d\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.529725 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-cnibin\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-etc-kubernetes\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-etc-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528949 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-cnibin\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.528969 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-etc-kubernetes\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.529026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-cni-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.529088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-multus-certs\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.529124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a84a191d-0b3a-460e-99fd-8cdba90483da-hosts-file\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.529132 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-host-run-multus-certs\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.529093 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-multus-cni-dir\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.529173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-systemd-units\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.530274 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.529189 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a84a191d-0b3a-460e-99fd-8cdba90483da-hosts-file\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.536973 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.536922 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:09.536973 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.536976 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:09.537194 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.536999 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jqhv2 for pod openshift-network-diagnostics/network-check-target-7hjb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:09.537194 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.537125 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2 podName:bd09714f-2381-4958-8a10-f5068fdd3371 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:10.037088589 +0000 UTC m=+3.043138677 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jqhv2" (UniqueName: "kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2") pod "network-check-target-7hjb9" (UID: "bd09714f-2381-4958-8a10-f5068fdd3371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:09.537509 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.537419 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 06:52:09.544462 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.544409 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrw7s\" (UniqueName: \"kubernetes.io/projected/dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6-kube-api-access-mrw7s\") pod \"multus-82zfm\" (UID: \"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6\") " pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.544742 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.544410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t5wz\" (UniqueName: \"kubernetes.io/projected/9e288cb7-b593-40f4-b3cd-1a538587ffa0-kube-api-access-9t5wz\") pod \"aws-ebs-csi-driver-node-cknw6\" (UID: \"9e288cb7-b593-40f4-b3cd-1a538587ffa0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.544742 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.544408 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9k4x\" (UniqueName: \"kubernetes.io/projected/b91febb1-5d61-4ade-9023-1e65088aabcb-kube-api-access-b9k4x\") pod \"node-ca-wgq6z\" (UID: \"b91febb1-5d61-4ade-9023-1e65088aabcb\") " pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.544742 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.544410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lpp9\" (UniqueName: \"kubernetes.io/projected/7a2220dc-5fbf-426c-8381-1af8a67762c5-kube-api-access-9lpp9\") pod \"multus-additional-cni-plugins-mlq4v\" (UID: \"7a2220dc-5fbf-426c-8381-1af8a67762c5\") " pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.544742 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.544410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tstm\" (UniqueName: \"kubernetes.io/projected/a84a191d-0b3a-460e-99fd-8cdba90483da-kube-api-access-5tstm\") pod \"node-resolver-gncth\" (UID: \"a84a191d-0b3a-460e-99fd-8cdba90483da\") " pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.630804 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.630718 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-env-overrides\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.630804 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.630824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cg5t\" (UniqueName: \"kubernetes.io/projected/b09f7e56-0c1c-44e4-8397-c739ab48d145-kube-api-access-6cg5t\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.631302 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.630875 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-slash\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.631302 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.630959 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-slash\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.631990 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.631951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-kubelet\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632093 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632022 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-cni-bin\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632093 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovnkube-script-lib\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632207 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-systemd\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632207 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovn-node-metrics-cert\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632207 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-kubernetes\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.632207 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632174 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-systemd\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632408 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632204 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-cni-bin\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632408 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-run\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.632408 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632107 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-kubelet\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632408 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632253 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-run\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.632620 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632454 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-kubernetes\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.632620 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632503 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-var-lib-kubelet\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.632620 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-host\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.632620 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dzk9\" (UniqueName: \"kubernetes.io/projected/bdec0f28-53c4-4c84-89a3-f9977886c34a-kube-api-access-7dzk9\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.632620 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632604 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20eb01e7-c7ef-47e7-85bc-e11eeac203c7-konnectivity-ca\") pod \"konnectivity-agent-67zqj\" (UID: \"20eb01e7-c7ef-47e7-85bc-e11eeac203c7\") " pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:09.632885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.632885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-node-log\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-cni-netd\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovnkube-config\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632794 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-env-overrides\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.632885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysctl-conf\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.632885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-sys\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.632885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-tuned\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdec0f28-53c4-4c84-89a3-f9977886c34a-host-slash\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20eb01e7-c7ef-47e7-85bc-e11eeac203c7-agent-certs\") pod \"konnectivity-agent-67zqj\" (UID: \"20eb01e7-c7ef-47e7-85bc-e11eeac203c7\") " pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.632968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.632976 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633003 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovnkube-script-lib\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633079 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bdec0f28-53c4-4c84-89a3-f9977886c34a-host-slash\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.633098 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret podName:dd78624f-cc1b-4b09-82a4-35c3ddbdb20b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:10.133060132 +0000 UTC m=+3.139110220 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret") pod "global-pull-secret-syncer-8mldq" (UID: "dd78624f-cc1b-4b09-82a4-35c3ddbdb20b") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633088 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-sys\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633198 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-host\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.633228 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633211 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-modprobe-d\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-etc-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633277 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysctl-conf\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-systemd-units\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633345 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-systemd-units\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633161 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-var-lib-kubelet\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-kubelet-config\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-run-netns\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-var-lib-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633503 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-ovn\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633524 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-modprobe-d\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-log-socket\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633569 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-etc-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdec0f28-53c4-4c84-89a3-f9977886c34a-iptables-alerter-script\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5h2c\" (UniqueName: \"kubernetes.io/projected/535aec0a-57dd-45d7-9efd-d89e9019edc4-kube-api-access-l5h2c\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633637 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-kubelet-config\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysctl-d\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.633838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633688 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-node-log\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633770 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysconfig\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633798 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-systemd\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633859 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-cni-netd\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-dbus\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633880 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-run-netns\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633916 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633957 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-var-lib-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633962 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj4vz\" (UniqueName: \"kubernetes.io/projected/310c1d11-4f82-4d27-8a3e-1ddffae546c4-kube-api-access-vj4vz\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634012 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-lib-modules\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b09f7e56-0c1c-44e4-8397-c739ab48d145-tmp\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634205 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-dbus\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634230 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/20eb01e7-c7ef-47e7-85bc-e11eeac203c7-konnectivity-ca\") pod \"konnectivity-agent-67zqj\" (UID: \"20eb01e7-c7ef-47e7-85bc-e11eeac203c7\") " pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634421 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovnkube-config\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.634978 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634500 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-ovn\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.636123 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634587 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysctl-d\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.636123 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634658 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-lib-modules\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.636123 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634661 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-sysconfig\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.636123 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.633825 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-log-socket\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.636123 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634734 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/310c1d11-4f82-4d27-8a3e-1ddffae546c4-run-openvswitch\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.636123 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.634721 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-systemd\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.636123 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.634823 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:09.636123 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:09.634923 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:10.134895597 +0000 UTC m=+3.140945682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:09.637264 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.637226 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bdec0f28-53c4-4c84-89a3-f9977886c34a-iptables-alerter-script\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.637564 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.637526 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b09f7e56-0c1c-44e4-8397-c739ab48d145-etc-tuned\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.637822 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.637787 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/20eb01e7-c7ef-47e7-85bc-e11eeac203c7-agent-certs\") pod \"konnectivity-agent-67zqj\" (UID: \"20eb01e7-c7ef-47e7-85bc-e11eeac203c7\") " pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:09.640574 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.640529 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/310c1d11-4f82-4d27-8a3e-1ddffae546c4-ovn-node-metrics-cert\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.644358 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.644298 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cg5t\" (UniqueName: \"kubernetes.io/projected/b09f7e56-0c1c-44e4-8397-c739ab48d145-kube-api-access-6cg5t\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.645464 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.645427 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj4vz\" (UniqueName: \"kubernetes.io/projected/310c1d11-4f82-4d27-8a3e-1ddffae546c4-kube-api-access-vj4vz\") pod \"ovnkube-node-5tlwf\" (UID: \"310c1d11-4f82-4d27-8a3e-1ddffae546c4\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.645876 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.645849 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b09f7e56-0c1c-44e4-8397-c739ab48d145-tmp\") pod \"tuned-lqdws\" (UID: \"b09f7e56-0c1c-44e4-8397-c739ab48d145\") " pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.646218 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.646187 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dzk9\" (UniqueName: \"kubernetes.io/projected/bdec0f28-53c4-4c84-89a3-f9977886c34a-kube-api-access-7dzk9\") pod \"iptables-alerter-c6sdc\" (UID: \"bdec0f28-53c4-4c84-89a3-f9977886c34a\") " pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.648163 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.648090 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5h2c\" (UniqueName: \"kubernetes.io/projected/535aec0a-57dd-45d7-9efd-d89e9019edc4-kube-api-access-l5h2c\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:09.675620 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.675400 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" event={"ID":"47b82ae00a4e61d8c8286ec65e9c9c5f","Type":"ContainerStarted","Data":"092099a011b25f1d5f9286a26a0e1da1b5fce12eb7693cc4c56e9e4598f424c1"} Jul 28 06:52:09.678684 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.678590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" event={"ID":"652ec2025569d089187b9f40ad489f57","Type":"ContainerStarted","Data":"352c3a9e59259245c33af352e88cbb8c5bf5000a2d237513c164caec32fe49f5"} Jul 28 06:52:09.712667 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.711910 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" Jul 28 06:52:09.721935 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.721857 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" Jul 28 06:52:09.738898 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:09.738817 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2220dc_5fbf_426c_8381_1af8a67762c5.slice/crio-b7d91566faa7621bfaedc8198839a8d8d0b4e509ec0ea9a41c8d2b7b7bb2b6e4 WatchSource:0}: Error finding container b7d91566faa7621bfaedc8198839a8d8d0b4e509ec0ea9a41c8d2b7b7bb2b6e4: Status 404 returned error can't find the container with id b7d91566faa7621bfaedc8198839a8d8d0b4e509ec0ea9a41c8d2b7b7bb2b6e4 Jul 28 06:52:09.740238 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.740179 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-gncth" Jul 28 06:52:09.742605 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:09.742546 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e288cb7_b593_40f4_b3cd_1a538587ffa0.slice/crio-02b8f2529bd46a49b0876b343cf63778417f58477e7fe38b14e47b70e40c71e6 WatchSource:0}: Error finding container 02b8f2529bd46a49b0876b343cf63778417f58477e7fe38b14e47b70e40c71e6: Status 404 returned error can't find the container with id 02b8f2529bd46a49b0876b343cf63778417f58477e7fe38b14e47b70e40c71e6 Jul 28 06:52:09.749943 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.749901 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wgq6z" Jul 28 06:52:09.759522 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.759476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-82zfm" Jul 28 06:52:09.769222 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:09.769124 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda84a191d_0b3a_460e_99fd_8cdba90483da.slice/crio-c1e03fc2e9db22c489426fd1031fdaa87dc96633dd55fd0bcf00a40eff2fc6e1 WatchSource:0}: Error finding container c1e03fc2e9db22c489426fd1031fdaa87dc96633dd55fd0bcf00a40eff2fc6e1: Status 404 returned error can't find the container with id c1e03fc2e9db22c489426fd1031fdaa87dc96633dd55fd0bcf00a40eff2fc6e1 Jul 28 06:52:09.771537 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.771486 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c6sdc" Jul 28 06:52:09.778885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.778835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:09.786866 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:09.785564 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbcd0f65_bb8c_4b28_ab0c_8f561ee508e6.slice/crio-92e3b4631e14cf9c837c7975f6124df1c9eae888269145241598b5725aa98112 WatchSource:0}: Error finding container 92e3b4631e14cf9c837c7975f6124df1c9eae888269145241598b5725aa98112: Status 404 returned error can't find the container with id 92e3b4631e14cf9c837c7975f6124df1c9eae888269145241598b5725aa98112 Jul 28 06:52:09.787268 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.786995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:09.794462 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:09.793923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqdws" Jul 28 06:52:09.818187 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:09.818124 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdec0f28_53c4_4c84_89a3_f9977886c34a.slice/crio-553d41695858867160e9a8a3ccb989461af4566eaca3ae94edf6558e85cb0cee WatchSource:0}: Error finding container 553d41695858867160e9a8a3ccb989461af4566eaca3ae94edf6558e85cb0cee: Status 404 returned error can't find the container with id 553d41695858867160e9a8a3ccb989461af4566eaca3ae94edf6558e85cb0cee Jul 28 06:52:09.838318 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:09.838264 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310c1d11_4f82_4d27_8a3e_1ddffae546c4.slice/crio-1c659b6029e43e5e0c560d21427ec87c6938ce4d2fb95d809173419c769b8413 WatchSource:0}: Error finding container 1c659b6029e43e5e0c560d21427ec87c6938ce4d2fb95d809173419c769b8413: Status 404 returned error can't find the container with id 1c659b6029e43e5e0c560d21427ec87c6938ce4d2fb95d809173419c769b8413 Jul 28 06:52:10.039288 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.039071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:10.039627 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.039351 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:10.039627 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.039386 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:10.039627 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.039405 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jqhv2 for pod openshift-network-diagnostics/network-check-target-7hjb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:10.039627 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.039505 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2 podName:bd09714f-2381-4958-8a10-f5068fdd3371 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:11.039474219 +0000 UTC m=+4.045524311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqhv2" (UniqueName: "kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2") pod "network-check-target-7hjb9" (UID: "bd09714f-2381-4958-8a10-f5068fdd3371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:10.140426 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.140349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:10.140818 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.140481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:10.140818 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.140645 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:10.140818 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.140661 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:10.140818 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.140800 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret podName:dd78624f-cc1b-4b09-82a4-35c3ddbdb20b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:11.140759943 +0000 UTC m=+4.146810040 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret") pod "global-pull-secret-syncer-8mldq" (UID: "dd78624f-cc1b-4b09-82a4-35c3ddbdb20b") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:10.141071 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.140837 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:11.140820678 +0000 UTC m=+4.146870772 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:10.458205 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.457955 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 06:47:09 +0000 UTC" deadline="2028-02-01 20:24:12.61542069 +0000 UTC" Jul 28 06:52:10.458205 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.458078 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13285h32m2.157348126s" Jul 28 06:52:10.662058 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.661034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:10.662058 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.661120 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:10.662058 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.661034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:10.662058 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.661343 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:10.662058 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.661439 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:10.662058 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:10.661565 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:10.685013 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.684899 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"1c659b6029e43e5e0c560d21427ec87c6938ce4d2fb95d809173419c769b8413"} Jul 28 06:52:10.688647 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.688558 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-67zqj" event={"ID":"20eb01e7-c7ef-47e7-85bc-e11eeac203c7","Type":"ContainerStarted","Data":"9f0dbd66cbcd325cdf7d3e1d6597ad46672d45b22f98e0e654cf87bb6e51f150"} Jul 28 06:52:10.690609 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.690466 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-82zfm" event={"ID":"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6","Type":"ContainerStarted","Data":"92e3b4631e14cf9c837c7975f6124df1c9eae888269145241598b5725aa98112"} Jul 28 06:52:10.692790 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.692720 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgq6z" event={"ID":"b91febb1-5d61-4ade-9023-1e65088aabcb","Type":"ContainerStarted","Data":"3194f235185a79bd97abeaa147b1a46ba2fb581ac786714435b7fa9ac78ce636"} Jul 28 06:52:10.695320 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.695255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" event={"ID":"9e288cb7-b593-40f4-b3cd-1a538587ffa0","Type":"ContainerStarted","Data":"02b8f2529bd46a49b0876b343cf63778417f58477e7fe38b14e47b70e40c71e6"} Jul 28 06:52:10.697911 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.697851 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqdws" event={"ID":"b09f7e56-0c1c-44e4-8397-c739ab48d145","Type":"ContainerStarted","Data":"f03e4ed6e40b65d78008cab0aaf52021cc26d3f881567b07a228a25535a92d81"} Jul 28 06:52:10.700015 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.699912 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c6sdc" event={"ID":"bdec0f28-53c4-4c84-89a3-f9977886c34a","Type":"ContainerStarted","Data":"553d41695858867160e9a8a3ccb989461af4566eaca3ae94edf6558e85cb0cee"} Jul 28 06:52:10.702172 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.702106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gncth" event={"ID":"a84a191d-0b3a-460e-99fd-8cdba90483da","Type":"ContainerStarted","Data":"c1e03fc2e9db22c489426fd1031fdaa87dc96633dd55fd0bcf00a40eff2fc6e1"} Jul 28 06:52:10.704147 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:10.704073 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerStarted","Data":"b7d91566faa7621bfaedc8198839a8d8d0b4e509ec0ea9a41c8d2b7b7bb2b6e4"} Jul 28 06:52:11.049410 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:11.049337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:11.049802 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:11.049675 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:11.049802 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:11.049723 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:11.049802 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:11.049741 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jqhv2 for pod openshift-network-diagnostics/network-check-target-7hjb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:11.049956 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:11.049823 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2 podName:bd09714f-2381-4958-8a10-f5068fdd3371 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:13.04979975 +0000 UTC m=+6.055849835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqhv2" (UniqueName: "kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2") pod "network-check-target-7hjb9" (UID: "bd09714f-2381-4958-8a10-f5068fdd3371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:11.151138 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:11.150865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:11.151138 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:11.151042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:11.151624 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:11.151166 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:11.151624 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:11.151244 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:11.151624 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:11.151316 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:13.15127694 +0000 UTC m=+6.157327048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:11.151624 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:11.151346 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret podName:dd78624f-cc1b-4b09-82a4-35c3ddbdb20b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:13.151334235 +0000 UTC m=+6.157384321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret") pod "global-pull-secret-syncer-8mldq" (UID: "dd78624f-cc1b-4b09-82a4-35c3ddbdb20b") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:11.459156 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:11.459066 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 06:47:09 +0000 UTC" deadline="2028-04-06 12:20:47.967506936 +0000 UTC" Jul 28 06:52:11.459156 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:11.459141 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14837h28m36.508372051s" Jul 28 06:52:12.662442 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:12.660919 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:12.662442 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:12.661194 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:12.662442 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:12.661912 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:12.662442 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:12.662091 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:12.662442 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:12.662185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:12.662442 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:12.662289 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:13.076657 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:13.075234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:13.076657 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:13.075651 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:13.076657 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:13.075686 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:13.076657 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:13.075724 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jqhv2 for pod openshift-network-diagnostics/network-check-target-7hjb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:13.076657 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:13.075837 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2 podName:bd09714f-2381-4958-8a10-f5068fdd3371 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:17.075802036 +0000 UTC m=+10.081852131 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqhv2" (UniqueName: "kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2") pod "network-check-target-7hjb9" (UID: "bd09714f-2381-4958-8a10-f5068fdd3371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:13.177977 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:13.176177 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:13.177977 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:13.176326 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:13.177977 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:13.176657 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:13.177977 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:13.176938 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:17.176898383 +0000 UTC m=+10.182948473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:13.177977 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:13.177715 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:13.177977 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:13.177808 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret podName:dd78624f-cc1b-4b09-82a4-35c3ddbdb20b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:17.177782528 +0000 UTC m=+10.183832612 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret") pod "global-pull-secret-syncer-8mldq" (UID: "dd78624f-cc1b-4b09-82a4-35c3ddbdb20b") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:14.662030 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:14.661947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:14.662955 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:14.661947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:14.662955 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:14.661947 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:14.662955 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:14.662283 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:14.662955 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:14.662320 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:14.662955 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:14.662199 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:16.662138 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:16.662083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:16.662825 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:16.662156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:16.662825 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:16.662083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:16.662825 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:16.662313 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:16.662825 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:16.662371 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:16.662825 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:16.662496 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:17.122508 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:17.122430 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:17.122924 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:17.122737 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:17.122924 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:17.122777 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:17.122924 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:17.122797 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jqhv2 for pod openshift-network-diagnostics/network-check-target-7hjb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:17.122924 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:17.122900 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2 podName:bd09714f-2381-4958-8a10-f5068fdd3371 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:25.122869147 +0000 UTC m=+18.128919234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqhv2" (UniqueName: "kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2") pod "network-check-target-7hjb9" (UID: "bd09714f-2381-4958-8a10-f5068fdd3371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:17.223792 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:17.223433 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:17.223792 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:17.223538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:17.223792 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:17.223694 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:17.223792 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:17.223694 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:17.223792 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:17.223793 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:25.223762585 +0000 UTC m=+18.229812668 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:17.223792 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:17.223815 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret podName:dd78624f-cc1b-4b09-82a4-35c3ddbdb20b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:25.223804435 +0000 UTC m=+18.229854519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret") pod "global-pull-secret-syncer-8mldq" (UID: "dd78624f-cc1b-4b09-82a4-35c3ddbdb20b") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:18.661449 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:18.661368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:18.662313 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:18.661699 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:18.662313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:18.661780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:18.662313 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:18.661871 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:18.662313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:18.661959 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:18.662313 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:18.662050 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:20.661189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:20.661118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:20.661189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:20.661158 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:20.662153 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:20.661118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:20.662153 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:20.661339 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:20.662153 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:20.661493 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:20.662153 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:20.661606 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:22.661450 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:22.661366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:22.662344 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:22.661366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:22.662344 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:22.661403 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:22.662344 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:22.661635 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:22.662344 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:22.661706 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:22.662344 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:22.661773 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:24.661885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:24.661821 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:24.662701 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:24.661821 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:24.662701 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:24.661832 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:24.662701 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:24.662062 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:24.662701 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:24.662158 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:24.662701 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:24.662239 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:25.215406 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:25.215312 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:25.215976 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:25.215642 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:25.215976 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:25.215688 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:25.215976 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:25.215711 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jqhv2 for pod openshift-network-diagnostics/network-check-target-7hjb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:25.215976 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:25.215830 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2 podName:bd09714f-2381-4958-8a10-f5068fdd3371 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:41.215793345 +0000 UTC m=+34.221843433 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqhv2" (UniqueName: "kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2") pod "network-check-target-7hjb9" (UID: "bd09714f-2381-4958-8a10-f5068fdd3371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:25.316812 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:25.316733 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:25.317246 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:25.316859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:25.317246 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:25.317128 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:25.317386 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:25.317263 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:41.317222272 +0000 UTC m=+34.323272357 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:25.318152 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:25.318083 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:25.318394 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:25.318260 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret podName:dd78624f-cc1b-4b09-82a4-35c3ddbdb20b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:41.318232986 +0000 UTC m=+34.324283069 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret") pod "global-pull-secret-syncer-8mldq" (UID: "dd78624f-cc1b-4b09-82a4-35c3ddbdb20b") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:26.661303 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:26.661239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:26.661303 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:26.661291 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:26.662275 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:26.661239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:26.662275 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:26.661474 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:26.662275 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:26.661644 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:26.662275 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:26.661732 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:28.661872 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:28.661802 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:28.662645 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:28.661802 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:28.662645 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:28.661802 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:28.662645 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:28.662042 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:28.662645 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:28.662195 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:28.662645 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:28.662326 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:30.661254 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:30.661171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:30.662156 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:30.661171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:30.662156 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:30.661171 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:30.662156 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:30.661433 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:30.662156 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:30.661498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:30.662156 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:30.661576 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:31.813297 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:31.812249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"1f36f423f15cf80d0015bd16c77094a5385855caa7d2620fdd16e209af8d4e31"} Jul 28 06:52:31.815432 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:31.813503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"0315a81dafa8074c527872f6af5c70e923a7468df01c669925c86583689486d2"} Jul 28 06:52:31.817702 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:31.817451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-82zfm" event={"ID":"dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6","Type":"ContainerStarted","Data":"11ed623a592ef9539f5bbd68b2dcced5c964a01be64b4fcf7921d2daf54542c1"} Jul 28 06:52:31.835398 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:31.835156 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" event={"ID":"47b82ae00a4e61d8c8286ec65e9c9c5f","Type":"ContainerStarted","Data":"81b37919b497a2fb560cfe4470f748b17481803ea2dd783ebfff4dd30a04d057"} Jul 28 06:52:31.849706 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:31.846403 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-82zfm" podStartSLOduration=2.254950269 podStartE2EDuration="23.846337615s" totalImagesPullingTime="21.591387346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:31.846301602 +0000 UTC m=+24.852351708" watchObservedRunningTime="2026-07-28 06:52:31.846337615 +0000 UTC m=+24.852387720" Jul 28 06:52:31.853264 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:31.851089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqdws" event={"ID":"b09f7e56-0c1c-44e4-8397-c739ab48d145","Type":"ContainerStarted","Data":"0ca04a4a5177ba8780d288cb32c178b7a13a9150d30b5a9007c4ae05619e01d2"} Jul 28 06:52:31.896349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:31.895768 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-68.ec2.internal" podStartSLOduration=22.895542373 podStartE2EDuration="22.895542373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:31.866199647 +0000 UTC m=+24.872249753" watchObservedRunningTime="2026-07-28 06:52:31.895542373 +0000 UTC m=+24.901592472" Jul 28 06:52:31.898708 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:31.898270 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lqdws" podStartSLOduration=2.438221407 podStartE2EDuration="23.898238563s" totalImagesPullingTime="21.460017156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:31.895002224 +0000 UTC m=+24.901052333" watchObservedRunningTime="2026-07-28 06:52:31.898238563 +0000 UTC m=+24.904288669" Jul 28 06:52:32.661947 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.661871 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:32.662368 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.661890 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:32.662368 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:32.662062 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:32.662368 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.661894 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:32.662368 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:32.662177 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:32.662368 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:32.662299 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:32.856545 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.856483 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-67zqj" event={"ID":"20eb01e7-c7ef-47e7-85bc-e11eeac203c7","Type":"ContainerStarted","Data":"ed1bf7dcb6faed081a1bcbdf73303a90a74409919ab5b3de50702cbfdb02f0ad"} Jul 28 06:52:32.859010 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.858957 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wgq6z" event={"ID":"b91febb1-5d61-4ade-9023-1e65088aabcb","Type":"ContainerStarted","Data":"e23f048ff3315ad2949c531235536802705a7a49d1b3049cfe6ae3f735aa36d6"} Jul 28 06:52:32.861346 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.861296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" event={"ID":"9e288cb7-b593-40f4-b3cd-1a538587ffa0","Type":"ContainerStarted","Data":"e2e51793dc19e4c67c8affb6babbb79705599b69cfe6f4a7bedbd438b7af4e62"} Jul 28 06:52:32.863513 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.863463 2562 generic.go:356] "Generic (PLEG): container finished" podID="652ec2025569d089187b9f40ad489f57" containerID="54d2dba7f19c604e421a3ef3778dfa7fd1dc37c3951701e5c410a8b0e6bc097b" exitCode=0 Jul 28 06:52:32.863856 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.863515 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" event={"ID":"652ec2025569d089187b9f40ad489f57","Type":"ContainerDied","Data":"54d2dba7f19c604e421a3ef3778dfa7fd1dc37c3951701e5c410a8b0e6bc097b"} Jul 28 06:52:32.865721 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.865673 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-gncth" event={"ID":"a84a191d-0b3a-460e-99fd-8cdba90483da","Type":"ContainerStarted","Data":"322ad4847a230df4d2ba9474db739ad99733b7d57a4a0077de93ba22d2ac4da4"} Jul 28 06:52:32.868867 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.868813 2562 generic.go:356] "Generic (PLEG): container finished" podID="7a2220dc-5fbf-426c-8381-1af8a67762c5" containerID="e6058a416918b74216865be0f019ad11b2cb537ac886bb299eeaffe5796975e6" exitCode=0 Jul 28 06:52:32.869106 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.868908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerDied","Data":"e6058a416918b74216865be0f019ad11b2cb537ac886bb299eeaffe5796975e6"} Jul 28 06:52:32.873142 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.872987 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-67zqj" podStartSLOduration=3.368853889 podStartE2EDuration="24.872952409s" totalImagesPullingTime="21.50409852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:32.8718947 +0000 UTC m=+25.877944804" watchObservedRunningTime="2026-07-28 06:52:32.872952409 +0000 UTC m=+25.879002582" Jul 28 06:52:32.873674 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.873543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"8153cd445eca69e7499ae0de41810020abb8dacfd84cb12fc8216c645c64bcd0"} Jul 28 06:52:32.873819 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.873768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"ba49e08646bb0a93051422fe35e4a9856f548eca472758e1e2552e11d956e0c9"} Jul 28 06:52:32.873888 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.873835 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"a4c053d4b451a5a8afef442cce25f81132c3d134e48f786fa983b8fbaf661df4"} Jul 28 06:52:32.873944 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.873896 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"f49b6a223829799b4644d717de9c15692547178c4ffd488c9309d80f12846190"} Jul 28 06:52:32.920024 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.919794 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-gncth" podStartSLOduration=3.386324811 podStartE2EDuration="24.919754087s" totalImagesPullingTime="21.533429276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:32.918587487 +0000 UTC m=+25.924637591" watchObservedRunningTime="2026-07-28 06:52:32.919754087 +0000 UTC m=+25.925804192" Jul 28 06:52:32.934001 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:32.933887 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wgq6z" podStartSLOduration=3.405359734 podStartE2EDuration="24.933846183s" totalImagesPullingTime="21.528486449s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:32.933360933 +0000 UTC m=+25.939411039" watchObservedRunningTime="2026-07-28 06:52:32.933846183 +0000 UTC m=+25.939896288" Jul 28 06:52:33.168681 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.168585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:33.246881 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.246812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:33.281337 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.281297 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 06:52:33.531589 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.531294 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T06:52:33.281325858Z","UUID":"11e4e32e-1f99-492e-b7c1-1d3d080d5ed2","Handler":null,"Name":"","Endpoint":""} Jul 28 06:52:33.534703 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.534653 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 06:52:33.534703 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.534722 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 06:52:33.881609 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.881554 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" event={"ID":"652ec2025569d089187b9f40ad489f57","Type":"ContainerStarted","Data":"8497a9be3dc726177f11e2814b5751b5f457a2558291f783419ceb959f775ffd"} Jul 28 06:52:33.890064 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.889997 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" event={"ID":"9e288cb7-b593-40f4-b3cd-1a538587ffa0","Type":"ContainerStarted","Data":"8388d504110c9215a76e6e4a726e56cb43092e3cbcb57b2cce889cbf801a8998"} Jul 28 06:52:33.897996 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:33.897897 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-68.ec2.internal" podStartSLOduration=24.897853161 podStartE2EDuration="24.897853161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:33.896263275 +0000 UTC m=+26.902313382" watchObservedRunningTime="2026-07-28 06:52:33.897853161 +0000 UTC m=+26.903903267" Jul 28 06:52:34.661175 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:34.661113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:34.661558 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:34.661113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:34.661558 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:34.661113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:34.661558 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:34.661352 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:34.661558 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:34.661484 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:34.661786 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:34.661596 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:34.897289 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:34.897193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c6sdc" event={"ID":"bdec0f28-53c4-4c84-89a3-f9977886c34a","Type":"ContainerStarted","Data":"66a2f5523cdc48920fd533f18819a47cb8f85a6d8fdac8374beedf2ab0ad4ada"} Jul 28 06:52:34.903282 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:34.903215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"26d33e92702ea38c070e92eedd1aa71f55ae3efb6519cb9ff417215262805634"} Jul 28 06:52:34.914094 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:34.913968 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c6sdc" podStartSLOduration=5.426321227 podStartE2EDuration="26.913925859s" totalImagesPullingTime="21.487604632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:34.913159703 +0000 UTC m=+27.919209808" watchObservedRunningTime="2026-07-28 06:52:34.913925859 +0000 UTC m=+27.919975964" Jul 28 06:52:35.034435 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:35.034360 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:35.133579 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:35.133395 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:35.191855 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:35.191789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:35.514748 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:35.514480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:35.567800 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:35.567705 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:35.909877 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:35.909805 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" event={"ID":"9e288cb7-b593-40f4-b3cd-1a538587ffa0","Type":"ContainerStarted","Data":"9b5e8735365cce2386f1ff2ce5489c772aea6ab598a80d8c9decb63f9a78137d"} Jul 28 06:52:35.928358 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:35.928251 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cknw6" podStartSLOduration=12.73209239 podStartE2EDuration="27.928222224s" totalImagesPullingTime="15.196129834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:35.927772465 +0000 UTC m=+28.933822572" watchObservedRunningTime="2026-07-28 06:52:35.928222224 +0000 UTC m=+28.934272346" Jul 28 06:52:36.661752 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:36.661224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:36.662131 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:36.661219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:36.662131 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:36.661219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:36.662131 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:36.661970 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:36.662131 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:36.662063 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:36.662355 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:36.662137 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:37.466162 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:37.465895 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:37.467818 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:37.467297 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:37.919754 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:37.919691 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerStarted","Data":"b02d1e666b20332dd05f245a8791c69d1a5c87d0ad2b9c647576d3ed8814dc3c"} Jul 28 06:52:37.925196 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:37.925103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" event={"ID":"310c1d11-4f82-4d27-8a3e-1ddffae546c4","Type":"ContainerStarted","Data":"63dce9b54fd4b8c0fd08637d723a5f9ecd4329646d0f5e3e0a58c9dd5711e3a8"} Jul 28 06:52:37.925588 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:37.925566 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:37.926436 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:37.926410 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-67zqj" Jul 28 06:52:37.970649 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:37.970536 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" podStartSLOduration=8.415715378 podStartE2EDuration="29.970507819s" totalImagesPullingTime="21.554792441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:37.969192315 +0000 UTC m=+30.975242423" watchObservedRunningTime="2026-07-28 06:52:37.970507819 +0000 UTC m=+30.976557923" Jul 28 06:52:38.031941 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.031876 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:38.661870 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.661785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:38.662649 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.661784 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:38.662649 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.661807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:38.662649 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:38.662046 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:38.662649 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:38.662205 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:38.662649 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:38.662343 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:38.931473 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.931267 2562 generic.go:356] "Generic (PLEG): container finished" podID="7a2220dc-5fbf-426c-8381-1af8a67762c5" containerID="b02d1e666b20332dd05f245a8791c69d1a5c87d0ad2b9c647576d3ed8814dc3c" exitCode=0 Jul 28 06:52:38.931473 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.931367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerDied","Data":"b02d1e666b20332dd05f245a8791c69d1a5c87d0ad2b9c647576d3ed8814dc3c"} Jul 28 06:52:38.932957 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.932740 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:38.932957 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.932907 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:38.932957 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.932986 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:38.975063 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.974390 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:38.976752 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:38.976709 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:52:39.855325 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:39.855243 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8mldq"] Jul 28 06:52:39.857125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:39.855512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:39.857125 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:39.855700 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:39.858883 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:39.858518 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7hjb9"] Jul 28 06:52:39.858883 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:39.858842 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:39.859205 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:39.859023 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:39.859463 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:39.859426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6rm99"] Jul 28 06:52:39.859667 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:39.859647 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:39.859858 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:39.859823 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:40.939945 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:40.939887 2562 generic.go:356] "Generic (PLEG): container finished" podID="7a2220dc-5fbf-426c-8381-1af8a67762c5" containerID="28f9a6d94aaadb8b644976fec2c11d501d72dcad2386bc402989ab643fb8ac42" exitCode=0 Jul 28 06:52:40.940874 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:40.939970 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerDied","Data":"28f9a6d94aaadb8b644976fec2c11d501d72dcad2386bc402989ab643fb8ac42"} Jul 28 06:52:41.301334 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:41.301148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:41.301717 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.301387 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:41.301717 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.301425 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:41.301717 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.301447 2562 projected.go:196] Error preparing data for projected volume kube-api-access-jqhv2 for pod openshift-network-diagnostics/network-check-target-7hjb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:41.301717 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.301548 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2 podName:bd09714f-2381-4958-8a10-f5068fdd3371 nodeName:}" failed. No retries permitted until 2026-07-28 06:53:13.301519039 +0000 UTC m=+66.307569122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jqhv2" (UniqueName: "kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2") pod "network-check-target-7hjb9" (UID: "bd09714f-2381-4958-8a10-f5068fdd3371") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:41.402988 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:41.402418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:41.403376 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.402679 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:41.403376 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:41.403111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:41.403376 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.403199 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:53:13.403150004 +0000 UTC m=+66.409200099 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:41.403376 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.403283 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:41.403376 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.403343 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret podName:dd78624f-cc1b-4b09-82a4-35c3ddbdb20b nodeName:}" failed. No retries permitted until 2026-07-28 06:53:13.403326969 +0000 UTC m=+66.409377052 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret") pod "global-pull-secret-syncer-8mldq" (UID: "dd78624f-cc1b-4b09-82a4-35c3ddbdb20b") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:41.661413 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:41.661347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:41.661838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:41.661347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:41.661838 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:41.661347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:41.661838 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.661575 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:41.661838 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.661789 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:41.662063 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:41.661946 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:41.948114 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:41.948042 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerStarted","Data":"6e01205cd4893d4bf16283f8bc4b3b30c9f511c0c4211a88717051cbbe50247a"} Jul 28 06:52:42.955493 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:42.955427 2562 generic.go:356] "Generic (PLEG): container finished" podID="7a2220dc-5fbf-426c-8381-1af8a67762c5" containerID="6e01205cd4893d4bf16283f8bc4b3b30c9f511c0c4211a88717051cbbe50247a" exitCode=0 Jul 28 06:52:42.956175 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:42.955502 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerDied","Data":"6e01205cd4893d4bf16283f8bc4b3b30c9f511c0c4211a88717051cbbe50247a"} Jul 28 06:52:43.661876 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:43.661799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:43.662269 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:43.661800 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:43.662269 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:43.661799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:43.662269 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:43.662080 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8mldq" podUID="dd78624f-cc1b-4b09-82a4-35c3ddbdb20b" Jul 28 06:52:43.662269 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:43.662240 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:52:43.662499 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:43.662415 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7hjb9" podUID="bd09714f-2381-4958-8a10-f5068fdd3371" Jul 28 06:52:45.251793 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.251729 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-68.ec2.internal" event="NodeReady" Jul 28 06:52:45.252696 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.252046 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 06:52:45.293907 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.293702 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wtd45"] Jul 28 06:52:45.297788 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.297731 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wbr6d"] Jul 28 06:52:45.298330 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.297948 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.300905 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.300487 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 06:52:45.300905 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.300551 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 06:52:45.300905 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.300487 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj4nt\"" Jul 28 06:52:45.301471 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.301447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wbr6d" Jul 28 06:52:45.304867 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.304828 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 06:52:45.304867 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.304858 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9z2rj\"" Jul 28 06:52:45.305188 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.304924 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 06:52:45.305188 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.305067 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 06:52:45.309735 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.309665 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wtd45"] Jul 28 06:52:45.311105 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.311001 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wbr6d"] Jul 28 06:52:45.436474 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.436399 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:45.444486 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.444408 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19fc102d-1417-4c01-ab64-f9c2c79744ae-config-volume\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.444486 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.444482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8ea604e-1844-4326-8044-45a9fd9d3dea-cert\") pod \"ingress-canary-wbr6d\" (UID: \"a8ea604e-1844-4326-8044-45a9fd9d3dea\") " pod="openshift-ingress-canary/ingress-canary-wbr6d" Jul 28 06:52:45.445015 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.444522 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hqhd\" (UniqueName: \"kubernetes.io/projected/a8ea604e-1844-4326-8044-45a9fd9d3dea-kube-api-access-9hqhd\") pod \"ingress-canary-wbr6d\" (UID: \"a8ea604e-1844-4326-8044-45a9fd9d3dea\") " pod="openshift-ingress-canary/ingress-canary-wbr6d" Jul 28 06:52:45.445015 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.444608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.445015 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.444657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kf4p\" (UniqueName: \"kubernetes.io/projected/19fc102d-1417-4c01-ab64-f9c2c79744ae-kube-api-access-9kf4p\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.445015 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.444702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fc102d-1417-4c01-ab64-f9c2c79744ae-tmp-dir\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.489752 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.489676 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:45.546125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.545912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19fc102d-1417-4c01-ab64-f9c2c79744ae-config-volume\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.546125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.545987 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8ea604e-1844-4326-8044-45a9fd9d3dea-cert\") pod \"ingress-canary-wbr6d\" (UID: \"a8ea604e-1844-4326-8044-45a9fd9d3dea\") " pod="openshift-ingress-canary/ingress-canary-wbr6d" Jul 28 06:52:45.546125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.546024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hqhd\" (UniqueName: \"kubernetes.io/projected/a8ea604e-1844-4326-8044-45a9fd9d3dea-kube-api-access-9hqhd\") pod \"ingress-canary-wbr6d\" (UID: \"a8ea604e-1844-4326-8044-45a9fd9d3dea\") " pod="openshift-ingress-canary/ingress-canary-wbr6d" Jul 28 06:52:45.546583 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.546223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.546583 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.546268 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kf4p\" (UniqueName: \"kubernetes.io/projected/19fc102d-1417-4c01-ab64-f9c2c79744ae-kube-api-access-9kf4p\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.546583 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.546315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fc102d-1417-4c01-ab64-f9c2c79744ae-tmp-dir\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.547174 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:45.547118 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:45.547377 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:45.547266 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:52:46.047229219 +0000 UTC m=+39.053279304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:52:45.548905 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.547506 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19fc102d-1417-4c01-ab64-f9c2c79744ae-tmp-dir\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.548905 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.547767 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19fc102d-1417-4c01-ab64-f9c2c79744ae-config-volume\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.558326 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.558262 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kf4p\" (UniqueName: \"kubernetes.io/projected/19fc102d-1417-4c01-ab64-f9c2c79744ae-kube-api-access-9kf4p\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:45.558601 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.558263 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a8ea604e-1844-4326-8044-45a9fd9d3dea-cert\") pod \"ingress-canary-wbr6d\" (UID: \"a8ea604e-1844-4326-8044-45a9fd9d3dea\") " pod="openshift-ingress-canary/ingress-canary-wbr6d" Jul 28 06:52:45.558748 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.558723 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hqhd\" (UniqueName: \"kubernetes.io/projected/a8ea604e-1844-4326-8044-45a9fd9d3dea-kube-api-access-9hqhd\") pod \"ingress-canary-wbr6d\" (UID: \"a8ea604e-1844-4326-8044-45a9fd9d3dea\") " pod="openshift-ingress-canary/ingress-canary-wbr6d" Jul 28 06:52:45.629776 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.629737 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wbr6d" Jul 28 06:52:45.662610 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.662540 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:52:45.663001 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.662540 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:52:45.663001 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.662540 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:52:45.666042 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.665991 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 06:52:45.666326 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.666070 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hmd7q\"" Jul 28 06:52:45.666326 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.666249 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mfvlz\"" Jul 28 06:52:45.666326 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.666283 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 06:52:45.666502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.666403 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 06:52:45.666502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:45.666427 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 06:52:46.052054 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:46.051984 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:46.052401 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:46.052231 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:46.052401 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:46.052377 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:52:47.052341402 +0000 UTC m=+40.058391492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:52:47.063757 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:47.063674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:47.064583 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:47.063938 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:47.064583 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:47.064053 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:52:49.064026746 +0000 UTC m=+42.070076832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:52:47.328130 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:47.327704 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wbr6d"] Jul 28 06:52:47.333500 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:52:47.333430 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8ea604e_1844_4326_8044_45a9fd9d3dea.slice/crio-078a1564c8e34e4f949147a09f21d2f657468620b8e34848e58ee65e5bad602f WatchSource:0}: Error finding container 078a1564c8e34e4f949147a09f21d2f657468620b8e34848e58ee65e5bad602f: Status 404 returned error can't find the container with id 078a1564c8e34e4f949147a09f21d2f657468620b8e34848e58ee65e5bad602f Jul 28 06:52:47.982772 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:47.982000 2562 generic.go:356] "Generic (PLEG): container finished" podID="7a2220dc-5fbf-426c-8381-1af8a67762c5" containerID="a2af318e2746e7e068e084074b119fcfef9faa3dbc5e7b2cbea323c5ba6a946d" exitCode=0 Jul 28 06:52:47.982772 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:47.982078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerDied","Data":"a2af318e2746e7e068e084074b119fcfef9faa3dbc5e7b2cbea323c5ba6a946d"} Jul 28 06:52:47.984240 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:47.984203 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wbr6d" event={"ID":"a8ea604e-1844-4326-8044-45a9fd9d3dea","Type":"ContainerStarted","Data":"078a1564c8e34e4f949147a09f21d2f657468620b8e34848e58ee65e5bad602f"} Jul 28 06:52:48.993217 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:48.993137 2562 generic.go:356] "Generic (PLEG): container finished" podID="7a2220dc-5fbf-426c-8381-1af8a67762c5" containerID="7a903162ce26aaaf3392f180ec233f0a30977bb6d3482f9306b7791c3e8615ee" exitCode=0 Jul 28 06:52:48.996168 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:48.993296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerDied","Data":"7a903162ce26aaaf3392f180ec233f0a30977bb6d3482f9306b7791c3e8615ee"} Jul 28 06:52:49.085152 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:49.085064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:49.085587 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:49.085292 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:49.085587 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:49.085440 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:52:53.085404154 +0000 UTC m=+46.091454238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:52:49.591177 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:49.591008 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:49.667773 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:49.667712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:50.001963 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:50.001903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" event={"ID":"7a2220dc-5fbf-426c-8381-1af8a67762c5","Type":"ContainerStarted","Data":"3fb073e65675c8c0051625b955d8f46f0b0e7b08813d54d31e016184ce82876b"} Jul 28 06:52:50.029313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:50.029190 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mlq4v" podStartSLOduration=9.432518217 podStartE2EDuration="42.029148391s" totalImagesPullingTime="32.596630174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:50.026863485 +0000 UTC m=+43.032913591" watchObservedRunningTime="2026-07-28 06:52:50.029148391 +0000 UTC m=+43.035198498" Jul 28 06:52:50.155738 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:50.155545 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:50.260333 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:50.260274 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:51.008363 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:51.008286 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wbr6d" event={"ID":"a8ea604e-1844-4326-8044-45a9fd9d3dea","Type":"ContainerStarted","Data":"0d0bebc14fb9d1e92fa5ee07baf9c0a69074de2f612d1eb03a835394fa5d5ca4"} Jul 28 06:52:51.025845 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:51.025733 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wbr6d" podStartSLOduration=3.176207721 podStartE2EDuration="6.025692679s" totalImagesPullingTime="2.849484958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:51.025585239 +0000 UTC m=+44.031635345" watchObservedRunningTime="2026-07-28 06:52:51.025692679 +0000 UTC m=+44.031742766" Jul 28 06:52:53.121065 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:53.120977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:52:53.121845 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:53.121203 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:53.121845 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:52:53.121323 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:53:01.121293533 +0000 UTC m=+54.127343615 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:52:55.671299 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:55.671228 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:55.745854 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:52:55.745787 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:01.198746 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:01.198659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:53:01.199841 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:53:01.198929 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:53:01.199841 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:53:01.199024 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:53:17.198996156 +0000 UTC m=+70.205046239 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:53:10.957591 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:10.957521 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tlwf" Jul 28 06:53:11.136345 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:11.136287 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:11.201225 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:11.201155 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:53:13.319267 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.319141 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:53:13.322202 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.322166 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 06:53:13.333421 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.333370 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 06:53:13.347606 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.347531 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqhv2\" (UniqueName: \"kubernetes.io/projected/bd09714f-2381-4958-8a10-f5068fdd3371-kube-api-access-jqhv2\") pod \"network-check-target-7hjb9\" (UID: \"bd09714f-2381-4958-8a10-f5068fdd3371\") " pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:53:13.420913 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.420814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:53:13.421275 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.420939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:53:13.423887 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.423841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 06:53:13.423983 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.423867 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 06:53:13.432202 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:53:13.432145 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 06:53:13.432386 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:53:13.432302 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:54:17.432265759 +0000 UTC m=+130.438315841 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : secret "metrics-daemon-secret" not found Jul 28 06:53:13.436144 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.436106 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/dd78624f-cc1b-4b09-82a4-35c3ddbdb20b-original-pull-secret\") pod \"global-pull-secret-syncer-8mldq\" (UID: \"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b\") " pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:53:13.594648 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.594440 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hmd7q\"" Jul 28 06:53:13.600817 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.600764 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8mldq" Jul 28 06:53:13.601849 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.601809 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:53:13.809081 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.809013 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7hjb9"] Jul 28 06:53:13.815598 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:53:13.815534 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd09714f_2381_4958_8a10_f5068fdd3371.slice/crio-0da58d3a9a9dbbb01b77e762f275cb6419f787d4a5a038a155a852acdb015717 WatchSource:0}: Error finding container 0da58d3a9a9dbbb01b77e762f275cb6419f787d4a5a038a155a852acdb015717: Status 404 returned error can't find the container with id 0da58d3a9a9dbbb01b77e762f275cb6419f787d4a5a038a155a852acdb015717 Jul 28 06:53:13.823776 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:13.823659 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8mldq"] Jul 28 06:53:13.830974 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:53:13.830915 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd78624f_cc1b_4b09_82a4_35c3ddbdb20b.slice/crio-99c860861a777c1a3ebff612674a276ae72da0170c981c12fbc9c331ad3b4f76 WatchSource:0}: Error finding container 99c860861a777c1a3ebff612674a276ae72da0170c981c12fbc9c331ad3b4f76: Status 404 returned error can't find the container with id 99c860861a777c1a3ebff612674a276ae72da0170c981c12fbc9c331ad3b4f76 Jul 28 06:53:14.094864 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:14.094798 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8mldq" event={"ID":"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b","Type":"ContainerStarted","Data":"99c860861a777c1a3ebff612674a276ae72da0170c981c12fbc9c331ad3b4f76"} Jul 28 06:53:14.096588 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:14.096545 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7hjb9" event={"ID":"bd09714f-2381-4958-8a10-f5068fdd3371","Type":"ContainerStarted","Data":"0da58d3a9a9dbbb01b77e762f275cb6419f787d4a5a038a155a852acdb015717"} Jul 28 06:53:17.260328 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:17.260244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:53:17.261077 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:53:17.260491 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:53:17.261077 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:53:17.260653 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:53:49.26059283 +0000 UTC m=+102.266642916 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:53:19.120309 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.120245 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8mldq" event={"ID":"dd78624f-cc1b-4b09-82a4-35c3ddbdb20b","Type":"ContainerStarted","Data":"54273f92fad9c8ea0832cab060f0e310151aa9512e3424a26bb78c4404b94a50"} Jul 28 06:53:19.122454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.122404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7hjb9" event={"ID":"bd09714f-2381-4958-8a10-f5068fdd3371","Type":"ContainerStarted","Data":"3512eed4779ed50bf15c9e45e03e94516301a0db82bd3a4709dd792a7690aa73"} Jul 28 06:53:19.122726 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.122544 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:53:19.136507 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.136411 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8mldq" podStartSLOduration=66.59185831 podStartE2EDuration="1m11.136378844s" totalImagesPullingTime="4.544520534s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:53:19.135893827 +0000 UTC m=+72.141943933" watchObservedRunningTime="2026-07-28 06:53:19.136378844 +0000 UTC m=+72.142428948" Jul 28 06:53:19.152691 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.152564 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7hjb9" podStartSLOduration=66.599321273 podStartE2EDuration="1m11.152529204s" totalImagesPullingTime="4.553207931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:53:19.151379705 +0000 UTC m=+72.157429811" watchObservedRunningTime="2026-07-28 06:53:19.152529204 +0000 UTC m=+72.158579312" Jul 28 06:53:19.541810 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.541646 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss"] Jul 28 06:53:19.545538 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.545482 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.549296 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.549250 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 28 06:53:19.550443 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.550394 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 28 06:53:19.550443 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.550443 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 28 06:53:19.550842 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.550470 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 28 06:53:19.550842 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.550525 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 28 06:53:19.550842 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.550394 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 28 06:53:19.551316 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.551298 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 28 06:53:19.559212 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.559153 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss"] Jul 28 06:53:19.682087 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.682019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrq2x\" (UniqueName: \"kubernetes.io/projected/84e89106-61cd-43b7-bc50-b423cd29014f-kube-api-access-hrq2x\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.682087 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.682093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-hub\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.682487 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.682218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-ca\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.682487 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.682284 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.682487 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.682324 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/84e89106-61cd-43b7-bc50-b423cd29014f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.682487 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.682356 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.783077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.782988 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.783077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.783083 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/84e89106-61cd-43b7-bc50-b423cd29014f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.783579 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.783127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.783579 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.783163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrq2x\" (UniqueName: \"kubernetes.io/projected/84e89106-61cd-43b7-bc50-b423cd29014f-kube-api-access-hrq2x\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.783579 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.783210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-hub\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.783579 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.783297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-ca\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.784224 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.784192 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/84e89106-61cd-43b7-bc50-b423cd29014f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.788179 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.788110 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.788179 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.788179 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-hub\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.788467 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.788262 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-ca\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.788467 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.788297 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/84e89106-61cd-43b7-bc50-b423cd29014f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.794279 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.794137 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrq2x\" (UniqueName: \"kubernetes.io/projected/84e89106-61cd-43b7-bc50-b423cd29014f-kube-api-access-hrq2x\") pod \"cluster-proxy-proxy-agent-766577c456-g9fss\" (UID: \"84e89106-61cd-43b7-bc50-b423cd29014f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:19.876753 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:19.876661 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:53:20.100601 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:20.100550 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss"] Jul 28 06:53:20.106642 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:53:20.106561 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84e89106_61cd_43b7_bc50_b423cd29014f.slice/crio-1b30b560485125ce362e9ad4f2d65a42ad068197da89ddf14502dfa17e4c2dcf WatchSource:0}: Error finding container 1b30b560485125ce362e9ad4f2d65a42ad068197da89ddf14502dfa17e4c2dcf: Status 404 returned error can't find the container with id 1b30b560485125ce362e9ad4f2d65a42ad068197da89ddf14502dfa17e4c2dcf Jul 28 06:53:20.128916 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:20.128847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" event={"ID":"84e89106-61cd-43b7-bc50-b423cd29014f","Type":"ContainerStarted","Data":"1b30b560485125ce362e9ad4f2d65a42ad068197da89ddf14502dfa17e4c2dcf"} Jul 28 06:53:24.150459 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:24.150397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" event={"ID":"84e89106-61cd-43b7-bc50-b423cd29014f","Type":"ContainerStarted","Data":"bb3354bf2363cc64c92c0ffee22dc6e159a0d3eb6b8907dbedeb5922692dca98"} Jul 28 06:53:24.151122 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:24.150487 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" event={"ID":"84e89106-61cd-43b7-bc50-b423cd29014f","Type":"ContainerStarted","Data":"9e99e4b1ea9ffc291101efd7c39a2bc6f54e924b44f2758f870a5437aa47533b"} Jul 28 06:53:25.158963 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:25.158651 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" event={"ID":"84e89106-61cd-43b7-bc50-b423cd29014f","Type":"ContainerStarted","Data":"e0a59e4f3fe3e11455ec322d3a9b94883695c3d4d1cf777cafc2d1fe8e6f5fe8"} Jul 28 06:53:25.178457 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:25.178353 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" podStartSLOduration=2.39477842 podStartE2EDuration="6.178316307s" totalImagesPullingTime="3.783537887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:53:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:53:25.17676777 +0000 UTC m=+78.182817876" watchObservedRunningTime="2026-07-28 06:53:25.178316307 +0000 UTC m=+78.184366412" Jul 28 06:53:49.269510 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:49.269411 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:53:49.270579 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:53:49.269708 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:53:49.270579 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:53:49.269844 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:54:53.269808289 +0000 UTC m=+166.275858372 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:53:50.137917 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:53:50.137854 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7hjb9" Jul 28 06:54:17.435187 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:54:17.435050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:54:17.436339 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:54:17.435314 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 06:54:17.436339 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:54:17.435471 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:19.435433944 +0000 UTC m=+252.441484027 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : secret "metrics-daemon-secret" not found Jul 28 06:54:48.320372 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:54:48.320258 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wtd45" podUID="19fc102d-1417-4c01-ab64-f9c2c79744ae" Jul 28 06:54:48.508971 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:54:48.508904 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wtd45" Jul 28 06:54:48.681182 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:54:48.681066 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:54:53.272700 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:54:53.272592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:54:53.273520 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:54:53.272827 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:54:53.273520 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:54:53.272955 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls podName:19fc102d-1417-4c01-ab64-f9c2c79744ae nodeName:}" failed. No retries permitted until 2026-07-28 06:56:55.272921727 +0000 UTC m=+288.278971809 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls") pod "dns-default-wtd45" (UID: "19fc102d-1417-4c01-ab64-f9c2c79744ae") : secret "dns-default-metrics-tls" not found Jul 28 06:55:02.661150 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:55:02.660948 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:55:28.624608 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:55:28.624542 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:10.831303 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.831249 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:10.873412 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.873343 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6qzxd"] Jul 28 06:56:10.876901 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.876859 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:10.880128 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.880031 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 06:56:10.880464 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.880106 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lrqpc\"" Jul 28 06:56:10.881071 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.881039 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 06:56:10.882406 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.882376 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 06:56:10.882605 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.882376 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 06:56:10.885257 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.885217 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 06:56:10.889670 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.889606 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6qzxd"] Jul 28 06:56:10.916319 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.916124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bps46\" (UniqueName: \"kubernetes.io/projected/a79a3c4f-ce8a-40ba-8097-271ad21977ba-kube-api-access-bps46\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:10.916319 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.916210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79a3c4f-ce8a-40ba-8097-271ad21977ba-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:10.916319 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.916240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79a3c4f-ce8a-40ba-8097-271ad21977ba-service-ca-bundle\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:10.916319 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.916265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a79a3c4f-ce8a-40ba-8097-271ad21977ba-serving-cert\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:10.916822 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.916340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a79a3c4f-ce8a-40ba-8097-271ad21977ba-snapshots\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:10.916822 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.916394 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79a3c4f-ce8a-40ba-8097-271ad21977ba-tmp\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:10.918353 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:10.918316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:11.017587 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.017367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bps46\" (UniqueName: \"kubernetes.io/projected/a79a3c4f-ce8a-40ba-8097-271ad21977ba-kube-api-access-bps46\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.017587 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.017467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79a3c4f-ce8a-40ba-8097-271ad21977ba-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.017587 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.017493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79a3c4f-ce8a-40ba-8097-271ad21977ba-service-ca-bundle\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.017587 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.017517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a79a3c4f-ce8a-40ba-8097-271ad21977ba-serving-cert\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.017587 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.017566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a79a3c4f-ce8a-40ba-8097-271ad21977ba-snapshots\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.017587 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.017649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79a3c4f-ce8a-40ba-8097-271ad21977ba-tmp\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.018885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.018836 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79a3c4f-ce8a-40ba-8097-271ad21977ba-service-ca-bundle\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.018885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.018877 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79a3c4f-ce8a-40ba-8097-271ad21977ba-tmp\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.019379 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.019134 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/a79a3c4f-ce8a-40ba-8097-271ad21977ba-snapshots\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.019441 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.019413 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a79a3c4f-ce8a-40ba-8097-271ad21977ba-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.020064 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.020024 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:11.023221 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.023169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a79a3c4f-ce8a-40ba-8097-271ad21977ba-serving-cert\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.027579 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.027496 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bps46\" (UniqueName: \"kubernetes.io/projected/a79a3c4f-ce8a-40ba-8097-271ad21977ba-kube-api-access-bps46\") pod \"insights-operator-5885fdb759-6qzxd\" (UID: \"a79a3c4f-ce8a-40ba-8097-271ad21977ba\") " pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.121140 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.121058 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:11.192047 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.191957 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-6qzxd" Jul 28 06:56:11.396152 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.395960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-6qzxd"] Jul 28 06:56:11.406324 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:56:11.406250 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79a3c4f_ce8a_40ba_8097_271ad21977ba.slice/crio-1554633b773b7943579edf82d77508a87a334cec0e180836a43adc6ee0ac6d5c WatchSource:0}: Error finding container 1554633b773b7943579edf82d77508a87a334cec0e180836a43adc6ee0ac6d5c: Status 404 returned error can't find the container with id 1554633b773b7943579edf82d77508a87a334cec0e180836a43adc6ee0ac6d5c Jul 28 06:56:11.846353 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:11.846146 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6qzxd" event={"ID":"a79a3c4f-ce8a-40ba-8097-271ad21977ba","Type":"ContainerStarted","Data":"1554633b773b7943579edf82d77508a87a334cec0e180836a43adc6ee0ac6d5c"} Jul 28 06:56:13.135018 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:13.134948 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:13.193822 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:13.193748 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:13.857391 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:13.857316 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6qzxd" event={"ID":"a79a3c4f-ce8a-40ba-8097-271ad21977ba","Type":"ContainerStarted","Data":"2806e9a8d4136efb80df573f8b2c581d95bd8780f77f98d18c80ca261b34cb4e"} Jul 28 06:56:13.876266 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:13.876152 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-6qzxd" podStartSLOduration=1.7944869749999999 podStartE2EDuration="3.876115711s" totalImagesPullingTime="2.081628736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:13.875087849 +0000 UTC m=+246.881137976" watchObservedRunningTime="2026-07-28 06:56:13.876115711 +0000 UTC m=+246.882165884" Jul 28 06:56:14.447051 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.446943 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qbf7k"] Jul 28 06:56:14.452155 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.452093 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.455811 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.455752 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 06:56:14.456183 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.455853 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6w47n\"" Jul 28 06:56:14.456183 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.455777 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 06:56:14.467439 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.467387 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qbf7k"] Jul 28 06:56:14.503809 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.503753 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:14.542708 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.542647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.543005 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.542729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-data-volume\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.543005 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.542766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.543005 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.542787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zqxt\" (UniqueName: \"kubernetes.io/projected/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-api-access-4zqxt\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.543005 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.542893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-crio-socket\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.566197 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.566136 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:14.643491 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.643419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.643491 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.643488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-data-volume\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.643995 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.643523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.643995 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.643545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zqxt\" (UniqueName: \"kubernetes.io/projected/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-api-access-4zqxt\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.643995 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.643594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-crio-socket\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.643995 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:14.643650 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:14.643995 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:14.643680 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:14.643995 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.643736 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-crio-socket\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.643995 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:14.643786 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:15.143755753 +0000 UTC m=+248.149805835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:14.643995 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:14.643827 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:15.143818587 +0000 UTC m=+248.149868670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : configmap "kube-rbac-proxy" not found Jul 28 06:56:14.644382 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.644038 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-data-volume\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:14.655894 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:14.655831 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zqxt\" (UniqueName: \"kubernetes.io/projected/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-api-access-4zqxt\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:15.148142 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:15.148046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:15.148142 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:15.148145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:15.148574 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:15.148248 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:15.148574 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:15.148284 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:15.148574 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:15.148344 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:16.148320436 +0000 UTC m=+249.154370521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : configmap "kube-rbac-proxy" not found Jul 28 06:56:15.148574 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:15.148383 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:16.148361019 +0000 UTC m=+249.154411101 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:15.479677 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:15.479424 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:15.540351 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:15.540274 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:15.695005 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:15.694932 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:15.795852 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:15.795657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:16.156549 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:16.156447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:16.156549 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:16.156557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:16.157054 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:16.156710 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:16.157054 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:16.156710 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:16.157054 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:16.156865 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.156830677 +0000 UTC m=+251.162880763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:16.157054 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:16.156885 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.156876851 +0000 UTC m=+251.162926934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : configmap "kube-rbac-proxy" not found Jul 28 06:56:16.189230 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:16.189161 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:16.289440 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:16.289377 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:16.391092 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:16.391032 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:16.457203 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:16.457058 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gncth_a84a191d-0b3a-460e-99fd-8cdba90483da/dns-node-resolver/0.log" Jul 28 06:56:16.486169 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:16.486109 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:16.586885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:16.586828 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:17.457400 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.457371 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgq6z_b91febb1-5d61-4ade-9023-1e65088aabcb/node-ca/0.log" Jul 28 06:56:17.777172 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.776923 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8vljm"] Jul 28 06:56:17.780919 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.780876 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.783870 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.783813 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 06:56:17.783870 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.783813 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 06:56:17.784249 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.783814 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 06:56:17.784249 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.783840 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 06:56:17.784827 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.784801 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tkgcq\"" Jul 28 06:56:17.788336 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.788284 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8vljm"] Jul 28 06:56:17.815345 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.815285 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:17.868454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.868392 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97c7b275-0896-4ec9-aabf-b59e7c6d176c-signing-key\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.868859 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.868517 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97c7b275-0896-4ec9-aabf-b59e7c6d176c-signing-cabundle\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.868859 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.868607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kgvh\" (UniqueName: \"kubernetes.io/projected/97c7b275-0896-4ec9-aabf-b59e7c6d176c-kube-api-access-6kgvh\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.869127 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.869097 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:17.969246 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.969137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kgvh\" (UniqueName: \"kubernetes.io/projected/97c7b275-0896-4ec9-aabf-b59e7c6d176c-kube-api-access-6kgvh\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.969246 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.969255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97c7b275-0896-4ec9-aabf-b59e7c6d176c-signing-key\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.969760 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.969358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97c7b275-0896-4ec9-aabf-b59e7c6d176c-signing-cabundle\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.970606 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.970570 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/97c7b275-0896-4ec9-aabf-b59e7c6d176c-signing-cabundle\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.973745 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.973703 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/97c7b275-0896-4ec9-aabf-b59e7c6d176c-signing-key\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:17.979925 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:17.979841 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kgvh\" (UniqueName: \"kubernetes.io/projected/97c7b275-0896-4ec9-aabf-b59e7c6d176c-kube-api-access-6kgvh\") pod \"service-ca-658d7b7c78-8vljm\" (UID: \"97c7b275-0896-4ec9-aabf-b59e7c6d176c\") " pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:18.093986 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.093788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:18.097572 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.097532 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" Jul 28 06:56:18.149752 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.149679 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:18.171168 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.171098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:18.171593 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.171228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:18.171593 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:18.171290 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:18.171593 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:18.171394 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:18.171593 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:18.171412 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:22.171381762 +0000 UTC m=+255.177431860 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : configmap "kube-rbac-proxy" not found Jul 28 06:56:18.171593 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:18.171468 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:22.171448697 +0000 UTC m=+255.177498795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:18.304032 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.303959 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-8vljm"] Jul 28 06:56:18.309593 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:56:18.309544 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c7b275_0896_4ec9_aabf_b59e7c6d176c.slice/crio-5280cd9de2a2ff3b0f8524477df60aba410e20d64109d317b5049252b16e30fd WatchSource:0}: Error finding container 5280cd9de2a2ff3b0f8524477df60aba410e20d64109d317b5049252b16e30fd: Status 404 returned error can't find the container with id 5280cd9de2a2ff3b0f8524477df60aba410e20d64109d317b5049252b16e30fd Jul 28 06:56:18.461042 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.460979 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wbr6d_a8ea604e-1844-4326-8044-45a9fd9d3dea/serve-healthcheck-canary/0.log" Jul 28 06:56:18.792679 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.792488 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:18.881767 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:18.881692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" event={"ID":"97c7b275-0896-4ec9-aabf-b59e7c6d176c","Type":"ContainerStarted","Data":"5280cd9de2a2ff3b0f8524477df60aba410e20d64109d317b5049252b16e30fd"} Jul 28 06:56:19.481736 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:19.481652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:56:19.482120 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:19.481875 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 06:56:19.482120 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:19.482005 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs podName:535aec0a-57dd-45d7-9efd-d89e9019edc4 nodeName:}" failed. No retries permitted until 2026-07-28 06:58:21.481969619 +0000 UTC m=+374.488019713 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs") pod "network-metrics-daemon-6rm99" (UID: "535aec0a-57dd-45d7-9efd-d89e9019edc4") : secret "metrics-daemon-secret" not found Jul 28 06:56:20.893329 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:20.893253 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" event={"ID":"97c7b275-0896-4ec9-aabf-b59e7c6d176c","Type":"ContainerStarted","Data":"0ba1561402f8392670d5e9423cf98af9930afe22312d48cf1b762b976865812d"} Jul 28 06:56:20.912000 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:20.911889 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-8vljm" podStartSLOduration=1.858730005 podStartE2EDuration="3.911853246s" totalImagesPullingTime="2.053123241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:20.910366093 +0000 UTC m=+253.916416201" watchObservedRunningTime="2026-07-28 06:56:20.911853246 +0000 UTC m=+253.917903351" Jul 28 06:56:21.077060 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:21.076985 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:22.208220 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:22.208143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:22.209607 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:22.209560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:22.210237 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:22.209395 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:22.210499 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:22.210484 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:30.210446376 +0000 UTC m=+263.216496459 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:22.210645 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:22.209993 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:22.210873 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:22.210842 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:30.210812327 +0000 UTC m=+263.216862415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : configmap "kube-rbac-proxy" not found Jul 28 06:56:22.303473 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:22.303403 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:22.666905 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:22.666840 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:22.723420 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:22.723368 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:22.902099 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:22.902027 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:23.004295 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:23.004127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:23.103082 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:23.103020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:23.857368 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:23.857286 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:24.253092 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:24.252804 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:24.664802 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:24.664744 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:24.854969 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:24.854903 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:25.057967 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:25.057712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:25.397100 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:25.397029 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:26.124785 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:26.124713 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:26.227045 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:26.226967 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:26.293111 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:26.293041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:26.461841 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:26.461577 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:26.657948 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:26.657892 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:26.865995 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:26.865926 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:27.053386 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:27.053312 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:27.686329 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:27.686252 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:28.061540 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:28.061366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:28.452652 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:28.452555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:28.657410 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:28.657346 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:28.804771 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:28.804560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:28.905790 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:28.905712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:29.052776 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:29.052581 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:30.056171 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:30.056119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:30.301222 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:30.301119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:30.301716 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:30.301290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:30.301716 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:30.301534 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:30.301716 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:30.301709 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls podName:87e7ec78-f12a-4cdd-98b9-0e8e10783ad0 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:46.301676376 +0000 UTC m=+279.307726458 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qbf7k" (UID: "87e7ec78-f12a-4cdd-98b9-0e8e10783ad0") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:30.302169 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:30.302139 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:30.466253 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:30.466179 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:30.653949 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:30.653882 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:30.852833 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:30.852778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:31.280123 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:31.279946 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:31.859682 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:31.859590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:32.257048 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:32.256887 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:32.661830 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:32.661760 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:32.853023 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:32.852952 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:33.060372 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:33.060205 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:35.514530 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:35.514449 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:35.611284 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:35.611210 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:35.985679 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:35.985604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:36.089598 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:36.089532 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:36.187792 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:36.187730 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:36.336171 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:36.335983 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:36.476593 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:36.476535 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:36.533633 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:36.533549 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:36.692566 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:36.692503 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:36.750578 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:36.750515 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:37.881747 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:37.881665 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:38.105550 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:38.105490 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:38.208077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:38.207917 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:38.490661 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:38.490425 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:38.659058 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:38.658993 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:39.403856 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:39.403779 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:39.497815 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:39.497746 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:43.499555 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.499476 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:43.601048 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.600972 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:43.708868 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.708794 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cbb7b6ccb-kgwvj"] Jul 28 06:56:43.713762 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.713723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.716445 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.716399 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 06:56:43.716741 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.716474 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 06:56:43.716741 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.716529 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 06:56:43.716741 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.716463 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 06:56:43.716741 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.716595 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 06:56:43.716741 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.716605 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 06:56:43.716741 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.716640 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-xx8w2\"" Jul 28 06:56:43.717093 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.716754 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 06:56:43.719340 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.719299 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbb7b6ccb-kgwvj"] Jul 28 06:56:43.835919 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.835732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-console-config\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.836243 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.835971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-serving-cert\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.836243 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.836027 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-oauth-serving-cert\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.836243 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.836083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-oauth-config\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.836243 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.836125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-service-ca\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.836243 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.836154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpf6m\" (UniqueName: \"kubernetes.io/projected/8916fd28-554b-4f86-b0da-a8da775ff76d-kube-api-access-jpf6m\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.937449 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.937359 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-serving-cert\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.937449 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.937459 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-oauth-serving-cert\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.937977 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.937521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-oauth-config\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.937977 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.937561 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-service-ca\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.937977 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.937590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpf6m\" (UniqueName: \"kubernetes.io/projected/8916fd28-554b-4f86-b0da-a8da775ff76d-kube-api-access-jpf6m\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.937977 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.937709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-console-config\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.938812 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.938765 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-console-config\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.938812 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.938796 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-oauth-serving-cert\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.938812 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.938803 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-service-ca\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.941637 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.941591 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-oauth-config\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.941888 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.941683 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-serving-cert\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:43.947490 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:43.947436 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpf6m\" (UniqueName: \"kubernetes.io/projected/8916fd28-554b-4f86-b0da-a8da775ff76d-kube-api-access-jpf6m\") pod \"console-5cbb7b6ccb-kgwvj\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:44.030656 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:44.030539 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:44.227793 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:44.227735 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:44.240469 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:44.240375 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cbb7b6ccb-kgwvj"] Jul 28 06:56:44.246962 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:56:44.246907 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8916fd28_554b_4f86_b0da_a8da775ff76d.slice/crio-a5fe947855ce02163193715d30e5ffe57ec8421987dadfe46cf571edee1da9b9 WatchSource:0}: Error finding container a5fe947855ce02163193715d30e5ffe57ec8421987dadfe46cf571edee1da9b9: Status 404 returned error can't find the container with id a5fe947855ce02163193715d30e5ffe57ec8421987dadfe46cf571edee1da9b9 Jul 28 06:56:44.323975 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:44.323900 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:44.927591 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:44.927526 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:45.001790 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.001721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbb7b6ccb-kgwvj" event={"ID":"8916fd28-554b-4f86-b0da-a8da775ff76d","Type":"ContainerStarted","Data":"a5fe947855ce02163193715d30e5ffe57ec8421987dadfe46cf571edee1da9b9"} Jul 28 06:56:45.028962 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.028844 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:45.084455 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.084385 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765"] Jul 28 06:56:45.088741 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.088685 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" Jul 28 06:56:45.092069 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.091744 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 28 06:56:45.092069 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.091792 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-djjzl\"" Jul 28 06:56:45.097852 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.097705 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765"] Jul 28 06:56:45.101777 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.101712 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:45.197325 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.197152 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:45.251861 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.251791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00a45fa1-6e05-42f0-99ec-59ccd7c37d31-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-nk765\" (UID: \"00a45fa1-6e05-42f0-99ec-59ccd7c37d31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" Jul 28 06:56:45.352665 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.352566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00a45fa1-6e05-42f0-99ec-59ccd7c37d31-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-nk765\" (UID: \"00a45fa1-6e05-42f0-99ec-59ccd7c37d31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" Jul 28 06:56:45.358086 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.358027 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/00a45fa1-6e05-42f0-99ec-59ccd7c37d31-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-nk765\" (UID: \"00a45fa1-6e05-42f0-99ec-59ccd7c37d31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" Jul 28 06:56:45.413287 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.413219 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" Jul 28 06:56:45.492350 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.492132 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:45.640317 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:45.640260 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765"] Jul 28 06:56:45.645855 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:56:45.645778 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a45fa1_6e05_42f0_99ec_59ccd7c37d31.slice/crio-d2a1da0d86d9888454267bb5ee2c21227fe7a777ca2a37517a5edd0fa298beb6 WatchSource:0}: Error finding container d2a1da0d86d9888454267bb5ee2c21227fe7a777ca2a37517a5edd0fa298beb6: Status 404 returned error can't find the container with id d2a1da0d86d9888454267bb5ee2c21227fe7a777ca2a37517a5edd0fa298beb6 Jul 28 06:56:46.008831 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:46.008765 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" event={"ID":"00a45fa1-6e05-42f0-99ec-59ccd7c37d31","Type":"ContainerStarted","Data":"d2a1da0d86d9888454267bb5ee2c21227fe7a777ca2a37517a5edd0fa298beb6"} Jul 28 06:56:46.364813 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:46.364731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:46.369517 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:46.369453 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/87e7ec78-f12a-4cdd-98b9-0e8e10783ad0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qbf7k\" (UID: \"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0\") " pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:46.569773 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:46.569697 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qbf7k" Jul 28 06:56:47.500114 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:47.500037 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:47.601946 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:47.601879 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:47.762682 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:47.762484 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qbf7k"] Jul 28 06:56:47.768597 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:56:47.768537 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e7ec78_f12a_4cdd_98b9_0e8e10783ad0.slice/crio-5c8f294fd2d43e05cefeaeca1624d060391c2fe8f3d4a957ffbb5c90e2594290 WatchSource:0}: Error finding container 5c8f294fd2d43e05cefeaeca1624d060391c2fe8f3d4a957ffbb5c90e2594290: Status 404 returned error can't find the container with id 5c8f294fd2d43e05cefeaeca1624d060391c2fe8f3d4a957ffbb5c90e2594290 Jul 28 06:56:48.023597 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:48.023393 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" event={"ID":"00a45fa1-6e05-42f0-99ec-59ccd7c37d31","Type":"ContainerStarted","Data":"a9dcf74ffcb0e8c2148bd782f460b9b24070b72efd36dc5fc8e2e95e237c043b"} Jul 28 06:56:48.023923 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:48.023649 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" Jul 28 06:56:48.026000 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:48.025940 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbb7b6ccb-kgwvj" event={"ID":"8916fd28-554b-4f86-b0da-a8da775ff76d","Type":"ContainerStarted","Data":"8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52"} Jul 28 06:56:48.028662 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:48.028566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbf7k" event={"ID":"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0","Type":"ContainerStarted","Data":"5c8f294fd2d43e05cefeaeca1624d060391c2fe8f3d4a957ffbb5c90e2594290"} Jul 28 06:56:48.031534 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:48.031490 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" Jul 28 06:56:48.041502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:48.041399 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-nk765" podStartSLOduration=1.139428938 podStartE2EDuration="3.041366804s" totalImagesPullingTime="1.901937866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:48.040332538 +0000 UTC m=+281.046382644" watchObservedRunningTime="2026-07-28 06:56:48.041366804 +0000 UTC m=+281.047416909" Jul 28 06:56:48.063409 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:48.063310 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5cbb7b6ccb-kgwvj" podStartSLOduration=1.753901816 podStartE2EDuration="5.063280402s" totalImagesPullingTime="3.309378586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:48.06285674 +0000 UTC m=+281.068906847" watchObservedRunningTime="2026-07-28 06:56:48.063280402 +0000 UTC m=+281.069330507" Jul 28 06:56:49.120400 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:49.120352 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:49.228705 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:49.228632 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:49.497490 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:49.497336 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:51.175193 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:51.174500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:51.510971 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:56:51.510790 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wtd45" podUID="19fc102d-1417-4c01-ab64-f9c2c79744ae" Jul 28 06:56:52.049422 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:52.049350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wtd45" Jul 28 06:56:52.111805 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:52.111731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:52.165471 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:52.165398 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:52.714550 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:52.714481 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:52.819586 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:52.819517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:54.031258 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:54.031176 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:54.032202 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:54.031315 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:54.040557 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:54.040482 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:54.067658 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:54.067528 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbf7k" event={"ID":"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0","Type":"ContainerStarted","Data":"5d72f8c52ca58a1f1f76cdac7d518778c37eea6c54014c7f374d042557750710"} Jul 28 06:56:54.075127 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:54.075062 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:56:55.208486 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:55.208410 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:55.349445 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:55.349378 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:55.369879 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:55.369763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:56:55.374172 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:55.374114 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19fc102d-1417-4c01-ab64-f9c2c79744ae-metrics-tls\") pod \"dns-default-wtd45\" (UID: \"19fc102d-1417-4c01-ab64-f9c2c79744ae\") " pod="openshift-dns/dns-default-wtd45" Jul 28 06:56:55.471683 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:55.471515 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:55.654336 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:55.654267 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj4nt\"" Jul 28 06:56:55.662066 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:55.661892 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wtd45" Jul 28 06:56:56.126454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:56.126340 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:56.224954 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:56.224890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:56:57.279309 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:57.279245 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wtd45"] Jul 28 06:56:57.284904 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:56:57.284849 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fc102d_1417_4c01_ab64_f9c2c79744ae.slice/crio-74bb09fdf544980686febb89700b09db2fa51d2b5d547fc475510c8f1c562e86 WatchSource:0}: Error finding container 74bb09fdf544980686febb89700b09db2fa51d2b5d547fc475510c8f1c562e86: Status 404 returned error can't find the container with id 74bb09fdf544980686febb89700b09db2fa51d2b5d547fc475510c8f1c562e86 Jul 28 06:56:58.094907 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:58.094841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbf7k" event={"ID":"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0","Type":"ContainerStarted","Data":"0d095b427d7d89a9370ba5012343fce0b748c4154b68f22b5e1c674bc6f1075d"} Jul 28 06:56:58.096996 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:56:58.096872 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtd45" event={"ID":"19fc102d-1417-4c01-ab64-f9c2c79744ae","Type":"ContainerStarted","Data":"74bb09fdf544980686febb89700b09db2fa51d2b5d547fc475510c8f1c562e86"} Jul 28 06:57:01.196580 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:01.196510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:01.269039 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:01.268984 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:01.356602 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:01.356544 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:01.458738 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:01.458020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:01.555162 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:01.555099 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:02.123066 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:02.122984 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qbf7k" event={"ID":"87e7ec78-f12a-4cdd-98b9-0e8e10783ad0","Type":"ContainerStarted","Data":"70b8eb4b175fc9df2b24588e53b673596a745282190bc1a3a782cc2811590335"} Jul 28 06:57:02.125651 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:02.125575 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtd45" event={"ID":"19fc102d-1417-4c01-ab64-f9c2c79744ae","Type":"ContainerStarted","Data":"9f348f70dccda3304de7f20ee96af4f8ebdf54b5cec81d104f2c305cf281a626"} Jul 28 06:57:02.125981 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:02.125709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wtd45" event={"ID":"19fc102d-1417-4c01-ab64-f9c2c79744ae","Type":"ContainerStarted","Data":"41ca08d2c25fd96d10a28da2a555a2ada98f491a9c464cf55ee765843e490731"} Jul 28 06:57:02.125981 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:02.125855 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wtd45" Jul 28 06:57:02.142675 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:02.142543 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qbf7k" podStartSLOduration=34.925613556 podStartE2EDuration="48.142503446s" totalImagesPullingTime="13.21688989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:56:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:02.140365743 +0000 UTC m=+295.146415864" watchObservedRunningTime="2026-07-28 06:57:02.142503446 +0000 UTC m=+295.148553550" Jul 28 06:57:02.157591 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:02.157496 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wtd45" podStartSLOduration=253.311323991 podStartE2EDuration="4m17.157455817s" totalImagesPullingTime="3.846131826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:02.157052301 +0000 UTC m=+295.163102431" watchObservedRunningTime="2026-07-28 06:57:02.157455817 +0000 UTC m=+295.163505923" Jul 28 06:57:02.256073 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:02.256004 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:03.930329 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:03.930214 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:03.994204 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:03.994126 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:05.520154 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:05.520080 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:05.621259 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:05.621149 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:05.662883 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:57:05.662771 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6rm99" podUID="535aec0a-57dd-45d7-9efd-d89e9019edc4" Jul 28 06:57:06.582559 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:06.582501 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:07.438872 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:07.438826 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 06:57:09.265920 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.265864 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:09.477143 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.477065 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:09.518552 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.518336 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2j8sk"] Jul 28 06:57:09.523359 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.523304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.527161 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.526796 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 06:57:09.527161 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.526841 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 06:57:09.527161 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.526796 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 06:57:09.527775 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.527745 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vhnzd\"" Jul 28 06:57:09.527775 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.527785 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 06:57:09.528141 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.528120 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 06:57:09.528328 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.528166 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 06:57:09.639956 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.639852 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-root\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.640392 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.639952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-textfile\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.640392 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.640044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5044216-d035-4111-92e1-6d7718a5ea8b-metrics-client-ca\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.640392 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.640092 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-tls\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.640392 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.640138 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-sys\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.640392 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.640184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wblg8\" (UniqueName: \"kubernetes.io/projected/e5044216-d035-4111-92e1-6d7718a5ea8b-kube-api-access-wblg8\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.640392 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.640230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.640392 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.640303 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-wtmp\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.640392 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.640332 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.696150 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.696062 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:09.741226 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741144 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wblg8\" (UniqueName: \"kubernetes.io/projected/e5044216-d035-4111-92e1-6d7718a5ea8b-kube-api-access-wblg8\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.741700 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.741700 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-wtmp\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.741700 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.741700 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-root\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.741700 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741473 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-textfile\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.741700 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5044216-d035-4111-92e1-6d7718a5ea8b-metrics-client-ca\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.742081 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741725 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-wtmp\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.742081 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741583 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-root\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.742081 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741803 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-tls\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.742081 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-sys\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.742081 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.741928 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5044216-d035-4111-92e1-6d7718a5ea8b-sys\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.742346 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.742180 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-textfile\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.742552 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.742522 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-accelerators-collector-config\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.742765 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.742732 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5044216-d035-4111-92e1-6d7718a5ea8b-metrics-client-ca\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.746169 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.746130 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.746357 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.746167 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5044216-d035-4111-92e1-6d7718a5ea8b-node-exporter-tls\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.751086 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.751029 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wblg8\" (UniqueName: \"kubernetes.io/projected/e5044216-d035-4111-92e1-6d7718a5ea8b-kube-api-access-wblg8\") pod \"node-exporter-2j8sk\" (UID: \"e5044216-d035-4111-92e1-6d7718a5ea8b\") " pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.795045 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.794853 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:09.842685 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.842584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2j8sk" Jul 28 06:57:09.863217 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:57:09.863145 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5044216_d035_4111_92e1_6d7718a5ea8b.slice/crio-4beb644e481d82838e964fea2443b11c9c64ad6e8fbef5373932c5ae567f39f7 WatchSource:0}: Error finding container 4beb644e481d82838e964fea2443b11c9c64ad6e8fbef5373932c5ae567f39f7: Status 404 returned error can't find the container with id 4beb644e481d82838e964fea2443b11c9c64ad6e8fbef5373932c5ae567f39f7 Jul 28 06:57:09.867187 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.867145 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 06:57:09.877484 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.877404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:09.951639 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:09.951560 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:10.111795 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:10.111719 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:10.164397 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:10.164340 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j8sk" event={"ID":"e5044216-d035-4111-92e1-6d7718a5ea8b","Type":"ContainerStarted","Data":"4beb644e481d82838e964fea2443b11c9c64ad6e8fbef5373932c5ae567f39f7"} Jul 28 06:57:10.425001 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:10.424811 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbb7b6ccb-kgwvj"] Jul 28 06:57:10.511129 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:10.511054 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:10.590368 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:10.590295 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:10.652723 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:10.652642 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:10.729861 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:10.729706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:10.787256 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:10.787191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:11.172715 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:11.172566 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j8sk" event={"ID":"e5044216-d035-4111-92e1-6d7718a5ea8b","Type":"ContainerStarted","Data":"a353dc305421781ec7844a86cf936bff91715c8dcf2c097119e08f0ef5cebbac"} Jul 28 06:57:11.395492 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:11.395430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:12.133507 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.133439 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wtd45" Jul 28 06:57:12.181862 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.181796 2562 generic.go:356] "Generic (PLEG): container finished" podID="e5044216-d035-4111-92e1-6d7718a5ea8b" containerID="a353dc305421781ec7844a86cf936bff91715c8dcf2c097119e08f0ef5cebbac" exitCode=0 Jul 28 06:57:12.182288 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.181877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j8sk" event={"ID":"e5044216-d035-4111-92e1-6d7718a5ea8b","Type":"ContainerDied","Data":"a353dc305421781ec7844a86cf936bff91715c8dcf2c097119e08f0ef5cebbac"} Jul 28 06:57:12.435321 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.435116 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:12.501470 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.501401 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7b798b6f78-w92p8"] Jul 28 06:57:12.513582 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.513511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.518454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.517739 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 28 06:57:12.518454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.517860 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wnstf\"" Jul 28 06:57:12.518454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.518180 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b798b6f78-w92p8"] Jul 28 06:57:12.518454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.518233 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 28 06:57:12.518454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.518374 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 28 06:57:12.518454 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.518402 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fek5fiejcek5t\"" Jul 28 06:57:12.519055 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.518510 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 28 06:57:12.519055 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.518718 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 28 06:57:12.523959 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.523889 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:12.675600 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.675501 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.675600 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.675605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.676073 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.675688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.676073 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.675728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbkg\" (UniqueName: \"kubernetes.io/projected/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-kube-api-access-zdbkg\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.676073 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.675767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.676073 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.675812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-metrics-client-ca\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.676073 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.675848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-grpc-tls\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.676073 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.675887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-tls\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.775031 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.774839 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:12.777083 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.777044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.777425 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.777102 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-metrics-client-ca\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.777425 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.777132 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-grpc-tls\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.777425 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.777156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-tls\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.777425 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.777257 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.777425 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.777300 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.777425 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.777339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.777425 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.777370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbkg\" (UniqueName: \"kubernetes.io/projected/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-kube-api-access-zdbkg\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.778418 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.778366 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-metrics-client-ca\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.781997 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.781925 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.782310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.782013 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-tls\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.782310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.782025 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-grpc-tls\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.782310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.782067 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.782482 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.782450 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.782544 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.782513 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.788349 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.788293 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbkg\" (UniqueName: \"kubernetes.io/projected/6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59-kube-api-access-zdbkg\") pod \"thanos-querier-7b798b6f78-w92p8\" (UID: \"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59\") " pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:12.832125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:12.832034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:13.034141 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.033949 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:13.053590 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.053507 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7b798b6f78-w92p8"] Jul 28 06:57:13.058694 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:57:13.058599 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f0b5c38_ce2b_48be_a8f4_5dc7ed379f59.slice/crio-f097c83521d765cd7a437c00e0c62b3ef9c6a4f18c7d52f9c228ef6a07af1b33 WatchSource:0}: Error finding container f097c83521d765cd7a437c00e0c62b3ef9c6a4f18c7d52f9c228ef6a07af1b33: Status 404 returned error can't find the container with id f097c83521d765cd7a437c00e0c62b3ef9c6a4f18c7d52f9c228ef6a07af1b33 Jul 28 06:57:13.191667 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.191545 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j8sk" event={"ID":"e5044216-d035-4111-92e1-6d7718a5ea8b","Type":"ContainerStarted","Data":"81db1056d6576b0d1921ff08851df4c737fbc994e4fdefa9767de3f413d2d4d7"} Jul 28 06:57:13.192501 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.191771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2j8sk" event={"ID":"e5044216-d035-4111-92e1-6d7718a5ea8b","Type":"ContainerStarted","Data":"fd218f8c996f6a5da641042d448f88d621246f28e91b0e49c3d06659398a3047"} Jul 28 06:57:13.193602 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.193544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" event={"ID":"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59","Type":"ContainerStarted","Data":"f097c83521d765cd7a437c00e0c62b3ef9c6a4f18c7d52f9c228ef6a07af1b33"} Jul 28 06:57:13.217173 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.217059 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2j8sk" podStartSLOduration=2.992920393 podStartE2EDuration="4.217020239s" totalImagesPullingTime="1.113819501s" totalInitContainerRuntime="110.280345ms" isStatefulPod=true podCreationTimestamp="2026-07-28 06:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:13.215227802 +0000 UTC m=+306.221277910" watchObservedRunningTime="2026-07-28 06:57:13.217020239 +0000 UTC m=+306.223070343" Jul 28 06:57:13.947758 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.947684 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-647dd75c5-d5cr8"] Jul 28 06:57:13.952424 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.952375 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:13.955670 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.955577 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 28 06:57:13.956109 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.956077 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 28 06:57:13.956259 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.956191 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 28 06:57:13.956777 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.956746 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-70jlkkoed9j7i\"" Jul 28 06:57:13.956945 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.956794 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 28 06:57:13.957204 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.957181 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7x98h\"" Jul 28 06:57:13.983453 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:13.983382 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-647dd75c5-d5cr8"] Jul 28 06:57:14.096666 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.096585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/95efe372-edf0-40bc-a4ed-699aac82546e-audit-log\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.097079 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.096758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/95efe372-edf0-40bc-a4ed-699aac82546e-metrics-server-audit-profiles\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.097079 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.096814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-client-ca-bundle\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.097079 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.096917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-secret-metrics-server-tls\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.097079 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.096965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6bw\" (UniqueName: \"kubernetes.io/projected/95efe372-edf0-40bc-a4ed-699aac82546e-kube-api-access-zw6bw\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.097079 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.097020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95efe372-edf0-40bc-a4ed-699aac82546e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.097079 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.097068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-secret-metrics-server-client-certs\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.198557 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.198376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-secret-metrics-server-tls\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.198557 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.198462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6bw\" (UniqueName: \"kubernetes.io/projected/95efe372-edf0-40bc-a4ed-699aac82546e-kube-api-access-zw6bw\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.198557 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.198507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95efe372-edf0-40bc-a4ed-699aac82546e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.198557 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.198548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-secret-metrics-server-client-certs\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.199590 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.198708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/95efe372-edf0-40bc-a4ed-699aac82546e-audit-log\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.199590 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.198772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/95efe372-edf0-40bc-a4ed-699aac82546e-metrics-server-audit-profiles\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.199590 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.198800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-client-ca-bundle\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.199879 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.199690 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/95efe372-edf0-40bc-a4ed-699aac82546e-audit-log\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.200440 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.200408 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95efe372-edf0-40bc-a4ed-699aac82546e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.200728 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.200695 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/95efe372-edf0-40bc-a4ed-699aac82546e-metrics-server-audit-profiles\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.203212 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.203169 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-secret-metrics-server-tls\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.203212 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.203211 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-client-ca-bundle\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.203523 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.203311 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/95efe372-edf0-40bc-a4ed-699aac82546e-secret-metrics-server-client-certs\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.209046 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.208991 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6bw\" (UniqueName: \"kubernetes.io/projected/95efe372-edf0-40bc-a4ed-699aac82546e-kube-api-access-zw6bw\") pod \"metrics-server-647dd75c5-d5cr8\" (UID: \"95efe372-edf0-40bc-a4ed-699aac82546e\") " pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.270703 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.270317 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:14.294399 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.294238 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:14.300038 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.297782 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d84fbc99-k4jx5"] Jul 28 06:57:14.305490 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.303968 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.313992 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.313919 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d84fbc99-k4jx5"] Jul 28 06:57:14.320119 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.319558 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 06:57:14.394882 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.394818 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:14.401276 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.401172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-config\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.401276 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.401267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-trusted-ca-bundle\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.401734 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.401330 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-oauth-serving-cert\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.401734 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.401435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-serving-cert\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.401734 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.401466 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-service-ca\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.401734 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.401519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-oauth-config\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.401734 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.401665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8ff\" (UniqueName: \"kubernetes.io/projected/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-kube-api-access-mh8ff\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.495843 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.495672 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:14.503310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.503250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-serving-cert\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.503310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.503315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-service-ca\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.504034 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.503394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-oauth-config\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.504034 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.503457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8ff\" (UniqueName: \"kubernetes.io/projected/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-kube-api-access-mh8ff\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.504034 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.503527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-config\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.504034 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.503555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-trusted-ca-bundle\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.504034 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.503607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-oauth-serving-cert\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.504748 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.504672 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-service-ca\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.505713 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.505610 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-config\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.506333 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.506302 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-oauth-serving-cert\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.506743 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.506706 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-trusted-ca-bundle\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.508295 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.508243 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-serving-cert\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.509423 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.509381 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-oauth-config\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.513290 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.513203 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8ff\" (UniqueName: \"kubernetes.io/projected/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-kube-api-access-mh8ff\") pod \"console-86d84fbc99-k4jx5\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.517600 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.517540 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-647dd75c5-d5cr8"] Jul 28 06:57:14.556225 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.556156 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:14.630857 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.630782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:14.689887 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.689821 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85b847d9d5-pw7jz"] Jul 28 06:57:14.696671 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.696563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.701002 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.700951 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 28 06:57:14.701002 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.700951 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 28 06:57:14.702485 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.702432 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-f92dv\"" Jul 28 06:57:14.702759 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.702529 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 28 06:57:14.702759 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.702574 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 28 06:57:14.702759 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.702433 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 28 06:57:14.708890 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.708831 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 28 06:57:14.713057 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.713012 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85b847d9d5-pw7jz"] Jul 28 06:57:14.731925 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.731849 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:14.806867 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.806694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-serving-certs-ca-bundle\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.806867 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.806827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-secret-telemeter-client\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.806867 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.806862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-telemeter-client-tls\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.807383 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.806960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-metrics-client-ca\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.807383 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.807023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.807383 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.807052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.807383 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.807094 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2sll\" (UniqueName: \"kubernetes.io/projected/86ac42bb-6149-4a4e-81ab-24d316a5c802-kube-api-access-v2sll\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.807383 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.807189 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-federate-client-tls\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.908593 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.908517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-serving-certs-ca-bundle\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.908899 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.908683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-secret-telemeter-client\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.908899 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.908727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-telemeter-client-tls\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.908899 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.908786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-metrics-client-ca\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.908899 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.908832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.908899 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.908856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.908899 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.908882 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2sll\" (UniqueName: \"kubernetes.io/projected/86ac42bb-6149-4a4e-81ab-24d316a5c802-kube-api-access-v2sll\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.909105 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.908926 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-federate-client-tls\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.909490 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.909439 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-serving-certs-ca-bundle\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.909661 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.909610 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-metrics-client-ca\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.910914 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.910832 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/86ac42bb-6149-4a4e-81ab-24d316a5c802-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.913701 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.913596 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.913953 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.913597 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-telemeter-client-tls\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.913953 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.913783 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-federate-client-tls\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.913953 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.913780 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/86ac42bb-6149-4a4e-81ab-24d316a5c802-secret-telemeter-client\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.920511 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:14.920458 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2sll\" (UniqueName: \"kubernetes.io/projected/86ac42bb-6149-4a4e-81ab-24d316a5c802-kube-api-access-v2sll\") pod \"telemeter-client-85b847d9d5-pw7jz\" (UID: \"86ac42bb-6149-4a4e-81ab-24d316a5c802\") " pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:14.951395 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:57:14.951325 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95efe372_edf0_40bc_a4ed_699aac82546e.slice/crio-b74fb6b22454d1a64c5559a5e7e3e8d287682d3506e8c5f94ac3ceedfbf5b49c WatchSource:0}: Error finding container b74fb6b22454d1a64c5559a5e7e3e8d287682d3506e8c5f94ac3ceedfbf5b49c: Status 404 returned error can't find the container with id b74fb6b22454d1a64c5559a5e7e3e8d287682d3506e8c5f94ac3ceedfbf5b49c Jul 28 06:57:15.016506 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.016465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" Jul 28 06:57:15.125911 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.125829 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:15.168642 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.168546 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d84fbc99-k4jx5"] Jul 28 06:57:15.215053 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.214985 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" event={"ID":"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59","Type":"ContainerStarted","Data":"8f100e27d7f738fd7902609ab6f778cabbdd531f3b8280e34314d3ed65d749e5"} Jul 28 06:57:15.217780 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.217691 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d84fbc99-k4jx5" event={"ID":"5ed1e1cb-f0cc-4411-8b45-350dc00971e9","Type":"ContainerStarted","Data":"fe17003bc798c5d11ab121fad284e19b45e5ee3eb09e4f51a5cd297a2fc0d847"} Jul 28 06:57:15.220453 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.220224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" event={"ID":"95efe372-edf0-40bc-a4ed-699aac82546e","Type":"ContainerStarted","Data":"b74fb6b22454d1a64c5559a5e7e3e8d287682d3506e8c5f94ac3ceedfbf5b49c"} Jul 28 06:57:15.227082 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.226999 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:15.273997 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.273916 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85b847d9d5-pw7jz"] Jul 28 06:57:15.287836 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:57:15.287589 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86ac42bb_6149_4a4e_81ab_24d316a5c802.slice/crio-df1064e9a240b1f8e81dd53ac6ecc8a779ba73ec56b80ddeafcbb613d207f987 WatchSource:0}: Error finding container df1064e9a240b1f8e81dd53ac6ecc8a779ba73ec56b80ddeafcbb613d207f987: Status 404 returned error can't find the container with id df1064e9a240b1f8e81dd53ac6ecc8a779ba73ec56b80ddeafcbb613d207f987 Jul 28 06:57:15.700361 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.700292 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:15.704593 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.704316 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:57:15.719531 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.719456 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.723748 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.723475 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ftxkq\"" Jul 28 06:57:15.724067 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.723900 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 28 06:57:15.724148 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724088 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8vo7hhfp8sij0\"" Jul 28 06:57:15.724202 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724178 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 28 06:57:15.724559 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724423 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 28 06:57:15.724559 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724456 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 28 06:57:15.724559 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724493 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:57:15.724885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724598 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 28 06:57:15.724885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724812 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 28 06:57:15.724885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724832 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 28 06:57:15.724885 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.724850 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 28 06:57:15.725077 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.725010 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 28 06:57:15.725169 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.725151 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 28 06:57:15.726071 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.726038 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 28 06:57:15.727304 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.727271 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 28 06:57:15.728154 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.728126 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 28 06:57:15.731324 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.731172 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 28 06:57:15.821334 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.821334 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.821816 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.821816 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.821816 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.821816 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60464beb-c2d9-408a-ac17-5e034d67a84b-config-out\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.821816 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.821816 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822069 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822069 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-web-config\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822069 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822069 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821928 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822069 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.821987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822069 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.822057 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-config\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.822083 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60464beb-c2d9-408a-ac17-5e034d67a84b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.822113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.822148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.822184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.822226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wjcc\" (UniqueName: \"kubernetes.io/projected/60464beb-c2d9-408a-ac17-5e034d67a84b-kube-api-access-5wjcc\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.822562 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.822319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924232 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924157 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-config\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60464beb-c2d9-408a-ac17-5e034d67a84b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wjcc\" (UniqueName: \"kubernetes.io/projected/60464beb-c2d9-408a-ac17-5e034d67a84b-kube-api-access-5wjcc\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.924828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.924711 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.925970 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.925490 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.925970 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.925650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.925970 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.925701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.925970 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.925764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.925970 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.925832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60464beb-c2d9-408a-ac17-5e034d67a84b-config-out\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.926390 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.926214 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.927001 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.927015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.927136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.927203 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.927398 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.927438 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-web-config\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.927527 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928149 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.927580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.928694 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.928271 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.931753 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.929896 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60464beb-c2d9-408a-ac17-5e034d67a84b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.931753 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.931011 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.931753 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.931071 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-config\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.931753 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.931575 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.931753 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.931762 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.932190 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.932057 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.934301 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.934099 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.935288 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.935055 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60464beb-c2d9-408a-ac17-5e034d67a84b-config-out\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.935288 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.935219 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.935593 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.935353 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.937235 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.935973 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.943160 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.937880 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.943160 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.939336 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60464beb-c2d9-408a-ac17-5e034d67a84b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.943160 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.940901 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wjcc\" (UniqueName: \"kubernetes.io/projected/60464beb-c2d9-408a-ac17-5e034d67a84b-kube-api-access-5wjcc\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.944291 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.943970 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-web-config\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:15.948502 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:15.948455 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60464beb-c2d9-408a-ac17-5e034d67a84b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60464beb-c2d9-408a-ac17-5e034d67a84b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:16.041233 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:16.041034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:16.236266 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:16.235942 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" event={"ID":"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59","Type":"ContainerStarted","Data":"5871c84648ec5fdc940e1088855b877b4b2d96aa321897a8489a0337b6ef2d58"} Jul 28 06:57:16.236266 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:16.236171 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" event={"ID":"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59","Type":"ContainerStarted","Data":"65ab2928a11fa5313d848935e01a4e5937691d91dc1c3f6cb8e2a637c49d87fa"} Jul 28 06:57:16.240230 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:16.240151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d84fbc99-k4jx5" event={"ID":"5ed1e1cb-f0cc-4411-8b45-350dc00971e9","Type":"ContainerStarted","Data":"89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f"} Jul 28 06:57:16.249730 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:16.249567 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" event={"ID":"86ac42bb-6149-4a4e-81ab-24d316a5c802","Type":"ContainerStarted","Data":"df1064e9a240b1f8e81dd53ac6ecc8a779ba73ec56b80ddeafcbb613d207f987"} Jul 28 06:57:16.260027 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:16.259902 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d84fbc99-k4jx5" podStartSLOduration=2.259857865 podStartE2EDuration="2.259857865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:16.258060067 +0000 UTC m=+309.264110220" watchObservedRunningTime="2026-07-28 06:57:16.259857865 +0000 UTC m=+309.265907950" Jul 28 06:57:16.322780 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:16.322728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 28 06:57:16.797601 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:57:16.797528 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60464beb_c2d9_408a_ac17_5e034d67a84b.slice/crio-9c8ec22ce7b0efe45241f8a61a7d38c9c81f2655120b732ba4e34712c808b2e4 WatchSource:0}: Error finding container 9c8ec22ce7b0efe45241f8a61a7d38c9c81f2655120b732ba4e34712c808b2e4: Status 404 returned error can't find the container with id 9c8ec22ce7b0efe45241f8a61a7d38c9c81f2655120b732ba4e34712c808b2e4 Jul 28 06:57:17.258394 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:17.258250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60464beb-c2d9-408a-ac17-5e034d67a84b","Type":"ContainerStarted","Data":"9c8ec22ce7b0efe45241f8a61a7d38c9c81f2655120b732ba4e34712c808b2e4"} Jul 28 06:57:18.272584 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:18.272425 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" event={"ID":"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59","Type":"ContainerStarted","Data":"345acbe48a4bc7f35c021a06714aa01196d38298bc33f08feea609cff9eb4c86"} Jul 28 06:57:18.275811 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:18.275692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" event={"ID":"95efe372-edf0-40bc-a4ed-699aac82546e","Type":"ContainerStarted","Data":"74b630e148d8b2e4a70fde8f89828cd8c25600be1f10e560bfa2da0334c5fba5"} Jul 28 06:57:18.279708 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:18.279643 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" event={"ID":"86ac42bb-6149-4a4e-81ab-24d316a5c802","Type":"ContainerStarted","Data":"959bc4c7cbc292058ee313136ad8c3e03193dae9e5ce1b6ab48d2bc5cd9b1d8a"} Jul 28 06:57:18.296357 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:18.296212 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" podStartSLOduration=2.238120032 podStartE2EDuration="5.296174538s" totalImagesPullingTime="3.058054506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:18.293532902 +0000 UTC m=+311.299583254" watchObservedRunningTime="2026-07-28 06:57:18.296174538 +0000 UTC m=+311.302224642" Jul 28 06:57:18.661116 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:18.661036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:57:19.290000 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:19.289922 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" event={"ID":"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59","Type":"ContainerStarted","Data":"4a102ab61394cfe7c5445b280659f422be54dd90489e6aa602bd8fbfd275265d"} Jul 28 06:57:19.290863 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:19.290120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" event={"ID":"6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59","Type":"ContainerStarted","Data":"10aadfd9e069327bcdc7874e8ea73bc4dc4a9cb3649b76e59bd7b49a0bc6ac1f"} Jul 28 06:57:19.290863 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:19.290364 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:19.292596 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:19.292553 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" event={"ID":"86ac42bb-6149-4a4e-81ab-24d316a5c802","Type":"ContainerStarted","Data":"1b917221ae0f8ed3c02d76fbfb5e3da37073d99aae318ecf74b59dd494cf5e51"} Jul 28 06:57:19.294881 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:19.294833 2562 generic.go:356] "Generic (PLEG): container finished" podID="60464beb-c2d9-408a-ac17-5e034d67a84b" containerID="d0a900cf92b454181b4e22936987f8842da0eaf82b391d64f95615d422de3696" exitCode=0 Jul 28 06:57:19.295108 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:19.294919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60464beb-c2d9-408a-ac17-5e034d67a84b","Type":"ContainerDied","Data":"d0a900cf92b454181b4e22936987f8842da0eaf82b391d64f95615d422de3696"} Jul 28 06:57:19.314490 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:19.314388 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" podStartSLOduration=2.7348770780000002 podStartE2EDuration="7.31433656s" totalImagesPullingTime="4.579459482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:19.311859721 +0000 UTC m=+312.317909826" watchObservedRunningTime="2026-07-28 06:57:19.31433656 +0000 UTC m=+312.320387132" Jul 28 06:57:19.879258 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:19.879142 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" podUID="84e89106-61cd-43b7-bc50-b423cd29014f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 28 06:57:20.306846 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:20.306650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" event={"ID":"86ac42bb-6149-4a4e-81ab-24d316a5c802","Type":"ContainerStarted","Data":"9f3f0243d52176ec57726fa6e135d1c29a9d627b828248ef8a74f5928750344d"} Jul 28 06:57:20.316975 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:20.316900 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7b798b6f78-w92p8" Jul 28 06:57:20.332828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:20.332705 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85b847d9d5-pw7jz" podStartSLOduration=2.770857711 podStartE2EDuration="6.332612554s" totalImagesPullingTime="3.561754843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:20.329410197 +0000 UTC m=+313.335460320" watchObservedRunningTime="2026-07-28 06:57:20.332612554 +0000 UTC m=+313.338662660" Jul 28 06:57:20.517881 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:20.517815 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:20.617251 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:20.617173 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:21.298132 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.298048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:21.358676 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.358582 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d84fbc99-k4jx5"] Jul 28 06:57:21.386958 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.386874 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-847c9dd6ff-m79wv"] Jul 28 06:57:21.389140 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.389066 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:21.407037 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.406960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847c9dd6ff-m79wv"] Jul 28 06:57:21.407421 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.407180 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.518999 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.518895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-config\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.519363 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.519114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-trusted-ca-bundle\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.519363 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.519178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-service-ca\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.519363 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.519282 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-serving-cert\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.519363 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.519318 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml7dl\" (UniqueName: \"kubernetes.io/projected/c94257ef-6345-47f5-ae1c-74aecca8fbbd-kube-api-access-ml7dl\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.519363 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.519358 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-oauth-config\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.519798 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.519747 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-oauth-serving-cert\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.621845 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.621766 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-config\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.622261 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.621895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-trusted-ca-bundle\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.622261 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.621947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-service-ca\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.622261 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.622023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-serving-cert\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.622261 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.622065 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml7dl\" (UniqueName: \"kubernetes.io/projected/c94257ef-6345-47f5-ae1c-74aecca8fbbd-kube-api-access-ml7dl\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.622261 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.622107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-oauth-config\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.622261 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.622160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-oauth-serving-cert\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.623368 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.623082 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-service-ca\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.623368 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.623086 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-config\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.623368 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.623189 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-trusted-ca-bundle\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.623368 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.623234 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-oauth-serving-cert\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.627337 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.627282 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-oauth-config\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.627655 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.627289 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-serving-cert\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.634164 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.634090 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml7dl\" (UniqueName: \"kubernetes.io/projected/c94257ef-6345-47f5-ae1c-74aecca8fbbd-kube-api-access-ml7dl\") pod \"console-847c9dd6ff-m79wv\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:21.730697 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:21.730589 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:22.788384 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:22.788315 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-847c9dd6ff-m79wv"] Jul 28 06:57:22.872118 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:57:22.871960 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94257ef_6345_47f5_ae1c_74aecca8fbbd.slice/crio-9a9ba4a1a18e602747f3d9d55fbb83b8a88bdb02460443bc833309a235154dc5 WatchSource:0}: Error finding container 9a9ba4a1a18e602747f3d9d55fbb83b8a88bdb02460443bc833309a235154dc5: Status 404 returned error can't find the container with id 9a9ba4a1a18e602747f3d9d55fbb83b8a88bdb02460443bc833309a235154dc5 Jul 28 06:57:23.328381 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:23.328325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847c9dd6ff-m79wv" event={"ID":"c94257ef-6345-47f5-ae1c-74aecca8fbbd","Type":"ContainerStarted","Data":"9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc"} Jul 28 06:57:23.328777 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:23.328426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847c9dd6ff-m79wv" event={"ID":"c94257ef-6345-47f5-ae1c-74aecca8fbbd","Type":"ContainerStarted","Data":"9a9ba4a1a18e602747f3d9d55fbb83b8a88bdb02460443bc833309a235154dc5"} Jul 28 06:57:23.333133 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:23.333101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60464beb-c2d9-408a-ac17-5e034d67a84b","Type":"ContainerStarted","Data":"e53d1602cc223ca1c866d5fc24f20778db5601672c49c60a6697aa9817377f07"} Jul 28 06:57:23.333282 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:23.333175 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60464beb-c2d9-408a-ac17-5e034d67a84b","Type":"ContainerStarted","Data":"f0cb895d7b4b566f1486d4bdfe883bae919ddc695d555d2240982e28092d34de"} Jul 28 06:57:23.346928 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:23.346793 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-847c9dd6ff-m79wv" podStartSLOduration=2.3467530549999998 podStartE2EDuration="2.346753055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:23.345257339 +0000 UTC m=+316.351307446" watchObservedRunningTime="2026-07-28 06:57:23.346753055 +0000 UTC m=+316.352803160" Jul 28 06:57:24.345223 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:24.345144 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60464beb-c2d9-408a-ac17-5e034d67a84b","Type":"ContainerStarted","Data":"f28983b908dddd8fd4d97c4e89b25aae8738979d66eaaad8277f197608557961"} Jul 28 06:57:24.346247 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:24.345336 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60464beb-c2d9-408a-ac17-5e034d67a84b","Type":"ContainerStarted","Data":"b26123ecbfc3cecc54bfb84b3142581677af698b271d53499c2a6c1f0a387a35"} Jul 28 06:57:24.346247 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:24.345378 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60464beb-c2d9-408a-ac17-5e034d67a84b","Type":"ContainerStarted","Data":"c72ce19e670b1f02673de9abfeea84987300a14e462a600b3b3670abf33a4be4"} Jul 28 06:57:24.346247 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:24.345420 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60464beb-c2d9-408a-ac17-5e034d67a84b","Type":"ContainerStarted","Data":"8c7a25a17165df097a360e4844cb78277681ddd91a78c7197336bd1065fb23fe"} Jul 28 06:57:24.378315 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:24.378188 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.469790845 podStartE2EDuration="9.378144585s" totalImagesPullingTime="5.871930335s" totalInitContainerRuntime="36.423405ms" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:24.376193322 +0000 UTC m=+317.382243428" watchObservedRunningTime="2026-07-28 06:57:24.378144585 +0000 UTC m=+317.384194690" Jul 28 06:57:24.631592 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:24.631508 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:26.042004 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:26.041916 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:57:29.375613 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:29.375544 2562 generic.go:356] "Generic (PLEG): container finished" podID="a79a3c4f-ce8a-40ba-8097-271ad21977ba" containerID="2806e9a8d4136efb80df573f8b2c581d95bd8780f77f98d18c80ca261b34cb4e" exitCode=0 Jul 28 06:57:29.376355 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:29.375663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6qzxd" event={"ID":"a79a3c4f-ce8a-40ba-8097-271ad21977ba","Type":"ContainerDied","Data":"2806e9a8d4136efb80df573f8b2c581d95bd8780f77f98d18c80ca261b34cb4e"} Jul 28 06:57:29.376355 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:29.376347 2562 scope.go:117] "RemoveContainer" containerID="2806e9a8d4136efb80df573f8b2c581d95bd8780f77f98d18c80ca261b34cb4e" Jul 28 06:57:29.878967 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:29.878892 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" podUID="84e89106-61cd-43b7-bc50-b423cd29014f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 28 06:57:30.311007 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:30.310837 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wbr6d_a8ea604e-1844-4326-8044-45a9fd9d3dea/serve-healthcheck-canary/0.log" Jul 28 06:57:30.385531 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:30.385445 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-6qzxd" event={"ID":"a79a3c4f-ce8a-40ba-8097-271ad21977ba","Type":"ContainerStarted","Data":"1bc43f6c8d2dbd3c6a2b1748e66beeddc5b5b79f846b318b8bad8332b42086d8"} Jul 28 06:57:31.731361 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:31.731283 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:31.732247 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:31.731412 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:31.738483 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:31.738431 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:32.411735 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:32.411675 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:57:32.620150 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:32.620085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:32.711794 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:32.711593 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:32.764828 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:32.764763 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:34.271193 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:34.271073 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:34.272158 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:34.271252 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:35.457001 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.456922 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5cbb7b6ccb-kgwvj" podUID="8916fd28-554b-4f86-b0da-a8da775ff76d" containerName="console" containerID="cri-o://8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52" gracePeriod=15 Jul 28 06:57:35.534416 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.534354 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:35.594988 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.594925 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:35.786088 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.786026 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:57:35.812900 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.812826 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-service-ca\") pod \"8916fd28-554b-4f86-b0da-a8da775ff76d\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " Jul 28 06:57:35.813310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.812987 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-oauth-serving-cert\") pod \"8916fd28-554b-4f86-b0da-a8da775ff76d\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " Jul 28 06:57:35.813310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.813081 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpf6m\" (UniqueName: \"kubernetes.io/projected/8916fd28-554b-4f86-b0da-a8da775ff76d-kube-api-access-jpf6m\") pod \"8916fd28-554b-4f86-b0da-a8da775ff76d\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " Jul 28 06:57:35.813310 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.813155 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-console-config\") pod \"8916fd28-554b-4f86-b0da-a8da775ff76d\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " Jul 28 06:57:35.813483 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.813410 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-serving-cert\") pod \"8916fd28-554b-4f86-b0da-a8da775ff76d\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " Jul 28 06:57:35.813483 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.813466 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-oauth-config\") pod \"8916fd28-554b-4f86-b0da-a8da775ff76d\" (UID: \"8916fd28-554b-4f86-b0da-a8da775ff76d\") " Jul 28 06:57:35.813692 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.813660 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-service-ca" (OuterVolumeSpecName: "service-ca") pod "8916fd28-554b-4f86-b0da-a8da775ff76d" (UID: "8916fd28-554b-4f86-b0da-a8da775ff76d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:35.814207 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.814103 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8916fd28-554b-4f86-b0da-a8da775ff76d" (UID: "8916fd28-554b-4f86-b0da-a8da775ff76d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:35.814207 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.814140 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-console-config" (OuterVolumeSpecName: "console-config") pod "8916fd28-554b-4f86-b0da-a8da775ff76d" (UID: "8916fd28-554b-4f86-b0da-a8da775ff76d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:35.814434 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.814380 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-service-ca\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:35.814434 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.814399 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-oauth-serving-cert\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:35.814434 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.814411 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8916fd28-554b-4f86-b0da-a8da775ff76d-console-config\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:35.817713 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.817660 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8916fd28-554b-4f86-b0da-a8da775ff76d" (UID: "8916fd28-554b-4f86-b0da-a8da775ff76d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:57:35.817713 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.817694 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8916fd28-554b-4f86-b0da-a8da775ff76d" (UID: "8916fd28-554b-4f86-b0da-a8da775ff76d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:57:35.817940 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.817677 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8916fd28-554b-4f86-b0da-a8da775ff76d-kube-api-access-jpf6m" (OuterVolumeSpecName: "kube-api-access-jpf6m") pod "8916fd28-554b-4f86-b0da-a8da775ff76d" (UID: "8916fd28-554b-4f86-b0da-a8da775ff76d"). InnerVolumeSpecName "kube-api-access-jpf6m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:57:35.915453 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.915361 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpf6m\" (UniqueName: \"kubernetes.io/projected/8916fd28-554b-4f86-b0da-a8da775ff76d-kube-api-access-jpf6m\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:35.915453 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.915429 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-serving-cert\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:35.915453 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:35.915445 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8916fd28-554b-4f86-b0da-a8da775ff76d-console-oauth-config\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:36.433593 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.433523 2562 generic.go:356] "Generic (PLEG): container finished" podID="8916fd28-554b-4f86-b0da-a8da775ff76d" containerID="8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52" exitCode=0 Jul 28 06:57:36.433593 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.433604 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cbb7b6ccb-kgwvj" Jul 28 06:57:36.434027 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.433661 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbb7b6ccb-kgwvj" event={"ID":"8916fd28-554b-4f86-b0da-a8da775ff76d","Type":"ContainerDied","Data":"8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52"} Jul 28 06:57:36.434027 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.433775 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cbb7b6ccb-kgwvj" event={"ID":"8916fd28-554b-4f86-b0da-a8da775ff76d","Type":"ContainerDied","Data":"a5fe947855ce02163193715d30e5ffe57ec8421987dadfe46cf571edee1da9b9"} Jul 28 06:57:36.434027 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.433834 2562 scope.go:117] "RemoveContainer" containerID="8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52" Jul 28 06:57:36.449535 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.449501 2562 scope.go:117] "RemoveContainer" containerID="8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52" Jul 28 06:57:36.450209 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:57:36.450163 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52\": container with ID starting with 8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52 not found: ID does not exist" containerID="8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52" Jul 28 06:57:36.450331 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.450239 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52"} err="failed to get container status \"8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52\": rpc error: code = NotFound desc = could not find container \"8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52\": container with ID starting with 8f95541a2d8deed3cba6ae624adf8ba9db55a280a511e03892862a1abb1aac52 not found: ID does not exist" Jul 28 06:57:36.460783 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.460685 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cbb7b6ccb-kgwvj"] Jul 28 06:57:36.472749 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:36.472654 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cbb7b6ccb-kgwvj"] Jul 28 06:57:37.668083 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:37.668016 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8916fd28-554b-4f86-b0da-a8da775ff76d" path="/var/lib/kubelet/pods/8916fd28-554b-4f86-b0da-a8da775ff76d/volumes" Jul 28 06:57:39.879370 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:39.879298 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" podUID="84e89106-61cd-43b7-bc50-b423cd29014f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 28 06:57:39.880054 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:39.879447 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" Jul 28 06:57:39.880491 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:39.880459 2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"e0a59e4f3fe3e11455ec322d3a9b94883695c3d4d1cf777cafc2d1fe8e6f5fe8"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 28 06:57:39.880561 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:39.880536 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" podUID="84e89106-61cd-43b7-bc50-b423cd29014f" containerName="service-proxy" containerID="cri-o://e0a59e4f3fe3e11455ec322d3a9b94883695c3d4d1cf777cafc2d1fe8e6f5fe8" gracePeriod=30 Jul 28 06:57:40.463549 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:40.463483 2562 generic.go:356] "Generic (PLEG): container finished" podID="84e89106-61cd-43b7-bc50-b423cd29014f" containerID="e0a59e4f3fe3e11455ec322d3a9b94883695c3d4d1cf777cafc2d1fe8e6f5fe8" exitCode=2 Jul 28 06:57:40.463886 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:40.463562 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" event={"ID":"84e89106-61cd-43b7-bc50-b423cd29014f","Type":"ContainerDied","Data":"e0a59e4f3fe3e11455ec322d3a9b94883695c3d4d1cf777cafc2d1fe8e6f5fe8"} Jul 28 06:57:40.463886 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:40.463734 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-766577c456-g9fss" event={"ID":"84e89106-61cd-43b7-bc50-b423cd29014f","Type":"ContainerStarted","Data":"05daf810bb90c1e4c769ce7acb09aa3462690368d1057fd23f0bfe7f9926d379"} Jul 28 06:57:44.766024 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:44.765944 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:44.868609 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:44.868536 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:44.968810 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:44.968731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:57:46.386721 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.386593 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d84fbc99-k4jx5" podUID="5ed1e1cb-f0cc-4411-8b45-350dc00971e9" containerName="console" containerID="cri-o://89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f" gracePeriod=15 Jul 28 06:57:46.740868 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.740813 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:46.870519 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.870432 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-oauth-serving-cert\") pod \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " Jul 28 06:57:46.870519 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.870540 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-oauth-config\") pod \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " Jul 28 06:57:46.870903 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.870577 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-serving-cert\") pod \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " Jul 28 06:57:46.870903 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.870672 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-config\") pod \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " Jul 28 06:57:46.870903 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.870795 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-service-ca\") pod \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " Jul 28 06:57:46.870903 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.870847 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh8ff\" (UniqueName: \"kubernetes.io/projected/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-kube-api-access-mh8ff\") pod \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " Jul 28 06:57:46.871106 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.870916 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-trusted-ca-bundle\") pod \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\" (UID: \"5ed1e1cb-f0cc-4411-8b45-350dc00971e9\") " Jul 28 06:57:46.871275 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.871235 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-config" (OuterVolumeSpecName: "console-config") pod "5ed1e1cb-f0cc-4411-8b45-350dc00971e9" (UID: "5ed1e1cb-f0cc-4411-8b45-350dc00971e9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:46.871275 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.871261 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5ed1e1cb-f0cc-4411-8b45-350dc00971e9" (UID: "5ed1e1cb-f0cc-4411-8b45-350dc00971e9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:46.871452 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.871298 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-service-ca" (OuterVolumeSpecName: "service-ca") pod "5ed1e1cb-f0cc-4411-8b45-350dc00971e9" (UID: "5ed1e1cb-f0cc-4411-8b45-350dc00971e9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:46.871513 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.871486 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5ed1e1cb-f0cc-4411-8b45-350dc00971e9" (UID: "5ed1e1cb-f0cc-4411-8b45-350dc00971e9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:46.873567 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.873530 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5ed1e1cb-f0cc-4411-8b45-350dc00971e9" (UID: "5ed1e1cb-f0cc-4411-8b45-350dc00971e9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:57:46.874063 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.874022 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5ed1e1cb-f0cc-4411-8b45-350dc00971e9" (UID: "5ed1e1cb-f0cc-4411-8b45-350dc00971e9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:57:46.874063 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.874040 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-kube-api-access-mh8ff" (OuterVolumeSpecName: "kube-api-access-mh8ff") pod "5ed1e1cb-f0cc-4411-8b45-350dc00971e9" (UID: "5ed1e1cb-f0cc-4411-8b45-350dc00971e9"). InnerVolumeSpecName "kube-api-access-mh8ff". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:57:46.972702 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.972536 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-service-ca\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:46.972702 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.972587 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh8ff\" (UniqueName: \"kubernetes.io/projected/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-kube-api-access-mh8ff\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:46.972702 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.972600 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-trusted-ca-bundle\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:46.972702 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.972612 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-oauth-serving-cert\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:46.972702 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.972641 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-oauth-config\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:46.972702 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.972653 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-serving-cert\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:46.972702 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:46.972666 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5ed1e1cb-f0cc-4411-8b45-350dc00971e9-console-config\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:57:47.508890 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.508827 2562 generic.go:356] "Generic (PLEG): container finished" podID="5ed1e1cb-f0cc-4411-8b45-350dc00971e9" containerID="89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f" exitCode=0 Jul 28 06:57:47.509596 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.508919 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d84fbc99-k4jx5" event={"ID":"5ed1e1cb-f0cc-4411-8b45-350dc00971e9","Type":"ContainerDied","Data":"89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f"} Jul 28 06:57:47.509596 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.508945 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d84fbc99-k4jx5" Jul 28 06:57:47.509596 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.509015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d84fbc99-k4jx5" event={"ID":"5ed1e1cb-f0cc-4411-8b45-350dc00971e9","Type":"ContainerDied","Data":"fe17003bc798c5d11ab121fad284e19b45e5ee3eb09e4f51a5cd297a2fc0d847"} Jul 28 06:57:47.509596 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.509052 2562 scope.go:117] "RemoveContainer" containerID="89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f" Jul 28 06:57:47.524738 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.524703 2562 scope.go:117] "RemoveContainer" containerID="89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f" Jul 28 06:57:47.525327 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:57:47.525289 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f\": container with ID starting with 89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f not found: ID does not exist" containerID="89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f" Jul 28 06:57:47.525437 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.525340 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f"} err="failed to get container status \"89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f\": rpc error: code = NotFound desc = could not find container \"89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f\": container with ID starting with 89a835798d7feff39b814ab9514d048fafcf5bc08554cc3861b70cab81813e0f not found: ID does not exist" Jul 28 06:57:47.538809 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.538674 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d84fbc99-k4jx5"] Jul 28 06:57:47.546418 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.546345 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d84fbc99-k4jx5"] Jul 28 06:57:47.668509 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:47.668444 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ed1e1cb-f0cc-4411-8b45-350dc00971e9" path="/var/lib/kubelet/pods/5ed1e1cb-f0cc-4411-8b45-350dc00971e9/volumes" Jul 28 06:57:54.280038 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:54.279970 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:57:54.285747 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:57:54.285693 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-647dd75c5-d5cr8" Jul 28 06:58:04.576856 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:04.576697 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:04.675875 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:04.675799 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:10.710544 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:10.710479 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:10.766661 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:10.766567 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:16.042125 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:16.042008 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:58:16.073802 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:16.073749 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:58:16.697887 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:16.697831 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 28 06:58:21.509082 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:21.509002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:58:21.513447 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:21.513386 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/535aec0a-57dd-45d7-9efd-d89e9019edc4-metrics-certs\") pod \"network-metrics-daemon-6rm99\" (UID: \"535aec0a-57dd-45d7-9efd-d89e9019edc4\") " pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:58:21.672211 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:21.672131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mfvlz\"" Jul 28 06:58:21.682060 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:21.681992 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6rm99" Jul 28 06:58:21.880550 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:21.880473 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6rm99"] Jul 28 06:58:21.886136 ip-10-0-133-68 kubenswrapper[2562]: W0728 06:58:21.886074 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod535aec0a_57dd_45d7_9efd_d89e9019edc4.slice/crio-0c242cf11f7166672bf626c96931127395213a42b682a9f0b967d4592a0baa1e WatchSource:0}: Error finding container 0c242cf11f7166672bf626c96931127395213a42b682a9f0b967d4592a0baa1e: Status 404 returned error can't find the container with id 0c242cf11f7166672bf626c96931127395213a42b682a9f0b967d4592a0baa1e Jul 28 06:58:22.709752 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:22.709665 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6rm99" event={"ID":"535aec0a-57dd-45d7-9efd-d89e9019edc4","Type":"ContainerStarted","Data":"0c242cf11f7166672bf626c96931127395213a42b682a9f0b967d4592a0baa1e"} Jul 28 06:58:23.719124 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:23.719059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6rm99" event={"ID":"535aec0a-57dd-45d7-9efd-d89e9019edc4","Type":"ContainerStarted","Data":"ba62d7b53e889dfe95130b389796498aed477936a3dc41b5d749ab9cc2f60966"} Jul 28 06:58:23.719827 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:23.719160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6rm99" event={"ID":"535aec0a-57dd-45d7-9efd-d89e9019edc4","Type":"ContainerStarted","Data":"1dbdf9602db2a488b690aef3612c48c796277e7f7e485f7e14aa3bd5c85eca0d"} Jul 28 06:58:23.738953 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:23.738832 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6rm99" podStartSLOduration=374.724660626 podStartE2EDuration="6m15.738788264s" totalImagesPullingTime="1.014127638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:58:23.736474762 +0000 UTC m=+376.742524867" watchObservedRunningTime="2026-07-28 06:58:23.738788264 +0000 UTC m=+376.744838369" Jul 28 06:58:23.827331 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:23.827267 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:23.887848 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:23.887788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:25.579564 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:25.579484 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:25.639404 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:25.639335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:32.512896 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:32.512815 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:32.569032 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:32.568963 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:37.611301 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:37.611238 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:37.668939 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:37.668876 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:43.779441 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:43.779331 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847c9dd6ff-m79wv"] Jul 28 06:58:43.876445 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:43.876320 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:43.948399 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:43.948345 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:44.005196 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:44.005118 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:50.564367 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:50.564303 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:50.668345 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:50.668273 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:58:54.892250 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:58:54.892175 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:00.401916 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:00.401833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:00.457844 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:00.457772 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:08.854396 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:08.854257 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-847c9dd6ff-m79wv" podUID="c94257ef-6345-47f5-ae1c-74aecca8fbbd" containerName="console" containerID="cri-o://9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc" gracePeriod=15 Jul 28 06:59:09.161883 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.161796 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:59:09.177339 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.177256 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-trusted-ca-bundle\") pod \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " Jul 28 06:59:09.177339 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.177350 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ml7dl\" (UniqueName: \"kubernetes.io/projected/c94257ef-6345-47f5-ae1c-74aecca8fbbd-kube-api-access-ml7dl\") pod \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " Jul 28 06:59:09.177790 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.177382 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-service-ca\") pod \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " Jul 28 06:59:09.177790 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.177406 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-oauth-config\") pod \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " Jul 28 06:59:09.177790 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.177438 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-serving-cert\") pod \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " Jul 28 06:59:09.177790 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.177472 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-oauth-serving-cert\") pod \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " Jul 28 06:59:09.177790 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.177586 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-config\") pod \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\" (UID: \"c94257ef-6345-47f5-ae1c-74aecca8fbbd\") " Jul 28 06:59:09.178055 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.177953 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c94257ef-6345-47f5-ae1c-74aecca8fbbd" (UID: "c94257ef-6345-47f5-ae1c-74aecca8fbbd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:59:09.178055 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.178012 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-service-ca" (OuterVolumeSpecName: "service-ca") pod "c94257ef-6345-47f5-ae1c-74aecca8fbbd" (UID: "c94257ef-6345-47f5-ae1c-74aecca8fbbd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:59:09.178285 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.178217 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c94257ef-6345-47f5-ae1c-74aecca8fbbd" (UID: "c94257ef-6345-47f5-ae1c-74aecca8fbbd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:59:09.178514 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.178309 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-config" (OuterVolumeSpecName: "console-config") pod "c94257ef-6345-47f5-ae1c-74aecca8fbbd" (UID: "c94257ef-6345-47f5-ae1c-74aecca8fbbd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:59:09.183053 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.182830 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c94257ef-6345-47f5-ae1c-74aecca8fbbd" (UID: "c94257ef-6345-47f5-ae1c-74aecca8fbbd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:59:09.183053 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.182962 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c94257ef-6345-47f5-ae1c-74aecca8fbbd" (UID: "c94257ef-6345-47f5-ae1c-74aecca8fbbd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:59:09.183768 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.183489 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c94257ef-6345-47f5-ae1c-74aecca8fbbd-kube-api-access-ml7dl" (OuterVolumeSpecName: "kube-api-access-ml7dl") pod "c94257ef-6345-47f5-ae1c-74aecca8fbbd" (UID: "c94257ef-6345-47f5-ae1c-74aecca8fbbd"). InnerVolumeSpecName "kube-api-access-ml7dl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:59:09.279189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.279069 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-config\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:59:09.279189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.279167 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-trusted-ca-bundle\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:59:09.279189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.279181 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ml7dl\" (UniqueName: \"kubernetes.io/projected/c94257ef-6345-47f5-ae1c-74aecca8fbbd-kube-api-access-ml7dl\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:59:09.279189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.279197 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-service-ca\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:59:09.279189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.279209 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-oauth-config\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:59:09.279189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.279221 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c94257ef-6345-47f5-ae1c-74aecca8fbbd-console-serving-cert\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:59:09.279189 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.279234 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c94257ef-6345-47f5-ae1c-74aecca8fbbd-oauth-serving-cert\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 06:59:09.970983 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.970792 2562 generic.go:356] "Generic (PLEG): container finished" podID="c94257ef-6345-47f5-ae1c-74aecca8fbbd" containerID="9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc" exitCode=0 Jul 28 06:59:09.970983 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.970887 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847c9dd6ff-m79wv" event={"ID":"c94257ef-6345-47f5-ae1c-74aecca8fbbd","Type":"ContainerDied","Data":"9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc"} Jul 28 06:59:09.970983 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.970925 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-847c9dd6ff-m79wv" Jul 28 06:59:09.971870 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.971015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-847c9dd6ff-m79wv" event={"ID":"c94257ef-6345-47f5-ae1c-74aecca8fbbd","Type":"ContainerDied","Data":"9a9ba4a1a18e602747f3d9d55fbb83b8a88bdb02460443bc833309a235154dc5"} Jul 28 06:59:09.971870 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.971056 2562 scope.go:117] "RemoveContainer" containerID="9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc" Jul 28 06:59:09.984786 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.984741 2562 scope.go:117] "RemoveContainer" containerID="9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc" Jul 28 06:59:09.985322 ip-10-0-133-68 kubenswrapper[2562]: E0728 06:59:09.985286 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc\": container with ID starting with 9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc not found: ID does not exist" containerID="9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc" Jul 28 06:59:09.985380 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.985343 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc"} err="failed to get container status \"9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc\": rpc error: code = NotFound desc = could not find container \"9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc\": container with ID starting with 9a7277b69fc0d4afd4ae0928539158393297358ba4324210d9d949b7e0f12fdc not found: ID does not exist" Jul 28 06:59:09.989132 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.989036 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-847c9dd6ff-m79wv"] Jul 28 06:59:09.993646 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:09.993570 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-847c9dd6ff-m79wv"] Jul 28 06:59:11.673976 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:11.673897 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c94257ef-6345-47f5-ae1c-74aecca8fbbd" path="/var/lib/kubelet/pods/c94257ef-6345-47f5-ae1c-74aecca8fbbd/volumes" Jul 28 06:59:23.939313 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:23.939233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:24.028958 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:24.028888 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:34.126923 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:34.126746 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:45.823783 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:45.823719 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:46.573040 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:46.572970 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:48.571029 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:48.570953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:49.425643 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:49.425562 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:49.486573 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:49.486443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:51.297937 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:51.297865 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:51.401579 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:51.401506 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:53.692051 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:53.691921 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:54.026601 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:54.026430 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:54.126642 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:54.126564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 06:59:54.183907 ip-10-0-133-68 kubenswrapper[2562]: I0728 06:59:54.183848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:01.321532 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:01.321446 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:10.262177 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:10.262095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:10.315380 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:10.315305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:15.632401 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:15.632341 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:15.686554 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:15.686494 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:21.643200 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:21.643127 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:21.742490 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:21.742428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:31.193359 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:31.193279 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:31.312439 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:31.312346 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:32.652378 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:32.652308 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:32.704285 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:32.704215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:00:33.413480 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:00:33.413418 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:01:29.208639 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:01:29.208551 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:01:29.314020 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:01:29.313956 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:01:29.380390 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:01:29.380332 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:11.000909 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:11.000824 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:19.425666 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:19.425568 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:19.526246 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:19.526180 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:21.796229 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.796162 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:21.796865 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.796631 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql"] Jul 28 07:02:21.797146 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797125 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8916fd28-554b-4f86-b0da-a8da775ff76d" containerName="console" Jul 28 07:02:21.797191 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797150 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8916fd28-554b-4f86-b0da-a8da775ff76d" containerName="console" Jul 28 07:02:21.797191 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797181 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed1e1cb-f0cc-4411-8b45-350dc00971e9" containerName="console" Jul 28 07:02:21.797191 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797188 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed1e1cb-f0cc-4411-8b45-350dc00971e9" containerName="console" Jul 28 07:02:21.797376 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797195 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c94257ef-6345-47f5-ae1c-74aecca8fbbd" containerName="console" Jul 28 07:02:21.797376 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797205 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c94257ef-6345-47f5-ae1c-74aecca8fbbd" containerName="console" Jul 28 07:02:21.797376 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797283 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c94257ef-6345-47f5-ae1c-74aecca8fbbd" containerName="console" Jul 28 07:02:21.797376 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797306 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8916fd28-554b-4f86-b0da-a8da775ff76d" containerName="console" Jul 28 07:02:21.797376 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.797314 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed1e1cb-f0cc-4411-8b45-350dc00971e9" containerName="console" Jul 28 07:02:21.801149 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.801106 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:21.804570 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.804534 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 28 07:02:21.804884 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.804866 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 28 07:02:21.805452 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.805429 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-nxmhf\"" Jul 28 07:02:21.805452 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.805444 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 28 07:02:21.805692 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.805670 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 28 07:02:21.810944 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.810898 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql"] Jul 28 07:02:21.952517 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.952435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93a5eb16-774c-4b5c-800b-035d0280753b-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:21.953047 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.952635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/93a5eb16-774c-4b5c-800b-035d0280753b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:21.953047 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:21.952686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz9xp\" (UniqueName: \"kubernetes.io/projected/93a5eb16-774c-4b5c-800b-035d0280753b-kube-api-access-pz9xp\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:22.054710 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.054437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93a5eb16-774c-4b5c-800b-035d0280753b-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:22.054710 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.054577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/93a5eb16-774c-4b5c-800b-035d0280753b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:22.054710 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.054665 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz9xp\" (UniqueName: \"kubernetes.io/projected/93a5eb16-774c-4b5c-800b-035d0280753b-kube-api-access-pz9xp\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:22.055736 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.055704 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/93a5eb16-774c-4b5c-800b-035d0280753b-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:22.058778 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.058743 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93a5eb16-774c-4b5c-800b-035d0280753b-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:22.066043 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.065978 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz9xp\" (UniqueName: \"kubernetes.io/projected/93a5eb16-774c-4b5c-800b-035d0280753b-kube-api-access-pz9xp\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:22.117863 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.117776 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:22.326719 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.326521 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql"] Jul 28 07:02:22.332265 ip-10-0-133-68 kubenswrapper[2562]: W0728 07:02:22.332207 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod93a5eb16_774c_4b5c_800b_035d0280753b.slice/crio-3282748aa14ece3f246ce4f2471eb8de4c84e1c01745a1fa0d2e63584d83ad30 WatchSource:0}: Error finding container 3282748aa14ece3f246ce4f2471eb8de4c84e1c01745a1fa0d2e63584d83ad30: Status 404 returned error can't find the container with id 3282748aa14ece3f246ce4f2471eb8de4c84e1c01745a1fa0d2e63584d83ad30 Jul 28 07:02:22.335102 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.335066 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 07:02:22.338137 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:22.338088 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:23.052130 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:23.052066 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" event={"ID":"93a5eb16-774c-4b5c-800b-035d0280753b","Type":"ContainerStarted","Data":"3282748aa14ece3f246ce4f2471eb8de4c84e1c01745a1fa0d2e63584d83ad30"} Jul 28 07:02:25.934690 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:25.934593 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:26.072842 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:26.072757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" event={"ID":"93a5eb16-774c-4b5c-800b-035d0280753b","Type":"ContainerStarted","Data":"ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c"} Jul 28 07:02:26.072842 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:26.072857 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:26.092430 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:26.092334 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" podStartSLOduration=2.349510107 podStartE2EDuration="5.092296547s" totalImagesPullingTime="2.74278644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:02:26.091184365 +0000 UTC m=+619.097234471" watchObservedRunningTime="2026-07-28 07:02:26.092296547 +0000 UTC m=+619.098346651" Jul 28 07:02:35.226788 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:35.226727 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:35.327713 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:35.327593 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:37.239014 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:37.238947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:39.573061 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:39.572988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:42.086380 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:42.086329 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:02:47.441168 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:47.441103 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:47.831701 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:47.831509 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:47.927768 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:47.927689 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:02:47.989664 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:02:47.989561 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:04:00.864679 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:00.864488 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:04:01.023913 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:01.023827 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql"] Jul 28 07:04:01.616283 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:01.616165 2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" podUID="93a5eb16-774c-4b5c-800b-035d0280753b" containerName="manager" containerID="cri-o://ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c" gracePeriod=30 Jul 28 07:04:01.909718 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:01.909644 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:04:02.032075 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.031958 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93a5eb16-774c-4b5c-800b-035d0280753b-cert\") pod \"93a5eb16-774c-4b5c-800b-035d0280753b\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " Jul 28 07:04:02.032489 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.032237 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/93a5eb16-774c-4b5c-800b-035d0280753b-kubeflow-trainer-config\") pod \"93a5eb16-774c-4b5c-800b-035d0280753b\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " Jul 28 07:04:02.032489 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.032292 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz9xp\" (UniqueName: \"kubernetes.io/projected/93a5eb16-774c-4b5c-800b-035d0280753b-kube-api-access-pz9xp\") pod \"93a5eb16-774c-4b5c-800b-035d0280753b\" (UID: \"93a5eb16-774c-4b5c-800b-035d0280753b\") " Jul 28 07:04:02.035956 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.035881 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93a5eb16-774c-4b5c-800b-035d0280753b-cert" (OuterVolumeSpecName: "cert") pod "93a5eb16-774c-4b5c-800b-035d0280753b" (UID: "93a5eb16-774c-4b5c-800b-035d0280753b"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 07:04:02.036600 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.036569 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93a5eb16-774c-4b5c-800b-035d0280753b-kube-api-access-pz9xp" (OuterVolumeSpecName: "kube-api-access-pz9xp") pod "93a5eb16-774c-4b5c-800b-035d0280753b" (UID: "93a5eb16-774c-4b5c-800b-035d0280753b"). InnerVolumeSpecName "kube-api-access-pz9xp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:04:02.041161 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.041089 2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a5eb16-774c-4b5c-800b-035d0280753b-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "93a5eb16-774c-4b5c-800b-035d0280753b" (UID: "93a5eb16-774c-4b5c-800b-035d0280753b"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 07:04:02.134056 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.133853 2562 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/93a5eb16-774c-4b5c-800b-035d0280753b-cert\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 07:04:02.134056 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.133911 2562 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/93a5eb16-774c-4b5c-800b-035d0280753b-kubeflow-trainer-config\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 07:04:02.134056 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.133928 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz9xp\" (UniqueName: \"kubernetes.io/projected/93a5eb16-774c-4b5c-800b-035d0280753b-kube-api-access-pz9xp\") on node \"ip-10-0-133-68.ec2.internal\" DevicePath \"\"" Jul 28 07:04:02.182124 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.182053 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:04:02.283175 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.283085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:04:02.623564 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.623497 2562 generic.go:356] "Generic (PLEG): container finished" podID="93a5eb16-774c-4b5c-800b-035d0280753b" containerID="ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c" exitCode=0 Jul 28 07:04:02.623979 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.623591 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" Jul 28 07:04:02.623979 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.623596 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" event={"ID":"93a5eb16-774c-4b5c-800b-035d0280753b","Type":"ContainerDied","Data":"ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c"} Jul 28 07:04:02.623979 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.623705 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql" event={"ID":"93a5eb16-774c-4b5c-800b-035d0280753b","Type":"ContainerDied","Data":"3282748aa14ece3f246ce4f2471eb8de4c84e1c01745a1fa0d2e63584d83ad30"} Jul 28 07:04:02.623979 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.623734 2562 scope.go:117] "RemoveContainer" containerID="ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c" Jul 28 07:04:02.639285 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.639244 2562 scope.go:117] "RemoveContainer" containerID="ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c" Jul 28 07:04:02.639900 ip-10-0-133-68 kubenswrapper[2562]: E0728 07:04:02.639869 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c\": container with ID starting with ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c not found: ID does not exist" containerID="ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c" Jul 28 07:04:02.640000 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.639920 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c"} err="failed to get container status \"ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c\": rpc error: code = NotFound desc = could not find container \"ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c\": container with ID starting with ae64ac6f4041de393a1afa374c3a3035f8bc89b35eb91039a516aceb0f1a800c not found: ID does not exist" Jul 28 07:04:02.651271 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.651197 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql"] Jul 28 07:04:02.654953 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:02.654890 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-md8ql"] Jul 28 07:04:03.668648 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:03.668579 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a5eb16-774c-4b5c-800b-035d0280753b" path="/var/lib/kubelet/pods/93a5eb16-774c-4b5c-800b-035d0280753b/volumes" Jul 28 07:04:04.741582 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:04.741532 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:04:04.815594 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:04:04.815537 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:05:02.707725 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.707648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:05:02.854891 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.854802 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xtz5m/must-gather-wfncv"] Jul 28 07:05:02.855527 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.855495 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a5eb16-774c-4b5c-800b-035d0280753b" containerName="manager" Jul 28 07:05:02.855705 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.855533 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a5eb16-774c-4b5c-800b-035d0280753b" containerName="manager" Jul 28 07:05:02.855808 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.855791 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a5eb16-774c-4b5c-800b-035d0280753b" containerName="manager" Jul 28 07:05:02.860077 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.860014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtz5m/must-gather-wfncv" Jul 28 07:05:02.863605 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.863547 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xtz5m\"/\"kube-root-ca.crt\"" Jul 28 07:05:02.864698 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.864650 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xtz5m\"/\"default-dockercfg-zrvbx\"" Jul 28 07:05:02.864936 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.864661 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xtz5m\"/\"openshift-service-ca.crt\"" Jul 28 07:05:02.867753 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.867699 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtz5m/must-gather-wfncv"] Jul 28 07:05:02.876496 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.876433 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:05:02.936316 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.936261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:05:02.949610 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.949541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj2lf\" (UniqueName: \"kubernetes.io/projected/5dbc44d0-c95b-4379-85a0-2c52bf46c28a-kube-api-access-fj2lf\") pod \"must-gather-wfncv\" (UID: \"5dbc44d0-c95b-4379-85a0-2c52bf46c28a\") " pod="openshift-must-gather-xtz5m/must-gather-wfncv" Jul 28 07:05:02.950007 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:02.949759 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5dbc44d0-c95b-4379-85a0-2c52bf46c28a-must-gather-output\") pod \"must-gather-wfncv\" (UID: \"5dbc44d0-c95b-4379-85a0-2c52bf46c28a\") " pod="openshift-must-gather-xtz5m/must-gather-wfncv" Jul 28 07:05:03.052023 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:03.051792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fj2lf\" (UniqueName: \"kubernetes.io/projected/5dbc44d0-c95b-4379-85a0-2c52bf46c28a-kube-api-access-fj2lf\") pod \"must-gather-wfncv\" (UID: \"5dbc44d0-c95b-4379-85a0-2c52bf46c28a\") " pod="openshift-must-gather-xtz5m/must-gather-wfncv" Jul 28 07:05:03.052023 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:03.051917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5dbc44d0-c95b-4379-85a0-2c52bf46c28a-must-gather-output\") pod \"must-gather-wfncv\" (UID: \"5dbc44d0-c95b-4379-85a0-2c52bf46c28a\") " pod="openshift-must-gather-xtz5m/must-gather-wfncv" Jul 28 07:05:03.052585 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:03.052547 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5dbc44d0-c95b-4379-85a0-2c52bf46c28a-must-gather-output\") pod \"must-gather-wfncv\" (UID: \"5dbc44d0-c95b-4379-85a0-2c52bf46c28a\") " pod="openshift-must-gather-xtz5m/must-gather-wfncv" Jul 28 07:05:03.062576 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:03.062521 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj2lf\" (UniqueName: \"kubernetes.io/projected/5dbc44d0-c95b-4379-85a0-2c52bf46c28a-kube-api-access-fj2lf\") pod \"must-gather-wfncv\" (UID: \"5dbc44d0-c95b-4379-85a0-2c52bf46c28a\") " pod="openshift-must-gather-xtz5m/must-gather-wfncv" Jul 28 07:05:03.177424 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:03.177293 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtz5m/must-gather-wfncv" Jul 28 07:05:03.386221 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:03.386147 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtz5m/must-gather-wfncv"] Jul 28 07:05:03.391729 ip-10-0-133-68 kubenswrapper[2562]: W0728 07:05:03.391675 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5dbc44d0_c95b_4379_85a0_2c52bf46c28a.slice/crio-23f35e194672505897d1eba94e2b8e5bae67e79196eb4f95c9d218a48dea50dd WatchSource:0}: Error finding container 23f35e194672505897d1eba94e2b8e5bae67e79196eb4f95c9d218a48dea50dd: Status 404 returned error can't find the container with id 23f35e194672505897d1eba94e2b8e5bae67e79196eb4f95c9d218a48dea50dd Jul 28 07:05:03.961725 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:03.961640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtz5m/must-gather-wfncv" event={"ID":"5dbc44d0-c95b-4379-85a0-2c52bf46c28a","Type":"ContainerStarted","Data":"23f35e194672505897d1eba94e2b8e5bae67e79196eb4f95c9d218a48dea50dd"} Jul 28 07:05:05.978306 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:05.978219 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtz5m/must-gather-wfncv" event={"ID":"5dbc44d0-c95b-4379-85a0-2c52bf46c28a","Type":"ContainerStarted","Data":"4890db793f0d685c0e75d325f4ca859bc2ee199fdb79376d055e7b0c73982a60"} Jul 28 07:05:05.979206 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:05.978348 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtz5m/must-gather-wfncv" event={"ID":"5dbc44d0-c95b-4379-85a0-2c52bf46c28a","Type":"ContainerStarted","Data":"ad9761737e8a1a19002a90d753622c6df55a94be6ddcf6db5d890edf55d08684"} Jul 28 07:05:05.998074 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:05.997932 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xtz5m/must-gather-wfncv" podStartSLOduration=2.414187561 podStartE2EDuration="3.997888706s" totalImagesPullingTime="1.583701145s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:05:05.99591394 +0000 UTC m=+779.001964057" watchObservedRunningTime="2026-07-28 07:05:05.997888706 +0000 UTC m=+779.003938812" Jul 28 07:05:06.761359 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:06.761290 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8mldq_dd78624f-cc1b-4b09-82a4-35c3ddbdb20b/global-pull-secret-syncer/0.log" Jul 28 07:05:06.863179 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:06.863115 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" Jul 28 07:05:06.946206 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:06.946144 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-68.ec2.internal_47b82ae00a4e61d8c8286ec65e9c9c5f/haproxy/0.log" Jul 28 07:05:08.334513 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:08.334444 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:05:08.396742 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:08.396673 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-67zqj_20eb01e7-c7ef-47e7-85bc-e11eeac203c7/konnectivity-agent/0.log" limit=1024 Jul 28 07:05:12.552478 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:12.552408 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-647dd75c5-d5cr8_95efe372-edf0-40bc-a4ed-699aac82546e/metrics-server/0.log" Jul 28 07:05:12.639001 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:12.638927 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2j8sk_e5044216-d035-4111-92e1-6d7718a5ea8b/node-exporter/0.log" Jul 28 07:05:12.674666 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:12.674577 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2j8sk_e5044216-d035-4111-92e1-6d7718a5ea8b/kube-rbac-proxy/0.log" Jul 28 07:05:12.711869 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:12.711819 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2j8sk_e5044216-d035-4111-92e1-6d7718a5ea8b/init-textfile/0.log" Jul 28 07:05:13.104430 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.104361 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60464beb-c2d9-408a-ac17-5e034d67a84b/prometheus/0.log" Jul 28 07:05:13.141238 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.141058 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60464beb-c2d9-408a-ac17-5e034d67a84b/config-reloader/0.log" Jul 28 07:05:13.173088 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.173005 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60464beb-c2d9-408a-ac17-5e034d67a84b/thanos-sidecar/0.log" Jul 28 07:05:13.207449 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.207326 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60464beb-c2d9-408a-ac17-5e034d67a84b/kube-rbac-proxy-web/0.log" Jul 28 07:05:13.242016 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.241891 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60464beb-c2d9-408a-ac17-5e034d67a84b/kube-rbac-proxy/0.log" Jul 28 07:05:13.278809 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.278741 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60464beb-c2d9-408a-ac17-5e034d67a84b/kube-rbac-proxy-thanos/0.log" Jul 28 07:05:13.310502 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.310444 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_60464beb-c2d9-408a-ac17-5e034d67a84b/init-config-reloader/0.log" Jul 28 07:05:13.409253 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.409082 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-nk765_00a45fa1-6e05-42f0-99ec-59ccd7c37d31/prometheus-operator-admission-webhook/0.log" Jul 28 07:05:13.451603 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.451554 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b847d9d5-pw7jz_86ac42bb-6149-4a4e-81ab-24d316a5c802/telemeter-client/0.log" Jul 28 07:05:13.483343 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.483290 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b847d9d5-pw7jz_86ac42bb-6149-4a4e-81ab-24d316a5c802/reload/0.log" Jul 28 07:05:13.512207 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.512144 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85b847d9d5-pw7jz_86ac42bb-6149-4a4e-81ab-24d316a5c802/kube-rbac-proxy/0.log" Jul 28 07:05:13.555239 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.555184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b798b6f78-w92p8_6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59/thanos-query/0.log" Jul 28 07:05:13.586980 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.586913 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b798b6f78-w92p8_6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59/kube-rbac-proxy-web/0.log" Jul 28 07:05:13.618887 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.618791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b798b6f78-w92p8_6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59/kube-rbac-proxy/0.log" Jul 28 07:05:13.648221 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.648122 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b798b6f78-w92p8_6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59/prom-label-proxy/0.log" Jul 28 07:05:13.683600 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.683429 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b798b6f78-w92p8_6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59/kube-rbac-proxy-rules/0.log" Jul 28 07:05:13.714896 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:13.714833 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7b798b6f78-w92p8_6f0b5c38-ce2b-48be-a8f4-5dc7ed379f59/kube-rbac-proxy-metrics/0.log" Jul 28 07:05:18.289469 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.289327 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj"] Jul 28 07:05:18.297408 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.297330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.307644 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.307554 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj"] Jul 28 07:05:18.361444 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.361342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-proc\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.362183 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.362126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-sys\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.362515 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.362497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-podres\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.362717 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.362699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-lib-modules\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.362888 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.362868 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blscl\" (UniqueName: \"kubernetes.io/projected/56b8ce32-0201-4001-a3a9-869456ba8556-kube-api-access-blscl\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464249 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-proc\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464249 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464264 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-sys\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464707 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-podres\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464707 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-lib-modules\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464707 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464372 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-proc\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464707 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464410 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-sys\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464707 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blscl\" (UniqueName: \"kubernetes.io/projected/56b8ce32-0201-4001-a3a9-869456ba8556-kube-api-access-blscl\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464707 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464537 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-podres\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.464707 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.464577 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/56b8ce32-0201-4001-a3a9-869456ba8556-lib-modules\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.475541 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.475259 2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blscl\" (UniqueName: \"kubernetes.io/projected/56b8ce32-0201-4001-a3a9-869456ba8556-kube-api-access-blscl\") pod \"perf-node-gather-daemonset-st6mj\" (UID: \"56b8ce32-0201-4001-a3a9-869456ba8556\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.625844 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.625752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:18.866836 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.866764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj"] Jul 28 07:05:18.922660 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.922577 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wtd45_19fc102d-1417-4c01-ab64-f9c2c79744ae/dns/0.log" Jul 28 07:05:18.950551 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:18.950474 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wtd45_19fc102d-1417-4c01-ab64-f9c2c79744ae/kube-rbac-proxy/0.log" Jul 28 07:05:19.020690 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:19.020632 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-gncth_a84a191d-0b3a-460e-99fd-8cdba90483da/dns-node-resolver/0.log" Jul 28 07:05:19.092284 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:19.092203 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" event={"ID":"56b8ce32-0201-4001-a3a9-869456ba8556","Type":"ContainerStarted","Data":"4372050a77b8edf4a88addf4ded67a74cf1df5ac46748e021f5e1c72036ad9e9"} Jul 28 07:05:19.638005 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:19.637920 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wgq6z_b91febb1-5d61-4ade-9023-1e65088aabcb/node-ca/0.log" Jul 28 07:05:20.102999 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:20.102869 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" event={"ID":"56b8ce32-0201-4001-a3a9-869456ba8556","Type":"ContainerStarted","Data":"a836157b0324c05d116d2bdf6593c904a7afcdc1c19c2fb4567a1ceda0772b90"} Jul 28 07:05:20.103429 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:20.103160 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:20.122509 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:20.122392 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" podStartSLOduration=2.122359406 podStartE2EDuration="2.122359406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:05:20.11941574 +0000 UTC m=+793.125465846" watchObservedRunningTime="2026-07-28 07:05:20.122359406 +0000 UTC m=+793.128409490" Jul 28 07:05:21.066927 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:21.066869 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wbr6d_a8ea604e-1844-4326-8044-45a9fd9d3dea/serve-healthcheck-canary/0.log" Jul 28 07:05:21.506413 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:21.506293 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-6qzxd_a79a3c4f-ce8a-40ba-8097-271ad21977ba/insights-operator/1.log" Jul 28 07:05:21.506904 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:21.506682 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-6qzxd_a79a3c4f-ce8a-40ba-8097-271ad21977ba/insights-operator/0.log" Jul 28 07:05:21.696851 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:21.696792 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbf7k_87e7ec78-f12a-4cdd-98b9-0e8e10783ad0/kube-rbac-proxy/0.log" Jul 28 07:05:21.725740 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:21.725689 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbf7k_87e7ec78-f12a-4cdd-98b9-0e8e10783ad0/exporter/0.log" Jul 28 07:05:21.754227 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:21.754164 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qbf7k_87e7ec78-f12a-4cdd-98b9-0e8e10783ad0/extractor/0.log" Jul 28 07:05:26.128637 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:26.128452 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-st6mj" Jul 28 07:05:29.620849 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:29.620783 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-82zfm_dbcd0f65-bb8c-4b28-ab0c-8f561ee508e6/kube-multus/0.log" Jul 28 07:05:29.834870 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:29.834694 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlq4v_7a2220dc-5fbf-426c-8381-1af8a67762c5/kube-multus-additional-cni-plugins/0.log" Jul 28 07:05:29.862499 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:29.862438 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlq4v_7a2220dc-5fbf-426c-8381-1af8a67762c5/egress-router-binary-copy/0.log" Jul 28 07:05:29.894149 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:29.894088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlq4v_7a2220dc-5fbf-426c-8381-1af8a67762c5/cni-plugins/0.log" Jul 28 07:05:29.923660 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:29.923566 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlq4v_7a2220dc-5fbf-426c-8381-1af8a67762c5/bond-cni-plugin/0.log" Jul 28 07:05:29.951117 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:29.951048 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlq4v_7a2220dc-5fbf-426c-8381-1af8a67762c5/routeoverride-cni/0.log" Jul 28 07:05:29.977763 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:29.977708 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlq4v_7a2220dc-5fbf-426c-8381-1af8a67762c5/whereabouts-cni-bincopy/0.log" Jul 28 07:05:30.008380 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:30.008329 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mlq4v_7a2220dc-5fbf-426c-8381-1af8a67762c5/whereabouts-cni/0.log" Jul 28 07:05:30.326034 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:30.325956 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6rm99_535aec0a-57dd-45d7-9efd-d89e9019edc4/network-metrics-daemon/0.log" Jul 28 07:05:30.353537 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:30.353484 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6rm99_535aec0a-57dd-45d7-9efd-d89e9019edc4/kube-rbac-proxy/0.log" Jul 28 07:05:31.399125 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:31.399073 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tlwf_310c1d11-4f82-4d27-8a3e-1ddffae546c4/ovn-controller/0.log" Jul 28 07:05:31.428098 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:31.428061 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tlwf_310c1d11-4f82-4d27-8a3e-1ddffae546c4/ovn-acl-logging/0.log" Jul 28 07:05:31.462866 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:31.462810 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tlwf_310c1d11-4f82-4d27-8a3e-1ddffae546c4/kube-rbac-proxy-node/0.log" Jul 28 07:05:31.494606 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:31.494556 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tlwf_310c1d11-4f82-4d27-8a3e-1ddffae546c4/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 07:05:31.517527 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:31.517469 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tlwf_310c1d11-4f82-4d27-8a3e-1ddffae546c4/northd/0.log" Jul 28 07:05:31.544586 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:31.544529 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tlwf_310c1d11-4f82-4d27-8a3e-1ddffae546c4/nbdb/0.log" Jul 28 07:05:31.571023 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:31.570960 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tlwf_310c1d11-4f82-4d27-8a3e-1ddffae546c4/sbdb/0.log" Jul 28 07:05:31.621597 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:31.621431 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5tlwf_310c1d11-4f82-4d27-8a3e-1ddffae546c4/ovnkube-controller/0.log" Jul 28 07:05:33.335724 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:33.335674 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7hjb9_bd09714f-2381-4958-8a10-f5068fdd3371/network-check-target-container/0.log" Jul 28 07:05:34.572247 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:34.572183 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-c6sdc_bdec0f28-53c4-4c84-89a3-f9977886c34a/iptables-alerter/0.log" Jul 28 07:05:35.412113 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:35.412055 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lqdws_b09f7e56-0c1c-44e4-8397-c739ab48d145/tuned/0.log" Jul 28 07:05:39.274863 ip-10-0-133-68 kubenswrapper[2562]: I0728 07:05:39.274788 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-658d7b7c78-8vljm_97c7b275-0896-4ec9-aabf-b59e7c6d176c/service-ca-controller/0.log"