Jul 01 18:25:18.522953 ip-10-0-128-190 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 01 18:25:18.522968 ip-10-0-128-190 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 01 18:25:18.522978 ip-10-0-128-190 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 01 18:25:18.523313 ip-10-0-128-190 systemd[1]: Failed to start Kubernetes Kubelet. Jul 01 18:25:28.593792 ip-10-0-128-190 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 01 18:25:28.593813 ip-10-0-128-190 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0d89c46ce0904e20a8207baf54892bda -- Jul 01 18:27:34.949145 ip-10-0-128-190 systemd[1]: Starting Kubernetes Kubelet... Jul 01 18:27:35.381059 ip-10-0-128-190 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:35.381059 ip-10-0-128-190 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 01 18:27:35.381059 ip-10-0-128-190 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:35.381059 ip-10-0-128-190 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 01 18:27:35.381059 ip-10-0-128-190 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 01 18:27:35.382430 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.382344 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 01 18:27:35.386200 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386185 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:35.386200 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386200 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386203 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386207 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386209 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386212 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386214 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386216 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386220 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386222 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386225 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386229 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386234 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386237 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386240 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386243 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386246 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386249 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386252 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386254 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:35.386263 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386257 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386259 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386262 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386264 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386268 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386270 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386274 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386278 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386280 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386283 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386286 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386288 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386291 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386293 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386296 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386299 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386303 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386307 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386309 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:35.386677 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386311 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386314 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386316 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386318 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386320 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386323 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386325 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386328 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386330 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386332 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386334 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386337 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386339 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386341 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386344 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386347 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386350 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386352 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386355 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:35.387120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386357 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386359 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386362 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386364 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386366 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386369 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386372 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386375 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386377 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386379 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386381 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386384 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386386 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386389 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386391 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386393 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386395 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386398 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386400 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386402 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:35.387568 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386405 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386407 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386409 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386412 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386414 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386417 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386419 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386421 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386425 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386427 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386430 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386432 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386434 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386436 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386439 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386441 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386444 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386446 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386448 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386450 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:35.388025 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.386453 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387148 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387153 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387156 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387160 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387162 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387186 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387205 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387209 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387212 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387215 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387218 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387222 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387225 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387227 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387233 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387237 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387240 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387242 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:35.388491 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387245 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387247 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387250 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387252 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387255 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387258 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387260 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387263 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387266 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387268 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387271 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387273 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387275 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387278 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387280 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387282 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387285 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387287 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387289 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387292 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:35.388974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387297 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387301 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387304 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387307 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387309 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387311 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387314 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387316 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387320 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387322 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387325 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387327 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387329 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387332 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387334 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387339 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387342 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387344 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387347 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387350 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:35.389420 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387352 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387355 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387357 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387360 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387362 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387364 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387367 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387369 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387371 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387374 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387376 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387380 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387384 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387388 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387391 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387396 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387399 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387402 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387405 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:35.389911 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387408 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387411 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387413 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387416 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387419 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387421 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387424 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387426 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387429 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387431 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387433 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387436 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387438 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387440 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387443 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387445 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387448 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387450 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387453 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:35.390347 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387455 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387458 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387460 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387912 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387918 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387921 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387926 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387930 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387933 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387937 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387940 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387943 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387945 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387947 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387950 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387952 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387954 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387957 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387959 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387962 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:35.390772 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387965 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387967 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387969 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387972 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387974 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387976 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387979 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387981 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387984 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387986 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387988 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387991 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387993 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387995 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.387997 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388000 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388002 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388004 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388007 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:35.391238 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388009 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388012 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388015 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388017 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388020 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388023 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388027 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388029 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388032 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388034 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388037 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388039 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388043 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388046 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388049 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388052 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388054 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388057 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388060 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:35.391668 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388062 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388064 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388067 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388069 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388071 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388074 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388076 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388078 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388081 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388083 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388086 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388088 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388091 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388093 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388095 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388097 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388100 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388102 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388107 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388109 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:35.392112 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388111 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388114 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388117 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388120 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388124 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388127 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388129 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388132 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388134 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388137 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388139 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388141 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388144 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388146 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388148 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388150 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388153 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388155 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388157 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388159 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:35.392542 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388161 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388164 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388166 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388168 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388233 2574 flags.go:64] FLAG: --address="0.0.0.0" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388240 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388246 2574 flags.go:64] FLAG: --anonymous-auth="true" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388250 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388254 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388258 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388264 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388269 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388273 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388275 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388279 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388282 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388285 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388288 2574 flags.go:64] FLAG: --cgroup-root="" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388290 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388293 2574 flags.go:64] FLAG: --client-ca-file="" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388296 2574 flags.go:64] FLAG: --cloud-provider="external" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388298 2574 flags.go:64] FLAG: --cluster-dns="[]" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388301 2574 flags.go:64] FLAG: --cluster-domain="" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388304 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 01 18:27:35.393001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388307 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388310 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388313 2574 flags.go:64] FLAG: --container-log-max-files="5" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388316 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388319 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388322 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388325 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388327 2574 flags.go:64] FLAG: --contention-profiling="false" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388330 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388333 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388335 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388338 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388343 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388346 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388349 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388351 2574 flags.go:64] FLAG: --enable-load-reader="false" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388354 2574 flags.go:64] FLAG: --enable-server="true" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388357 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388363 2574 flags.go:64] FLAG: --event-burst="100" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388366 2574 flags.go:64] FLAG: --event-qps="50" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388369 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388372 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388375 2574 flags.go:64] FLAG: --eviction-hard="" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388379 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 01 18:27:35.393524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388382 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388385 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388387 2574 flags.go:64] FLAG: --eviction-soft="" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388390 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388393 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388395 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388398 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388400 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388403 2574 flags.go:64] FLAG: --fail-swap-on="true" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388406 2574 flags.go:64] FLAG: --feature-gates="" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388409 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388412 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388415 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388418 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388421 2574 flags.go:64] FLAG: --healthz-port="10248" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388424 2574 flags.go:64] FLAG: --help="false" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388427 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388430 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388433 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388435 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388440 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388443 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388445 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 01 18:27:35.394121 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388448 2574 flags.go:64] FLAG: --image-service-endpoint="" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388451 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388453 2574 flags.go:64] FLAG: --kube-api-burst="100" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388460 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388463 2574 flags.go:64] FLAG: --kube-api-qps="50" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388467 2574 flags.go:64] FLAG: --kube-reserved="" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388469 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388472 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388475 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388478 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388481 2574 flags.go:64] FLAG: --lock-file="" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388484 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388486 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388489 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388494 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388497 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388500 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388503 2574 flags.go:64] FLAG: --logging-format="text" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388506 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388509 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388512 2574 flags.go:64] FLAG: --manifest-url="" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388515 2574 flags.go:64] FLAG: --manifest-url-header="" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388519 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388522 2574 flags.go:64] FLAG: --max-open-files="1000000" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388526 2574 flags.go:64] FLAG: --max-pods="110" Jul 01 18:27:35.394653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388529 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388532 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388535 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388538 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388542 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388545 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388548 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388555 2574 flags.go:64] FLAG: --node-status-max-images="50" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388558 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388561 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388566 2574 flags.go:64] FLAG: --pod-cidr="" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388568 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8a2632cd31d78133be7b5fb6999469b2acf9b98d077c7f6ae5d0d94083d76b04" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388575 2574 flags.go:64] FLAG: --pod-manifest-path="" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388578 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388581 2574 flags.go:64] FLAG: --pods-per-core="0" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388583 2574 flags.go:64] FLAG: --port="10250" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388586 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388589 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02da2d92de45a71c3" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388592 2574 flags.go:64] FLAG: --qos-reserved="" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388595 2574 flags.go:64] FLAG: --read-only-port="10255" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388598 2574 flags.go:64] FLAG: --register-node="true" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388601 2574 flags.go:64] FLAG: --register-with-taints="" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388604 2574 flags.go:64] FLAG: --registry-burst="10" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388607 2574 flags.go:64] FLAG: --registry-qps="5" Jul 01 18:27:35.395253 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388609 2574 flags.go:64] FLAG: --reserved-cpus="" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388612 2574 flags.go:64] FLAG: --reserved-memory="" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388615 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388618 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388622 2574 flags.go:64] FLAG: --rotate-certificates="false" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388624 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388627 2574 flags.go:64] FLAG: --runonce="false" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388630 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388633 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388636 2574 flags.go:64] FLAG: --seccomp-default="false" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388638 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388641 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388643 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388647 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388650 2574 flags.go:64] FLAG: --storage-driver-password="root" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388653 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388655 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388658 2574 flags.go:64] FLAG: --storage-driver-user="root" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388662 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388666 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388668 2574 flags.go:64] FLAG: --system-cgroups="" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388672 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388677 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388680 2574 flags.go:64] FLAG: --tls-cert-file="" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388682 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 01 18:27:35.396187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388686 2574 flags.go:64] FLAG: --tls-min-version="" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388688 2574 flags.go:64] FLAG: --tls-private-key-file="" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388691 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388693 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388696 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388699 2574 flags.go:64] FLAG: --v="2" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388702 2574 flags.go:64] FLAG: --version="false" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388706 2574 flags.go:64] FLAG: --vmodule="" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388709 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.388712 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388842 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388846 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388849 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388852 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388855 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388858 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388860 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388863 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388865 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388868 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388872 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388874 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:35.397276 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388877 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388879 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388882 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388886 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388889 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388891 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388893 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388897 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388899 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388901 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388904 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388907 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388909 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388911 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388914 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388916 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388918 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388921 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388923 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:35.398172 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388926 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388928 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388930 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388933 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388935 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388937 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388940 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388942 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388944 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388946 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388949 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388953 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388955 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388957 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388960 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388962 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388966 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388969 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388971 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388974 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:35.398993 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388976 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388979 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388982 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388984 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388987 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388989 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388992 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388994 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388997 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.388999 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389001 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389003 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389006 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389008 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389011 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389013 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389015 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389018 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389020 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389023 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:35.399811 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389025 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389027 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389029 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389033 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389037 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389040 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389042 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389045 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389049 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389051 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389054 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389056 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389059 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389061 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389065 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389069 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389072 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389075 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389077 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:35.400340 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389080 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389082 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389085 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389087 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389089 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389092 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389094 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389096 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.389100 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.389812 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.398283 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.398304 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.398326 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.398334 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 01 18:27:35.400776 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398438 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398446 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398451 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398456 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398460 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398464 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398469 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398473 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398477 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398481 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398485 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398489 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398493 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398496 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398501 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398504 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398508 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398512 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398516 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398520 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:35.401318 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398524 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398528 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398531 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398535 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398539 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398543 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398547 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398551 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398555 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398568 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398573 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398576 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398581 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398585 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398589 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398593 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398597 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398601 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398605 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398613 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:35.402131 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398617 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398624 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398629 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398634 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398638 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398643 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398647 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398651 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398655 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398659 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398663 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398667 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398671 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398675 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398679 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398682 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398688 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398693 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:35.402672 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398700 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398705 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398710 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398716 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398727 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398732 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398736 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398750 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398755 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398759 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398763 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398767 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398771 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398774 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398779 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398802 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398807 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398811 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398815 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398818 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:35.403204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398822 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398826 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398830 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398834 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398838 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398841 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398845 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398849 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398853 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398856 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398860 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398864 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398868 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398872 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398876 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398881 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398886 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398899 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398903 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398907 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:35.403703 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.398910 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.398918 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399182 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399191 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399196 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399200 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399205 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399209 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399213 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399217 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399221 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399225 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399229 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399233 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399237 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 01 18:27:35.404204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399241 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399244 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399248 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399252 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399256 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399260 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399263 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399267 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399271 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399275 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399279 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399283 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399287 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399292 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399296 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399307 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399311 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399315 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399319 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399323 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 01 18:27:35.404545 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399327 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399331 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399335 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399338 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399342 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399346 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399350 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399354 2574 feature_gate.go:328] unrecognized feature gate: Example Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399358 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399361 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399365 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399369 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399373 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399378 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399384 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399388 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399392 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399396 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399399 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 01 18:27:35.405170 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399403 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399407 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399410 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399415 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399419 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399423 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399427 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399431 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399435 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399446 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399450 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399454 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399458 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399462 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399466 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399470 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399474 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399478 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399482 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 01 18:27:35.405604 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399485 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399489 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399493 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399497 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399503 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399508 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399512 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399517 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399521 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399525 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399529 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399533 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399539 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399544 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399548 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399552 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399556 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399560 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399564 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 01 18:27:35.406120 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399568 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399572 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399576 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399580 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399590 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399594 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399598 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399602 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:35.399605 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.399612 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.399865 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.403056 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.404880 2574 server.go:1019] "Starting client certificate rotation" Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.404983 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:27:35.406565 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.405018 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 01 18:27:35.407723 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.407698 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:27:35.412618 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.412600 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 01 18:27:35.425463 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.425404 2574 log.go:25] "Validated CRI v1 runtime API" Jul 01 18:27:35.427895 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.427881 2574 log.go:25] "Validated CRI v1 image API" Jul 01 18:27:35.428636 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.428619 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 01 18:27:35.432677 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.432653 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 802ec764-1ec7-4705-893e-adafdda89f23:/dev/nvme0n1p3 812cbed1-8f8c-450d-a054-0a953d5720c3:/dev/nvme0n1p4] Jul 01 18:27:35.432761 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.432675 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 01 18:27:35.436947 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.436930 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:27:35.437899 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.437771 2574 manager.go:216] Machine: {Timestamp:2026-07-01 18:27:35.436306327 +0000 UTC m=+0.371078119 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3200089 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ea9eaec87bf0f153b48ef22fb8ea1 SystemUUID:ec2ea9ea-ec87-bf0f-153b-48ef22fb8ea1 BootID:0d89c46c-e090-4e20-a820-7baf54892bda Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b0:f8:3d:de:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b0:f8:3d:de:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:89:e3:33:64:30 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 01 18:27:35.437899 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.437896 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 01 18:27:35.438000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.437985 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.124.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260623-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 01 18:27:35.440363 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.440336 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 01 18:27:35.440500 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.440364 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-190.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 01 18:27:35.440977 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.440967 2574 topology_manager.go:138] "Creating topology manager with none policy" Jul 01 18:27:35.441008 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.440979 2574 container_manager_linux.go:309] "Creating device plugin manager" Jul 01 18:27:35.441008 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.440986 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:27:35.441710 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.441701 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 01 18:27:35.442510 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.442501 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 01 18:27:35.445646 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.445630 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:27:35.445766 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.445758 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 01 18:27:35.445841 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.445832 2574 kubelet.go:486] "Attempting to sync node with API server" Jul 01 18:27:35.445872 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.445852 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 01 18:27:35.445872 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.445861 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 01 18:27:35.445921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.445875 2574 kubelet.go:398] "Adding apiserver pod source" Jul 01 18:27:35.445921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.445883 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 01 18:27:35.446242 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.446229 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:27:35.446296 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.446250 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 01 18:27:35.448209 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.448185 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 01 18:27:35.450611 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.450593 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 01 18:27:35.450701 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.450630 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 01 18:27:35.451812 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451780 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 01 18:27:35.451881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451817 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 01 18:27:35.451881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451824 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 01 18:27:35.451881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451829 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 01 18:27:35.451881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451838 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 01 18:27:35.451881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451844 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 01 18:27:35.451881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451851 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 01 18:27:35.451881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451856 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 01 18:27:35.452059 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451862 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 01 18:27:35.452059 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451902 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 01 18:27:35.452059 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451914 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 01 18:27:35.452059 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.451921 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 01 18:27:35.453278 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.453266 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 01 18:27:35.453278 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.453276 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 01 18:27:35.456275 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.456261 2574 server.go:1268] "Started kubelet" Jul 01 18:27:35.456411 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.456373 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 01 18:27:35.456493 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.456405 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 01 18:27:35.456493 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.456465 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 01 18:27:35.457089 ip-10-0-128-190 systemd[1]: Started Kubernetes Kubelet. Jul 01 18:27:35.457617 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.457599 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 01 18:27:35.458323 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.458307 2574 server.go:310] "Adding debug handlers to kubelet server" Jul 01 18:27:35.458696 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.458673 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ljkzw" Jul 01 18:27:35.459366 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.459348 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-190.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 01 18:27:35.459366 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.459352 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 01 18:27:35.459484 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.459466 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 01 18:27:35.461810 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.461774 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 01 18:27:35.464041 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.463161 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-190.ec2.internal.18be3dcd88b1c696 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-190.ec2.internal,UID:ip-10-0-128-190.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-190.ec2.internal,},FirstTimestamp:2026-07-01 18:27:35.456237206 +0000 UTC m=+0.391009003,LastTimestamp:2026-07-01 18:27:35.456237206 +0000 UTC m=+0.391009003,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-190.ec2.internal,}" Jul 01 18:27:35.465563 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.465540 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 01 18:27:35.465647 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.465600 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 01 18:27:35.465647 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.465603 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ljkzw" Jul 01 18:27:35.465988 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.465968 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:35.466220 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.466207 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 01 18:27:35.466296 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.466223 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 01 18:27:35.466381 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.466361 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 01 18:27:35.466465 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.466408 2574 reconstruct.go:97] "Volume reconstruction finished" Jul 01 18:27:35.466465 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.466418 2574 reconciler.go:29] "Reconciler: start to sync state" Jul 01 18:27:35.468170 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.467982 2574 factory.go:55] Registering systemd factory Jul 01 18:27:35.468170 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.468002 2574 factory.go:223] Registration of the systemd container factory successfully Jul 01 18:27:35.468892 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.468877 2574 factory.go:153] Registering CRI-O factory Jul 01 18:27:35.468973 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.468895 2574 factory.go:223] Registration of the crio container factory successfully Jul 01 18:27:35.468973 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.468942 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 01 18:27:35.468973 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.468969 2574 factory.go:103] Registering Raw factory Jul 01 18:27:35.469101 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.468984 2574 manager.go:1196] Started watching for new ooms in manager Jul 01 18:27:35.469516 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.469501 2574 manager.go:349] Starting recovery of all containers Jul 01 18:27:35.470626 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.470595 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-190.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 01 18:27:35.470801 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.470754 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 01 18:27:35.482796 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.482764 2574 manager.go:354] Recovery completed Jul 01 18:27:35.487071 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.487057 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:35.489914 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.489896 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:35.489988 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.489931 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:35.489988 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.489944 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:35.490500 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.490490 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 01 18:27:35.490500 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.490500 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 01 18:27:35.490577 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.490515 2574 state_mem.go:36] "Initialized new in-memory state store" Jul 01 18:27:35.490577 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.490557 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:35.491862 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.491849 2574 policy_none.go:49] "None policy: Start" Jul 01 18:27:35.491921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.491880 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 01 18:27:35.491921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.491897 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 01 18:27:35.491970 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.491847 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:35.491970 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.491955 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:35.492017 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.491970 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:35.493459 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.493449 2574 policy_none.go:47] "Start" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.531493 2574 manager.go:337] "Starting Device Plugin manager" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.531675 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.531697 2574 server.go:87] "Starting device plugin registration server" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.531959 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.531980 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.532116 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.532555 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.532568 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.532818 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.532894 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.533956 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.535180 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.535214 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.535233 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jul 01 18:27:35.536398 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.535269 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 01 18:27:35.537563 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.537543 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:35.632817 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.632770 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:35.633807 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.633775 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:35.633895 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.633823 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:35.633895 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.633833 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:35.633895 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.633866 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.635833 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.635810 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal"] Jul 01 18:27:35.635881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.635873 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:35.636642 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.636618 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:35.636642 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.636645 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:35.636761 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.636656 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:35.638175 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638164 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:35.638295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.638327 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638322 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:35.638893 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638881 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:35.638960 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638904 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:35.638960 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638913 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:35.638960 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638943 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:35.639071 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638966 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:35.639071 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.638978 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:35.640197 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.640181 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.640270 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.640204 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-190.ec2.internal\": node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:35.640270 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.640187 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.640336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.640300 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 01 18:27:35.640997 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.640981 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientMemory" Jul 01 18:27:35.641082 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.641009 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasNoDiskPressure" Jul 01 18:27:35.641082 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.641023 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeHasSufficientPID" Jul 01 18:27:35.653852 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.653836 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:35.656331 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.656318 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-190.ec2.internal\" not found" node="ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.659996 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.659981 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-190.ec2.internal\" not found" node="ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.754147 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.754066 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:35.767706 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.767681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00432cb5944b7b354bb07d8bbaf4574d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-190.ec2.internal\" (UID: \"00432cb5944b7b354bb07d8bbaf4574d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.767775 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.767716 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a73242044ffea168987df30a87a9f27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal\" (UID: \"8a73242044ffea168987df30a87a9f27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.767775 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.767734 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a73242044ffea168987df30a87a9f27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal\" (UID: \"8a73242044ffea168987df30a87a9f27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.854278 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.854241 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:35.868482 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.868451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00432cb5944b7b354bb07d8bbaf4574d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-190.ec2.internal\" (UID: \"00432cb5944b7b354bb07d8bbaf4574d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.868589 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.868489 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a73242044ffea168987df30a87a9f27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal\" (UID: \"8a73242044ffea168987df30a87a9f27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.868589 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.868511 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a73242044ffea168987df30a87a9f27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal\" (UID: \"8a73242044ffea168987df30a87a9f27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.868589 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.868551 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/00432cb5944b7b354bb07d8bbaf4574d-config\") pod \"kube-apiserver-proxy-ip-10-0-128-190.ec2.internal\" (UID: \"00432cb5944b7b354bb07d8bbaf4574d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.868589 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.868554 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8a73242044ffea168987df30a87a9f27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal\" (UID: \"8a73242044ffea168987df30a87a9f27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.868728 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.868555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8a73242044ffea168987df30a87a9f27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal\" (UID: \"8a73242044ffea168987df30a87a9f27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.954721 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:35.954694 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:35.959839 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.959819 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" Jul 01 18:27:35.965030 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:35.965003 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:36.055179 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.055091 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.155832 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.155782 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.256354 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.256324 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.357250 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.357165 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.403835 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.403803 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 01 18:27:36.404295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.403953 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 01 18:27:36.457307 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.457280 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.470391 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.470343 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-30 18:22:35 +0000 UTC" deadline="2028-02-05 04:48:52.679938835 +0000 UTC" Jul 01 18:27:36.470391 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.470381 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14002h21m16.209559594s" Jul 01 18:27:36.558170 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.558144 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.637166 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:36.637139 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a73242044ffea168987df30a87a9f27.slice/crio-dd1429b67c638909a51886566dad1b5dc5629ef81e54baad5a1676c35db362d6 WatchSource:0}: Error finding container dd1429b67c638909a51886566dad1b5dc5629ef81e54baad5a1676c35db362d6: Status 404 returned error can't find the container with id dd1429b67c638909a51886566dad1b5dc5629ef81e54baad5a1676c35db362d6 Jul 01 18:27:36.637803 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:36.637751 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00432cb5944b7b354bb07d8bbaf4574d.slice/crio-f26cdbb5be994729b4803cb261fbaa4f26ea3d275dc91e18ea76251993083ef7 WatchSource:0}: Error finding container f26cdbb5be994729b4803cb261fbaa4f26ea3d275dc91e18ea76251993083ef7: Status 404 returned error can't find the container with id f26cdbb5be994729b4803cb261fbaa4f26ea3d275dc91e18ea76251993083ef7 Jul 01 18:27:36.642101 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.642083 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:27:36.659183 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.659163 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.759953 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.759905 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.792375 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.792346 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:36.860899 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:36.860867 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-190.ec2.internal\" not found" Jul 01 18:27:36.935030 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.934951 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:36.967061 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.967034 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" Jul 01 18:27:36.977139 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.977114 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:27:36.978874 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.978859 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" Jul 01 18:27:36.986254 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:36.986239 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 01 18:27:37.061209 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.061179 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:37.447065 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.447033 2574 apiserver.go:52] "Watching apiserver" Jul 01 18:27:37.452030 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.452002 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 01 18:27:37.454099 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.454068 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4cptw","kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9nl4h","openshift-image-registry/node-ca-6k2jg","openshift-multus/multus-additional-cni-plugins-lm47g","openshift-multus/network-metrics-daemon-947sf","openshift-network-diagnostics/network-check-target-qjf7l","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb","openshift-dns/node-resolver-lsgd6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal","openshift-multus/multus-jvljf","openshift-network-operator/iptables-alerter-8t6j6","openshift-ovn-kubernetes/ovnkube-node-pkt5l","kube-system/global-pull-secret-syncer-sjcfw"] Jul 01 18:27:37.455935 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.455917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:37.456040 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.455990 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:37.457036 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.457015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.458478 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.458135 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.460054 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.459812 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.462191 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.460926 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 01 18:27:37.462191 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.460953 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 01 18:27:37.462191 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.461346 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:27:37.462191 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.461385 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 01 18:27:37.462191 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.461925 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 01 18:27:37.462191 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.461942 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 01 18:27:37.462191 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.462047 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 01 18:27:37.462564 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.462281 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 01 18:27:37.462564 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.462501 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-98v95\"" Jul 01 18:27:37.464303 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.463043 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.464303 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.463445 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m8ztt\"" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.464629 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.464717 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.465048 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.465085 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.465157 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.465473 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.465487 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gf7xc\"" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.465718 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.465878 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pfxfn\"" Jul 01 18:27:37.466143 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.465891 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 01 18:27:37.466866 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.466830 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 01 18:27:37.467629 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.467300 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 01 18:27:37.467879 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.467683 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.467879 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.467837 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 01 18:27:37.468960 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.468933 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:37.469474 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.469460 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 01 18:27:37.469646 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.469629 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 01 18:27:37.469775 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.469757 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z5chw\"" Jul 01 18:27:37.470541 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.470526 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.470714 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.470671 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 01 18:27:37.470937 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.470913 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:37.471022 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.470952 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6l8dk\"" Jul 01 18:27:37.471081 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.470954 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 01 18:27:37.472247 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.471975 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.473314 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.473298 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.474269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.474243 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 01 18:27:37.474493 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.474476 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xvt8c\"" Jul 01 18:27:37.474615 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.474571 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 01 18:27:37.474803 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.474746 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 01 18:27:37.477488 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.477104 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.479023 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479000 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.479113 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479038 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:37.479113 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-systemd-units\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479113 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479138 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 01 18:27:37.479269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovnkube-config\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479193 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-run\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.479269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cnibin\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.479269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-os-release\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.479536 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479282 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.479536 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74dd95b0-3118-4585-82a2-d7aadcbcb385-hosts-file\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.479536 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-slash\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479536 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479363 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-cni-netd\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479536 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479383 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hxfb5\"" Jul 01 18:27:37.479536 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-modprobe-d\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.479536 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479500 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cni-binary-copy\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479537 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdmc8\" (UniqueName: \"kubernetes.io/projected/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-kube-api-access-bdmc8\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479573 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-systemd\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479607 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-etc-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-cni-bin\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9c9x\" (UniqueName: \"kubernetes.io/projected/fbdf134e-15ee-45d8-9d57-55334829cb6a-kube-api-access-x9c9x\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479676 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-sys\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-lib-modules\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-var-lib-kubelet\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479755 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-kubelet\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479763 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-znz9s\"" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479773 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28784f12-79d9-4954-b1e3-522fea8dbdcf-serviceca\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-host\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479850 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6vh\" (UniqueName: \"kubernetes.io/projected/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-kube-api-access-qz6vh\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s58dw\" (UniqueName: \"kubernetes.io/projected/74dd95b0-3118-4585-82a2-d7aadcbcb385-kube-api-access-s58dw\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.479900 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479907 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-node-log\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.479980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-log-socket\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480015 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-env-overrides\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480018 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovn-node-metrics-cert\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysctl-conf\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-systemd\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74dd95b0-3118-4585-82a2-d7aadcbcb385-tmp-dir\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-var-lib-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovnkube-script-lib\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480176 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h4g2\" (UniqueName: \"kubernetes.io/projected/28784f12-79d9-4954-b1e3-522fea8dbdcf-kube-api-access-8h4g2\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480212 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b870091-3050-4767-9b6a-d15179f26464-etc-tuned\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-ovn\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28784f12-79d9-4954-b1e3-522fea8dbdcf-host\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.480596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysctl-d\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.481356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480361 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgxx6\" (UniqueName: \"kubernetes.io/projected/2b870091-3050-4767-9b6a-d15179f26464-kube-api-access-dgxx6\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.481356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480374 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:27:37.481356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.481356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480417 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-run-netns\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.481356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysconfig\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.481356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-kubernetes\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.481356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480777 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b870091-3050-4767-9b6a-d15179f26464-tmp\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.481356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.480821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-system-cni-dir\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.502440 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.502415 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbhdv" Jul 01 18:27:37.510956 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.510935 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nbhdv" Jul 01 18:27:37.543338 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.543289 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" event={"ID":"8a73242044ffea168987df30a87a9f27","Type":"ContainerStarted","Data":"dd1429b67c638909a51886566dad1b5dc5629ef81e54baad5a1676c35db362d6"} Jul 01 18:27:37.544761 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.544729 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" event={"ID":"00432cb5944b7b354bb07d8bbaf4574d","Type":"ContainerStarted","Data":"f26cdbb5be994729b4803cb261fbaa4f26ea3d275dc91e18ea76251993083ef7"} Jul 01 18:27:37.568342 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.568312 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 01 18:27:37.581891 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.581856 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-run\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582074 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.581901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.582074 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.581925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-socket-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.582074 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.581971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-registration-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.582074 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.581997 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74dd95b0-3118-4585-82a2-d7aadcbcb385-hosts-file\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.582074 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582019 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-slash\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582074 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582041 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-cni-netd\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582074 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582060 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-modprobe-d\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582071 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-run\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-systemd\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-cni-bin\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9c9x\" (UniqueName: \"kubernetes.io/projected/fbdf134e-15ee-45d8-9d57-55334829cb6a-kube-api-access-x9c9x\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582139 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/74dd95b0-3118-4585-82a2-d7aadcbcb385-hosts-file\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdadd096-1f5c-4d29-88ae-2901deac0104-konnectivity-ca\") pod \"konnectivity-agent-4cptw\" (UID: \"bdadd096-1f5c-4d29-88ae-2901deac0104\") " pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-kubelet\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582235 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-slash\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-kubelet\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-cni-netd\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582342 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-modprobe-d\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582409 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-cni-bin\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-host\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582456 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-systemd\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582491 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-device-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-host\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-socket-dir-parent\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysctl-conf\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582633 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-cnibin\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582655 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-var-lib-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovnkube-script-lib\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582699 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h4g2\" (UniqueName: \"kubernetes.io/projected/28784f12-79d9-4954-b1e3-522fea8dbdcf-kube-api-access-8h4g2\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b870091-3050-4767-9b6a-d15179f26464-etc-tuned\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-ovn\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582763 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-etc-selinux\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysctl-conf\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-hostroot\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysconfig\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582843 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-var-lib-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-ovn\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.582995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysconfig\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.582943 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583118 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583183 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583206 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-netns\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-kubelet\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-systemd-units\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583330 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583390 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cnibin\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-os-release\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583482 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583489 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583511 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-run-ovn-kubernetes\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/863b0c81-feec-4346-a9e4-9f0e4ea4723c-host-slash\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cnibin\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.583711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-systemd-units\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583584 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-os-release\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovnkube-script-lib\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj2xk\" (UniqueName: \"kubernetes.io/projected/863b0c81-feec-4346-a9e4-9f0e4ea4723c-kube-api-access-pj2xk\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583642 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cni-binary-copy\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.583651 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583682 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdmc8\" (UniqueName: \"kubernetes.io/projected/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-kube-api-access-bdmc8\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.583777 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs podName:021c38e9-03d2-4dbc-bc8a-064de7a0c62f nodeName:}" failed. No retries permitted until 2026-07-01 18:27:38.083745096 +0000 UTC m=+3.018516893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs") pod "network-metrics-daemon-947sf" (UID: "021c38e9-03d2-4dbc-bc8a-064de7a0c62f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdadd096-1f5c-4d29-88ae-2901deac0104-agent-certs\") pod \"konnectivity-agent-4cptw\" (UID: \"bdadd096-1f5c-4d29-88ae-2901deac0104\") " pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583891 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16343865-65ff-4e09-a37f-d7ba4939141a-dbus\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583924 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-cni-multus\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-etc-kubernetes\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-etc-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.583993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-sys\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584026 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-lib-modules\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584041 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-etc-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.584605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-var-lib-kubelet\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584058 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-sys\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-sys-fs\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-var-lib-kubelet\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584102 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-cni-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-k8s-cni-cncf-io\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584145 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-lib-modules\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584160 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-cni-bin\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584165 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-cni-binary-copy\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28784f12-79d9-4954-b1e3-522fea8dbdcf-serviceca\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6vh\" (UniqueName: \"kubernetes.io/projected/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-kube-api-access-qz6vh\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16343865-65ff-4e09-a37f-d7ba4939141a-kubelet-config\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584260 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l25kq\" (UniqueName: \"kubernetes.io/projected/689ab513-7820-47b3-87ee-e760d7b98ee3-kube-api-access-l25kq\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-system-cni-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584312 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-conf-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584336 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s58dw\" (UniqueName: \"kubernetes.io/projected/74dd95b0-3118-4585-82a2-d7aadcbcb385-kube-api-access-s58dw\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.585410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-node-log\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584426 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-log-socket\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584451 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-env-overrides\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-node-log\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovn-node-metrics-cert\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-log-socket\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-systemd\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584543 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d8qw\" (UniqueName: \"kubernetes.io/projected/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-kube-api-access-2d8qw\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74dd95b0-3118-4585-82a2-d7aadcbcb385-tmp-dir\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584608 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28784f12-79d9-4954-b1e3-522fea8dbdcf-serviceca\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584616 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-systemd\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-run-openvswitch\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584644 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584694 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-os-release\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-cni-binary-copy\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-daemon-config\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.586206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28784f12-79d9-4954-b1e3-522fea8dbdcf-host\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584810 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysctl-d\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584835 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgxx6\" (UniqueName: \"kubernetes.io/projected/2b870091-3050-4767-9b6a-d15179f26464-kube-api-access-dgxx6\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584860 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/74dd95b0-3118-4585-82a2-d7aadcbcb385-tmp-dir\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584887 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/863b0c81-feec-4346-a9e4-9f0e4ea4723c-iptables-alerter-script\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.584864 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-env-overrides\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585062 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28784f12-79d9-4954-b1e3-522fea8dbdcf-host\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585078 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-sysctl-d\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-multus-certs\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585159 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-run-netns\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-kubernetes\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585223 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbdf134e-15ee-45d8-9d57-55334829cb6a-host-run-netns\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b870091-3050-4767-9b6a-d15179f26464-tmp\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-system-cni-dir\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585321 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovnkube-config\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585572 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.587004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-system-cni-dir\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.587780 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585688 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2b870091-3050-4767-9b6a-d15179f26464-etc-kubernetes\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.587780 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.585863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovnkube-config\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.587780 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.587304 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2b870091-3050-4767-9b6a-d15179f26464-etc-tuned\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.588073 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.588030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2b870091-3050-4767-9b6a-d15179f26464-tmp\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.588809 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.588768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdf134e-15ee-45d8-9d57-55334829cb6a-ovn-node-metrics-cert\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.591596 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.591574 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:37.591694 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.591599 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:37.591694 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.591613 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hl8dv for pod openshift-network-diagnostics/network-check-target-qjf7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:37.591823 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.591692 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv podName:3c157c07-028f-4f99-9c22-5ddecf22d171 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:38.091663829 +0000 UTC m=+3.026435617 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hl8dv" (UniqueName: "kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv") pod "network-check-target-qjf7l" (UID: "3c157c07-028f-4f99-9c22-5ddecf22d171") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:37.593483 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.593459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h4g2\" (UniqueName: \"kubernetes.io/projected/28784f12-79d9-4954-b1e3-522fea8dbdcf-kube-api-access-8h4g2\") pod \"node-ca-6k2jg\" (UID: \"28784f12-79d9-4954-b1e3-522fea8dbdcf\") " pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.593581 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.593493 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9c9x\" (UniqueName: \"kubernetes.io/projected/fbdf134e-15ee-45d8-9d57-55334829cb6a-kube-api-access-x9c9x\") pod \"ovnkube-node-pkt5l\" (UID: \"fbdf134e-15ee-45d8-9d57-55334829cb6a\") " pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.594255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.594179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdmc8\" (UniqueName: \"kubernetes.io/projected/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-kube-api-access-bdmc8\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:37.594726 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.594695 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgxx6\" (UniqueName: \"kubernetes.io/projected/2b870091-3050-4767-9b6a-d15179f26464-kube-api-access-dgxx6\") pod \"tuned-9nl4h\" (UID: \"2b870091-3050-4767-9b6a-d15179f26464\") " pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.595326 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.595303 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6vh\" (UniqueName: \"kubernetes.io/projected/fd1d5d37-fb35-48f2-a5b4-e220af3d348f-kube-api-access-qz6vh\") pod \"multus-additional-cni-plugins-lm47g\" (UID: \"fd1d5d37-fb35-48f2-a5b4-e220af3d348f\") " pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.596157 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.596136 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s58dw\" (UniqueName: \"kubernetes.io/projected/74dd95b0-3118-4585-82a2-d7aadcbcb385-kube-api-access-s58dw\") pod \"node-resolver-lsgd6\" (UID: \"74dd95b0-3118-4585-82a2-d7aadcbcb385\") " pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.685751 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-sys-fs\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.685751 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685755 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-cni-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685782 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-k8s-cni-cncf-io\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-cni-bin\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16343865-65ff-4e09-a37f-d7ba4939141a-kubelet-config\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685869 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l25kq\" (UniqueName: \"kubernetes.io/projected/689ab513-7820-47b3-87ee-e760d7b98ee3-kube-api-access-l25kq\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685872 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-sys-fs\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685893 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-system-cni-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-cni-bin\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-k8s-cni-cncf-io\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685933 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-cni-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-conf-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/16343865-65ff-4e09-a37f-d7ba4939141a-kubelet-config\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.686000 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.685974 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-system-cni-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-conf-dir\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d8qw\" (UniqueName: \"kubernetes.io/projected/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-kube-api-access-2d8qw\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686115 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-os-release\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686155 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-cni-binary-copy\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.686219 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686245 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-daemon-config\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:37.686283 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret podName:16343865-65ff-4e09-a37f-d7ba4939141a nodeName:}" failed. No retries permitted until 2026-07-01 18:27:38.186263458 +0000 UTC m=+3.121035240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret") pod "global-pull-secret-syncer-sjcfw" (UID: "16343865-65ff-4e09-a37f-d7ba4939141a") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686217 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-os-release\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/863b0c81-feec-4346-a9e4-9f0e4ea4723c-iptables-alerter-script\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-multus-certs\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686388 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-socket-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686410 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-registration-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdadd096-1f5c-4d29-88ae-2901deac0104-konnectivity-ca\") pod \"konnectivity-agent-4cptw\" (UID: \"bdadd096-1f5c-4d29-88ae-2901deac0104\") " pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686464 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-device-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.686561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686519 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-device-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686568 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-socket-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686584 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-registration-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686601 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-socket-dir-parent\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686630 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-cnibin\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-multus-certs\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-etc-selinux\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686700 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-hostroot\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-netns\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-cni-binary-copy\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/689ab513-7820-47b3-87ee-e760d7b98ee3-etc-selinux\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-daemon-config\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686774 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-kubelet\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686751 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-hostroot\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686806 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-run-netns\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686811 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-multus-socket-dir-parent\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/863b0c81-feec-4346-a9e4-9f0e4ea4723c-host-slash\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.687350 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-kubelet\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686858 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj2xk\" (UniqueName: \"kubernetes.io/projected/863b0c81-feec-4346-a9e4-9f0e4ea4723c-kube-api-access-pj2xk\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686888 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdadd096-1f5c-4d29-88ae-2901deac0104-agent-certs\") pod \"konnectivity-agent-4cptw\" (UID: \"bdadd096-1f5c-4d29-88ae-2901deac0104\") " pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686878 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/863b0c81-feec-4346-a9e4-9f0e4ea4723c-host-slash\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686809 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-cnibin\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16343865-65ff-4e09-a37f-d7ba4939141a-dbus\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686935 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-cni-multus\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686956 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/16343865-65ff-4e09-a37f-d7ba4939141a-dbus\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686959 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-etc-kubernetes\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686902 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/863b0c81-feec-4346-a9e4-9f0e4ea4723c-iptables-alerter-script\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.686990 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-etc-kubernetes\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.687021 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-host-var-lib-cni-multus\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.688226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.687083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bdadd096-1f5c-4d29-88ae-2901deac0104-konnectivity-ca\") pod \"konnectivity-agent-4cptw\" (UID: \"bdadd096-1f5c-4d29-88ae-2901deac0104\") " pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:37.689357 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.689340 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bdadd096-1f5c-4d29-88ae-2901deac0104-agent-certs\") pod \"konnectivity-agent-4cptw\" (UID: \"bdadd096-1f5c-4d29-88ae-2901deac0104\") " pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:37.695062 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.695038 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l25kq\" (UniqueName: \"kubernetes.io/projected/689ab513-7820-47b3-87ee-e760d7b98ee3-kube-api-access-l25kq\") pod \"aws-ebs-csi-driver-node-cm7cb\" (UID: \"689ab513-7820-47b3-87ee-e760d7b98ee3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.695586 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.695565 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d8qw\" (UniqueName: \"kubernetes.io/projected/b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf-kube-api-access-2d8qw\") pod \"multus-jvljf\" (UID: \"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf\") " pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.695670 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.695592 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj2xk\" (UniqueName: \"kubernetes.io/projected/863b0c81-feec-4346-a9e4-9f0e4ea4723c-kube-api-access-pj2xk\") pod \"iptables-alerter-8t6j6\" (UID: \"863b0c81-feec-4346-a9e4-9f0e4ea4723c\") " pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.774814 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.774721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:27:37.780665 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.780641 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" Jul 01 18:27:37.791397 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.791372 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-6k2jg" Jul 01 18:27:37.797015 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.796992 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lm47g" Jul 01 18:27:37.804889 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.804867 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lsgd6" Jul 01 18:27:37.813742 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.813720 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:37.820474 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.820454 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" Jul 01 18:27:37.828181 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.828161 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jvljf" Jul 01 18:27:37.842909 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.842883 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8t6j6" Jul 01 18:27:37.942237 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:37.942205 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 01 18:27:38.089942 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:38.089865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:38.090085 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:38.090050 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:38.090143 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:38.090112 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs podName:021c38e9-03d2-4dbc-bc8a-064de7a0c62f nodeName:}" failed. No retries permitted until 2026-07-01 18:27:39.090094067 +0000 UTC m=+4.024865864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs") pod "network-metrics-daemon-947sf" (UID: "021c38e9-03d2-4dbc-bc8a-064de7a0c62f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:38.191044 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:38.191007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:38.191216 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:38.191057 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:38.191216 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:38.191173 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:38.191216 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:38.191196 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:38.191216 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:38.191200 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:38.191216 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:38.191218 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hl8dv for pod openshift-network-diagnostics/network-check-target-qjf7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:38.191495 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:38.191255 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret podName:16343865-65ff-4e09-a37f-d7ba4939141a nodeName:}" failed. No retries permitted until 2026-07-01 18:27:39.191237811 +0000 UTC m=+4.126009598 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret") pod "global-pull-secret-syncer-sjcfw" (UID: "16343865-65ff-4e09-a37f-d7ba4939141a") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:38.191495 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:38.191272 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv podName:3c157c07-028f-4f99-9c22-5ddecf22d171 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:39.191263697 +0000 UTC m=+4.126035484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl8dv" (UniqueName: "kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv") pod "network-check-target-qjf7l" (UID: "3c157c07-028f-4f99-9c22-5ddecf22d171") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:38.513553 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:38.513421 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:22:37 +0000 UTC" deadline="2028-03-12 02:20:16.177355754 +0000 UTC" Jul 01 18:27:38.513553 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:38.513498 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14863h52m37.663862512s" Jul 01 18:27:38.657515 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.657485 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b870091_3050_4767_9b6a_d15179f26464.slice/crio-e2c0622d5a8bd2dbbc356748b2b19c71051f6a4141241aa6711c9054025b887b WatchSource:0}: Error finding container e2c0622d5a8bd2dbbc356748b2b19c71051f6a4141241aa6711c9054025b887b: Status 404 returned error can't find the container with id e2c0622d5a8bd2dbbc356748b2b19c71051f6a4141241aa6711c9054025b887b Jul 01 18:27:38.659875 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.659846 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd1d5d37_fb35_48f2_a5b4_e220af3d348f.slice/crio-8ddc04f138b6d9456d877d9f3d06522c4be62358f89689002ca1244eec9bb198 WatchSource:0}: Error finding container 8ddc04f138b6d9456d877d9f3d06522c4be62358f89689002ca1244eec9bb198: Status 404 returned error can't find the container with id 8ddc04f138b6d9456d877d9f3d06522c4be62358f89689002ca1244eec9bb198 Jul 01 18:27:38.661955 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.661932 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbdf134e_15ee_45d8_9d57_55334829cb6a.slice/crio-9146f42cdebf3919cb0668c9078f5167437a4006091b173202860f1e2386c9b8 WatchSource:0}: Error finding container 9146f42cdebf3919cb0668c9078f5167437a4006091b173202860f1e2386c9b8: Status 404 returned error can't find the container with id 9146f42cdebf3919cb0668c9078f5167437a4006091b173202860f1e2386c9b8 Jul 01 18:27:38.663434 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.663412 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74dd95b0_3118_4585_82a2_d7aadcbcb385.slice/crio-2e2139b3cab7213e124f8b246f851bf099cb26a9c08f6659c083103e47c5ba83 WatchSource:0}: Error finding container 2e2139b3cab7213e124f8b246f851bf099cb26a9c08f6659c083103e47c5ba83: Status 404 returned error can't find the container with id 2e2139b3cab7213e124f8b246f851bf099cb26a9c08f6659c083103e47c5ba83 Jul 01 18:27:38.664966 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.664941 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod863b0c81_feec_4346_a9e4_9f0e4ea4723c.slice/crio-3941de3596624d3f58dd9609f92eb0620d7777193d044a9167dc11a454bc956f WatchSource:0}: Error finding container 3941de3596624d3f58dd9609f92eb0620d7777193d044a9167dc11a454bc956f: Status 404 returned error can't find the container with id 3941de3596624d3f58dd9609f92eb0620d7777193d044a9167dc11a454bc956f Jul 01 18:27:38.668225 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.668203 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdadd096_1f5c_4d29_88ae_2901deac0104.slice/crio-f2cc98f03969fcbcea0d55bb168ba8fc51299ffc0a42e2d7bdbee7234da61932 WatchSource:0}: Error finding container f2cc98f03969fcbcea0d55bb168ba8fc51299ffc0a42e2d7bdbee7234da61932: Status 404 returned error can't find the container with id f2cc98f03969fcbcea0d55bb168ba8fc51299ffc0a42e2d7bdbee7234da61932 Jul 01 18:27:38.668980 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.668868 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28784f12_79d9_4954_b1e3_522fea8dbdcf.slice/crio-97a98ce0f8d8cbbc0879ec82f5cb9bb9aee141ddab5bfe56b97e171fd84cd799 WatchSource:0}: Error finding container 97a98ce0f8d8cbbc0879ec82f5cb9bb9aee141ddab5bfe56b97e171fd84cd799: Status 404 returned error can't find the container with id 97a98ce0f8d8cbbc0879ec82f5cb9bb9aee141ddab5bfe56b97e171fd84cd799 Jul 01 18:27:38.669640 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.669572 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689ab513_7820_47b3_87ee_e760d7b98ee3.slice/crio-53ffdfacb59fd221b64922f50b4ba8b18acbb3a789160573ac872e902d8c4f52 WatchSource:0}: Error finding container 53ffdfacb59fd221b64922f50b4ba8b18acbb3a789160573ac872e902d8c4f52: Status 404 returned error can't find the container with id 53ffdfacb59fd221b64922f50b4ba8b18acbb3a789160573ac872e902d8c4f52 Jul 01 18:27:38.671569 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:27:38.671538 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c3f4ea_0b74_4470_92c3_75ae69b9b2cf.slice/crio-3c419d641420ab480b4b87d5363556a2415ca6829fd6030c8fc0a4bb35c25cbe WatchSource:0}: Error finding container 3c419d641420ab480b4b87d5363556a2415ca6829fd6030c8fc0a4bb35c25cbe: Status 404 returned error can't find the container with id 3c419d641420ab480b4b87d5363556a2415ca6829fd6030c8fc0a4bb35c25cbe Jul 01 18:27:39.097908 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.097550 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:39.097908 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.097814 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:39.097908 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.097908 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs podName:021c38e9-03d2-4dbc-bc8a-064de7a0c62f nodeName:}" failed. No retries permitted until 2026-07-01 18:27:41.097887217 +0000 UTC m=+6.032659013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs") pod "network-metrics-daemon-947sf" (UID: "021c38e9-03d2-4dbc-bc8a-064de7a0c62f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:39.199555 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.198927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:39.199555 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.198980 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:39.199555 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.199094 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:39.199555 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.199155 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret podName:16343865-65ff-4e09-a37f-d7ba4939141a nodeName:}" failed. No retries permitted until 2026-07-01 18:27:41.19913695 +0000 UTC m=+6.133908748 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret") pod "global-pull-secret-syncer-sjcfw" (UID: "16343865-65ff-4e09-a37f-d7ba4939141a") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:39.199555 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.199501 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:39.199555 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.199523 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:39.199555 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.199534 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hl8dv for pod openshift-network-diagnostics/network-check-target-qjf7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:39.200011 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.199604 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv podName:3c157c07-028f-4f99-9c22-5ddecf22d171 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:41.199575605 +0000 UTC m=+6.134347404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl8dv" (UniqueName: "kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv") pod "network-check-target-qjf7l" (UID: "3c157c07-028f-4f99-9c22-5ddecf22d171") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:39.513978 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.513854 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-30 18:22:37 +0000 UTC" deadline="2027-12-03 23:52:35.65239048 +0000 UTC" Jul 01 18:27:39.513978 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.513890 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12485h24m56.138505359s" Jul 01 18:27:39.544615 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.543846 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:39.544615 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.543979 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:39.544615 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.544362 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:39.544615 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.544448 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:39.544615 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.544512 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:39.547976 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:39.545582 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:39.566279 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.566236 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8t6j6" event={"ID":"863b0c81-feec-4346-a9e4-9f0e4ea4723c","Type":"ContainerStarted","Data":"3941de3596624d3f58dd9609f92eb0620d7777193d044a9167dc11a454bc956f"} Jul 01 18:27:39.572274 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.572243 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lsgd6" event={"ID":"74dd95b0-3118-4585-82a2-d7aadcbcb385","Type":"ContainerStarted","Data":"2e2139b3cab7213e124f8b246f851bf099cb26a9c08f6659c083103e47c5ba83"} Jul 01 18:27:39.580294 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.580218 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" event={"ID":"2b870091-3050-4767-9b6a-d15179f26464","Type":"ContainerStarted","Data":"e2c0622d5a8bd2dbbc356748b2b19c71051f6a4141241aa6711c9054025b887b"} Jul 01 18:27:39.587846 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.586865 2574 generic.go:356] "Generic (PLEG): container finished" podID="8a73242044ffea168987df30a87a9f27" containerID="a6294ae57689cafc656d01bab70a85d2aaea250698a6d07c1a6c67f75574020f" exitCode=0 Jul 01 18:27:39.587846 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.586948 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" event={"ID":"8a73242044ffea168987df30a87a9f27","Type":"ContainerDied","Data":"a6294ae57689cafc656d01bab70a85d2aaea250698a6d07c1a6c67f75574020f"} Jul 01 18:27:39.597075 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.596972 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" event={"ID":"689ab513-7820-47b3-87ee-e760d7b98ee3","Type":"ContainerStarted","Data":"53ffdfacb59fd221b64922f50b4ba8b18acbb3a789160573ac872e902d8c4f52"} Jul 01 18:27:39.618050 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.618008 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6k2jg" event={"ID":"28784f12-79d9-4954-b1e3-522fea8dbdcf","Type":"ContainerStarted","Data":"97a98ce0f8d8cbbc0879ec82f5cb9bb9aee141ddab5bfe56b97e171fd84cd799"} Jul 01 18:27:39.637853 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.634755 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4cptw" event={"ID":"bdadd096-1f5c-4d29-88ae-2901deac0104","Type":"ContainerStarted","Data":"f2cc98f03969fcbcea0d55bb168ba8fc51299ffc0a42e2d7bdbee7234da61932"} Jul 01 18:27:39.653965 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.653830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"9146f42cdebf3919cb0668c9078f5167437a4006091b173202860f1e2386c9b8"} Jul 01 18:27:39.657923 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.657837 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm47g" event={"ID":"fd1d5d37-fb35-48f2-a5b4-e220af3d348f","Type":"ContainerStarted","Data":"8ddc04f138b6d9456d877d9f3d06522c4be62358f89689002ca1244eec9bb198"} Jul 01 18:27:39.680851 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.680799 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" event={"ID":"00432cb5944b7b354bb07d8bbaf4574d","Type":"ContainerStarted","Data":"4efd1f5b23015598a5dd0e549c36708dbbfbe2fbbef74214d022e40ba21e3862"} Jul 01 18:27:39.699133 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.699059 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jvljf" event={"ID":"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf","Type":"ContainerStarted","Data":"3c419d641420ab480b4b87d5363556a2415ca6829fd6030c8fc0a4bb35c25cbe"} Jul 01 18:27:39.714208 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:39.714042 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-190.ec2.internal" podStartSLOduration=3.714019557 podStartE2EDuration="3.714019557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:39.712441898 +0000 UTC m=+4.647213703" watchObservedRunningTime="2026-07-01 18:27:39.714019557 +0000 UTC m=+4.648791363" Jul 01 18:27:40.734133 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:40.734092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" event={"ID":"8a73242044ffea168987df30a87a9f27","Type":"ContainerStarted","Data":"3733fdfedf1e0f8efb94dd42d3cb9e1f360861fc076fc802185cdd3062be9395"} Jul 01 18:27:41.119495 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:41.119214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:41.119495 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.119368 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:41.119495 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.119437 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs podName:021c38e9-03d2-4dbc-bc8a-064de7a0c62f nodeName:}" failed. No retries permitted until 2026-07-01 18:27:45.119418014 +0000 UTC m=+10.054189811 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs") pod "network-metrics-daemon-947sf" (UID: "021c38e9-03d2-4dbc-bc8a-064de7a0c62f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:41.221182 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:41.220407 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:41.221182 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:41.220457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:41.221182 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.220598 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:41.221182 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.220661 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret podName:16343865-65ff-4e09-a37f-d7ba4939141a nodeName:}" failed. No retries permitted until 2026-07-01 18:27:45.220643667 +0000 UTC m=+10.155415453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret") pod "global-pull-secret-syncer-sjcfw" (UID: "16343865-65ff-4e09-a37f-d7ba4939141a") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:41.221182 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.220743 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:41.221182 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.220760 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:41.221182 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.220772 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hl8dv for pod openshift-network-diagnostics/network-check-target-qjf7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:41.221182 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.220825 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv podName:3c157c07-028f-4f99-9c22-5ddecf22d171 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:45.220812781 +0000 UTC m=+10.155584576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl8dv" (UniqueName: "kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv") pod "network-check-target-qjf7l" (UID: "3c157c07-028f-4f99-9c22-5ddecf22d171") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:41.546046 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:41.545964 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:41.546046 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:41.545996 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:41.546273 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.546099 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:41.546569 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.546511 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:41.546645 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:41.546582 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:41.546696 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:41.546666 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:43.540004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:43.539972 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:43.540460 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:43.540114 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:43.540460 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:43.540399 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:43.540568 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:43.540480 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:43.540568 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:43.540540 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:43.540679 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:43.540604 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:45.152707 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:45.152660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:45.153179 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.152858 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:45.153179 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.152946 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs podName:021c38e9-03d2-4dbc-bc8a-064de7a0c62f nodeName:}" failed. No retries permitted until 2026-07-01 18:27:53.152923217 +0000 UTC m=+18.087695012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs") pod "network-metrics-daemon-947sf" (UID: "021c38e9-03d2-4dbc-bc8a-064de7a0c62f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:45.253818 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:45.253768 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:45.254019 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:45.253900 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:45.254086 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.254039 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:45.254086 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.254058 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:45.254086 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.254072 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hl8dv for pod openshift-network-diagnostics/network-check-target-qjf7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:45.254211 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.254134 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv podName:3c157c07-028f-4f99-9c22-5ddecf22d171 nodeName:}" failed. No retries permitted until 2026-07-01 18:27:53.254114434 +0000 UTC m=+18.188886231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl8dv" (UniqueName: "kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv") pod "network-check-target-qjf7l" (UID: "3c157c07-028f-4f99-9c22-5ddecf22d171") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:45.254626 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.254542 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:45.254626 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.254597 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret podName:16343865-65ff-4e09-a37f-d7ba4939141a nodeName:}" failed. No retries permitted until 2026-07-01 18:27:53.25458217 +0000 UTC m=+18.189353967 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret") pod "global-pull-secret-syncer-sjcfw" (UID: "16343865-65ff-4e09-a37f-d7ba4939141a") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:45.539673 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:45.539568 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:45.539857 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.539716 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:45.540305 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:45.540285 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:45.540520 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.540434 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:45.540520 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:45.540502 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:45.540672 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:45.540637 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:47.539854 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:47.539774 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:47.539854 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:47.539827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:47.540389 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:47.539907 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:47.540389 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:47.539774 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:47.540389 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:47.540048 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:47.540389 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:47.540131 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:49.536406 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:49.536312 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:49.536866 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:49.536315 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:49.537729 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:49.536328 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:49.537890 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:49.537861 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:49.538405 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:49.538372 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:49.538501 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:49.538474 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:51.539272 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:51.539243 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:51.539272 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:51.539270 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:51.539849 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:51.539270 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:51.539849 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:51.539364 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:51.539849 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:51.539457 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:51.539849 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:51.539539 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:53.216676 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:53.216632 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:53.217145 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.216800 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:53.217145 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.216869 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs podName:021c38e9-03d2-4dbc-bc8a-064de7a0c62f nodeName:}" failed. No retries permitted until 2026-07-01 18:28:09.216850916 +0000 UTC m=+34.151622725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs") pod "network-metrics-daemon-947sf" (UID: "021c38e9-03d2-4dbc-bc8a-064de7a0c62f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:27:53.317348 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:53.317253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:53.317348 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:53.317313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:53.317592 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.317452 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:27:53.317592 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.317469 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:53.317592 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.317479 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:27:53.317592 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.317493 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hl8dv for pod openshift-network-diagnostics/network-check-target-qjf7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:53.317592 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.317541 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret podName:16343865-65ff-4e09-a37f-d7ba4939141a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:09.317520475 +0000 UTC m=+34.252292280 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret") pod "global-pull-secret-syncer-sjcfw" (UID: "16343865-65ff-4e09-a37f-d7ba4939141a") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:27:53.317592 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.317556 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv podName:3c157c07-028f-4f99-9c22-5ddecf22d171 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:09.317550232 +0000 UTC m=+34.252322013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl8dv" (UniqueName: "kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv") pod "network-check-target-qjf7l" (UID: "3c157c07-028f-4f99-9c22-5ddecf22d171") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:27:53.538629 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:53.538597 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:53.538837 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:53.538639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:53.538837 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:53.538639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:53.538837 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.538722 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:53.538837 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.538824 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:53.539048 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:53.538907 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:55.536288 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:55.536250 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:55.536755 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:55.536359 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:55.536755 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:55.536375 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:55.536755 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:55.536473 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:55.536755 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:55.536532 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:55.536755 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:55.536601 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:57.536116 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:57.536081 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:57.536116 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:57.536107 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:57.536554 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:57.536081 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:57.536554 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:57.536205 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:57.536554 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:57.536259 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:57.536554 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:57.536321 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:58.795631 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.795252 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" event={"ID":"689ab513-7820-47b3-87ee-e760d7b98ee3","Type":"ContainerStarted","Data":"9007091d5a06a3b085bbe25eb2626f430019f063983f46cf456a2f9c3c5296e8"} Jul 01 18:27:58.796648 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.796615 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-6k2jg" event={"ID":"28784f12-79d9-4954-b1e3-522fea8dbdcf","Type":"ContainerStarted","Data":"89519f084a7d29921278fda4494a6ae4035e50c4af67951dff27aa9d6c9c768d"} Jul 01 18:27:58.798064 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.798043 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4cptw" event={"ID":"bdadd096-1f5c-4d29-88ae-2901deac0104","Type":"ContainerStarted","Data":"0bc704c459cb751ef9b4a5bd000ee053ad782b699af8538e067c95cde4ba78ae"} Jul 01 18:27:58.800988 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.800968 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"32ae460c9970dae13cf1375ac926bab4d81f29b1b9f2dd8016508a8447049951"} Jul 01 18:27:58.801085 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.801030 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"c3e00bf27b1361377f8c9d15ded9efcaf4b676f3f7850ceac6916805c0c2d49e"} Jul 01 18:27:58.801085 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.801059 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"4ba1e19980d17c52c009780303b9d3d9257effba729fd29ce6a21b9c085ee052"} Jul 01 18:27:58.801152 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.801104 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"e99540b527c3abd5b2a3fed2278c4fe45cfc30e2451fbe73a18db60cf9be1fb1"} Jul 01 18:27:58.801152 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.801133 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"2de266cb1ee2e04bae7f696d04403e2d449cf03de982ba2715009550cd407b11"} Jul 01 18:27:58.801211 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.801159 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"b5d358c318243d686a9bce64d7386abf91d52f4a823273c261ba362775231f79"} Jul 01 18:27:58.802379 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.802357 2574 generic.go:356] "Generic (PLEG): container finished" podID="fd1d5d37-fb35-48f2-a5b4-e220af3d348f" containerID="0d3245fea1f2c0ec0d30d4281213415657df49e0d3aa079b00b924b037604788" exitCode=0 Jul 01 18:27:58.802465 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.802426 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm47g" event={"ID":"fd1d5d37-fb35-48f2-a5b4-e220af3d348f","Type":"ContainerDied","Data":"0d3245fea1f2c0ec0d30d4281213415657df49e0d3aa079b00b924b037604788"} Jul 01 18:27:58.803950 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.803774 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jvljf" event={"ID":"b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf","Type":"ContainerStarted","Data":"cb71c3e230fbc22f6f34075b00842425d12d4f3d18296dcbb697d373b0b5841d"} Jul 01 18:27:58.805284 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.805250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lsgd6" event={"ID":"74dd95b0-3118-4585-82a2-d7aadcbcb385","Type":"ContainerStarted","Data":"f6bde613d5c8cc73d457cb5726b6178b1e6e67f12baa693482e9848c6c0e4d88"} Jul 01 18:27:58.806526 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.806506 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" event={"ID":"2b870091-3050-4767-9b6a-d15179f26464","Type":"ContainerStarted","Data":"3033d96dcfee34456186edf6ae0a570f7a02ce82be2a6e25532195f55d9029ef"} Jul 01 18:27:58.811211 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.811172 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-190.ec2.internal" podStartSLOduration=22.811160454 podStartE2EDuration="22.811160454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:40.756723457 +0000 UTC m=+5.691495265" watchObservedRunningTime="2026-07-01 18:27:58.811160454 +0000 UTC m=+23.745932258" Jul 01 18:27:58.811652 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.811622 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-6k2jg" podStartSLOduration=9.46192726 podStartE2EDuration="23.811614503s" totalImagesPullingTime="14.349687243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:58.8110218 +0000 UTC m=+23.745793605" watchObservedRunningTime="2026-07-01 18:27:58.811614503 +0000 UTC m=+23.746386307" Jul 01 18:27:58.828248 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.828199 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lsgd6" podStartSLOduration=4.83347232 podStartE2EDuration="23.828185419s" totalImagesPullingTime="18.994713099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:58.827858327 +0000 UTC m=+23.762630130" watchObservedRunningTime="2026-07-01 18:27:58.828185419 +0000 UTC m=+23.762957223" Jul 01 18:27:58.845329 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.845279 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9nl4h" podStartSLOduration=4.841289263 podStartE2EDuration="23.845265012s" totalImagesPullingTime="19.003975749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:58.8448142 +0000 UTC m=+23.779586001" watchObservedRunningTime="2026-07-01 18:27:58.845265012 +0000 UTC m=+23.780036855" Jul 01 18:27:58.887410 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.887354 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4cptw" podStartSLOduration=4.896793159 podStartE2EDuration="23.887337132s" totalImagesPullingTime="18.990543973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:58.887302212 +0000 UTC m=+23.822074027" watchObservedRunningTime="2026-07-01 18:27:58.887337132 +0000 UTC m=+23.822108935" Jul 01 18:27:58.905806 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:58.905736 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jvljf" podStartSLOduration=4.901287133 podStartE2EDuration="23.905720743s" totalImagesPullingTime="19.00443361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:58.905682564 +0000 UTC m=+23.840454367" watchObservedRunningTime="2026-07-01 18:27:58.905720743 +0000 UTC m=+23.840492547" Jul 01 18:27:59.051534 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.051444 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:27:59.092499 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.092470 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 01 18:27:59.132105 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.132077 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:27:59.232361 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.232328 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:27:59.536169 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.536133 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:27:59.536169 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.536154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:27:59.536169 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.536154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:27:59.536561 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:59.536263 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:27:59.536561 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:59.536370 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:27:59.536561 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:27:59.536493 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:27:59.547391 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.547303 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-01T18:27:59.092493568Z","UUID":"faa5d510-7d9f-4705-8450-2218e12ae781","Handler":null,"Name":"","Endpoint":""} Jul 01 18:27:59.549087 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.549060 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 01 18:27:59.549213 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.549103 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 01 18:27:59.811105 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.810981 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8t6j6" event={"ID":"863b0c81-feec-4346-a9e4-9f0e4ea4723c","Type":"ContainerStarted","Data":"76a92b97d15de61c2656153f76feb045fa44c1c89bb7056be618aa502b1f568b"} Jul 01 18:27:59.813579 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.813545 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" event={"ID":"689ab513-7820-47b3-87ee-e760d7b98ee3","Type":"ContainerStarted","Data":"21f6001c937a38874e357fa022c8b1dfee8e6fcd6e05d72f5a81e86932c2f7eb"} Jul 01 18:27:59.825031 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.824975 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8t6j6" podStartSLOduration=5.830956588 podStartE2EDuration="24.824957345s" totalImagesPullingTime="18.994000757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:27:59.824853731 +0000 UTC m=+24.759625538" watchObservedRunningTime="2026-07-01 18:27:59.824957345 +0000 UTC m=+24.759729143" Jul 01 18:27:59.845423 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.845378 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:59.846288 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.846267 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:27:59.979796 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:27:59.979740 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:00.060349 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:00.060312 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:00.818240 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:00.818199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" event={"ID":"689ab513-7820-47b3-87ee-e760d7b98ee3","Type":"ContainerStarted","Data":"933d96f930a26d6a0bdcffe81174cbca3cee392f3302feb0779a1dee4265008c"} Jul 01 18:28:00.822306 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:00.822278 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"7eb7dac96dc3f98ee648ce6d548b0930124236f6dedcec8a0a227471a289e78a"} Jul 01 18:28:00.835757 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:00.835695 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cm7cb" podStartSLOduration=4.564836989 podStartE2EDuration="25.835677641s" totalImagesPullingTime="21.270840652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:00.834914081 +0000 UTC m=+25.769685886" watchObservedRunningTime="2026-07-01 18:28:00.835677641 +0000 UTC m=+25.770449473" Jul 01 18:28:01.536524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:01.536490 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:01.536729 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:01.536490 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:01.536729 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:01.536620 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:28:01.536729 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:01.536646 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:01.536934 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:01.536760 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:28:01.536934 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:01.536854 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:28:01.824668 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:01.824392 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 18:28:02.111104 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:02.111031 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:02.182120 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:02.182083 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:02.637699 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:02.637657 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:02.698990 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:02.698954 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:02.801528 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:02.801500 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:02.894887 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:02.894853 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:03.536109 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.535939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:03.536281 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.535950 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:03.536281 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:03.536193 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:28:03.536281 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.535982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:03.536409 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:03.536281 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:28:03.536409 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:03.536369 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:28:03.737587 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.737503 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:03.831031 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.831004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:03.833833 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.833797 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" event={"ID":"fbdf134e-15ee-45d8-9d57-55334829cb6a","Type":"ContainerStarted","Data":"ab8e1db5497df1ffb19d64254a5d32e5fbeca336273c8f2712c86290dda7a11b"} Jul 01 18:28:03.833998 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.833957 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:28:03.834060 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.834010 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:28:03.835625 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.835602 2574 generic.go:356] "Generic (PLEG): container finished" podID="fd1d5d37-fb35-48f2-a5b4-e220af3d348f" containerID="3d8acd2e317220d158e383d51dd9fd115d7fc606cf1bcfc2538ea3ed887c8202" exitCode=0 Jul 01 18:28:03.835735 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.835647 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm47g" event={"ID":"fd1d5d37-fb35-48f2-a5b4-e220af3d348f","Type":"ContainerDied","Data":"3d8acd2e317220d158e383d51dd9fd115d7fc606cf1bcfc2538ea3ed887c8202"} Jul 01 18:28:03.849657 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.849632 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:28:03.860372 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:03.860318 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" podStartSLOduration=9.757376116 podStartE2EDuration="28.860299794s" totalImagesPullingTime="19.102923678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:03.859947658 +0000 UTC m=+28.794719465" watchObservedRunningTime="2026-07-01 18:28:03.860299794 +0000 UTC m=+28.795071600" Jul 01 18:28:04.041743 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:04.041658 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:04.115027 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:04.114999 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:04.409199 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:04.409169 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:04.480124 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:04.480045 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:04.838912 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:04.838885 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:28:04.854873 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:04.854850 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:28:05.066554 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.066514 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qjf7l"] Jul 01 18:28:05.067018 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.066620 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-947sf"] Jul 01 18:28:05.067018 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.066740 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:05.067018 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:05.066909 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:28:05.067397 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.067370 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:05.067521 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:05.067502 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:28:05.068804 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.068763 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sjcfw"] Jul 01 18:28:05.068920 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.068893 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:05.069016 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:05.068991 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:28:05.666295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.666262 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:05.842757 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.842716 2574 generic.go:356] "Generic (PLEG): container finished" podID="fd1d5d37-fb35-48f2-a5b4-e220af3d348f" containerID="7ae71fef1977ccdd6295d6e1e027470cfcc27195a16c6117aba020d1a2d32d8c" exitCode=0 Jul 01 18:28:05.842938 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:05.842812 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm47g" event={"ID":"fd1d5d37-fb35-48f2-a5b4-e220af3d348f","Type":"ContainerDied","Data":"7ae71fef1977ccdd6295d6e1e027470cfcc27195a16c6117aba020d1a2d32d8c"} Jul 01 18:28:06.536433 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:06.536392 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:06.536916 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:06.536448 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:06.536916 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:06.536471 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:06.536916 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:06.536580 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:28:06.536916 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:06.536721 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:28:06.536916 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:06.536826 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:28:06.700980 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:06.700944 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:28:06.701142 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:06.701080 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 01 18:28:06.701545 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:06.701532 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4cptw" Jul 01 18:28:06.775564 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:06.775515 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:07.850136 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:07.850101 2574 generic.go:356] "Generic (PLEG): container finished" podID="fd1d5d37-fb35-48f2-a5b4-e220af3d348f" containerID="bc288db73b177bfb2dd730e6c05931caf2cd46cdd07ba1f5d6e1e44b3957dccd" exitCode=0 Jul 01 18:28:07.850555 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:07.850145 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm47g" event={"ID":"fd1d5d37-fb35-48f2-a5b4-e220af3d348f","Type":"ContainerDied","Data":"bc288db73b177bfb2dd730e6c05931caf2cd46cdd07ba1f5d6e1e44b3957dccd"} Jul 01 18:28:08.535921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:08.535889 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:08.535921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:08.535905 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:08.535921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:08.535926 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:08.536146 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:08.536000 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:28:08.536146 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:08.536035 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:28:08.536146 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:08.536128 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:28:08.714361 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:08.714324 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:08.794324 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:08.794202 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:09.235657 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:09.235614 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:09.236154 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:09.235819 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:28:09.236154 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:09.235902 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs podName:021c38e9-03d2-4dbc-bc8a-064de7a0c62f nodeName:}" failed. No retries permitted until 2026-07-01 18:28:41.235880092 +0000 UTC m=+66.170651892 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs") pod "network-metrics-daemon-947sf" (UID: "021c38e9-03d2-4dbc-bc8a-064de7a0c62f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 01 18:28:09.336602 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:09.336567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:09.336602 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:09.336605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:09.336862 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:09.336731 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 01 18:28:09.336862 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:09.336746 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 01 18:28:09.336862 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:09.336772 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 01 18:28:09.336862 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:09.336801 2574 projected.go:196] Error preparing data for projected volume kube-api-access-hl8dv for pod openshift-network-diagnostics/network-check-target-qjf7l: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:28:09.336862 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:09.336815 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret podName:16343865-65ff-4e09-a37f-d7ba4939141a nodeName:}" failed. No retries permitted until 2026-07-01 18:28:41.336774709 +0000 UTC m=+66.271546509 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret") pod "global-pull-secret-syncer-sjcfw" (UID: "16343865-65ff-4e09-a37f-d7ba4939141a") : object "kube-system"/"original-pull-secret" not registered Jul 01 18:28:09.336862 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:09.336851 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv podName:3c157c07-028f-4f99-9c22-5ddecf22d171 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:41.336834802 +0000 UTC m=+66.271606598 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hl8dv" (UniqueName: "kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv") pod "network-check-target-qjf7l" (UID: "3c157c07-028f-4f99-9c22-5ddecf22d171") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 01 18:28:10.536002 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:10.535967 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:10.536483 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:10.536015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:10.536483 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:10.535988 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:10.536483 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:10.536091 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-947sf" podUID="021c38e9-03d2-4dbc-bc8a-064de7a0c62f" Jul 01 18:28:10.536483 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:10.536170 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjcfw" podUID="16343865-65ff-4e09-a37f-d7ba4939141a" Jul 01 18:28:10.536483 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:10.536237 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qjf7l" podUID="3c157c07-028f-4f99-9c22-5ddecf22d171" Jul 01 18:28:11.278429 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.278401 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-190.ec2.internal" event="NodeReady" Jul 01 18:28:11.278594 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.278546 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 01 18:28:11.324893 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.324824 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-28kk8"] Jul 01 18:28:11.327689 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.327652 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.328114 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.328090 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gw696"] Jul 01 18:28:11.329509 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.329485 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 01 18:28:11.329611 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.329492 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 01 18:28:11.329611 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.329590 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5x58v\"" Jul 01 18:28:11.329931 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.329910 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gw696" Jul 01 18:28:11.332031 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.332006 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 01 18:28:11.332156 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.332031 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hxnf9\"" Jul 01 18:28:11.332156 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.332045 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 01 18:28:11.332156 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.332104 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 01 18:28:11.340293 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.340267 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-28kk8"] Jul 01 18:28:11.342920 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.342758 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gw696"] Jul 01 18:28:11.454442 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.454357 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.454616 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.454493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-config-volume\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.454616 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.454523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08936d22-2399-47bc-a800-6c1e6fa98ce6-cert\") pod \"ingress-canary-gw696\" (UID: \"08936d22-2399-47bc-a800-6c1e6fa98ce6\") " pod="openshift-ingress-canary/ingress-canary-gw696" Jul 01 18:28:11.454616 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.454556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-tmp-dir\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.454777 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.454630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l65bt\" (UniqueName: \"kubernetes.io/projected/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-kube-api-access-l65bt\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.454777 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.454682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqrx6\" (UniqueName: \"kubernetes.io/projected/08936d22-2399-47bc-a800-6c1e6fa98ce6-kube-api-access-tqrx6\") pod \"ingress-canary-gw696\" (UID: \"08936d22-2399-47bc-a800-6c1e6fa98ce6\") " pod="openshift-ingress-canary/ingress-canary-gw696" Jul 01 18:28:11.510676 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.510635 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:11.555672 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.555638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.556295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.555803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-config-volume\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.556295 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:11.555815 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:11.556295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.555841 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08936d22-2399-47bc-a800-6c1e6fa98ce6-cert\") pod \"ingress-canary-gw696\" (UID: \"08936d22-2399-47bc-a800-6c1e6fa98ce6\") " pod="openshift-ingress-canary/ingress-canary-gw696" Jul 01 18:28:11.556295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.555868 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-tmp-dir\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.556295 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:11.555899 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls podName:bb083a92-6ac3-4fd6-8063-f10fa13a0bbc nodeName:}" failed. No retries permitted until 2026-07-01 18:28:12.055876051 +0000 UTC m=+36.990647846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls") pod "dns-default-28kk8" (UID: "bb083a92-6ac3-4fd6-8063-f10fa13a0bbc") : secret "dns-default-metrics-tls" not found Jul 01 18:28:11.556295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.555942 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l65bt\" (UniqueName: \"kubernetes.io/projected/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-kube-api-access-l65bt\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.556295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.555975 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqrx6\" (UniqueName: \"kubernetes.io/projected/08936d22-2399-47bc-a800-6c1e6fa98ce6-kube-api-access-tqrx6\") pod \"ingress-canary-gw696\" (UID: \"08936d22-2399-47bc-a800-6c1e6fa98ce6\") " pod="openshift-ingress-canary/ingress-canary-gw696" Jul 01 18:28:11.556295 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.556190 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-tmp-dir\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.556656 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.556439 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-config-volume\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.560605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.560585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/08936d22-2399-47bc-a800-6c1e6fa98ce6-cert\") pod \"ingress-canary-gw696\" (UID: \"08936d22-2399-47bc-a800-6c1e6fa98ce6\") " pod="openshift-ingress-canary/ingress-canary-gw696" Jul 01 18:28:11.565831 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.565807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l65bt\" (UniqueName: \"kubernetes.io/projected/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-kube-api-access-l65bt\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:11.565993 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.565972 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqrx6\" (UniqueName: \"kubernetes.io/projected/08936d22-2399-47bc-a800-6c1e6fa98ce6-kube-api-access-tqrx6\") pod \"ingress-canary-gw696\" (UID: \"08936d22-2399-47bc-a800-6c1e6fa98ce6\") " pod="openshift-ingress-canary/ingress-canary-gw696" Jul 01 18:28:11.612662 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.612614 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:11.648537 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:11.648500 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gw696" Jul 01 18:28:12.060833 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.060595 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:12.060995 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:12.060776 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:12.060995 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:12.060952 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls podName:bb083a92-6ac3-4fd6-8063-f10fa13a0bbc nodeName:}" failed. No retries permitted until 2026-07-01 18:28:13.060929821 +0000 UTC m=+37.995701606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls") pod "dns-default-28kk8" (UID: "bb083a92-6ac3-4fd6-8063-f10fa13a0bbc") : secret "dns-default-metrics-tls" not found Jul 01 18:28:12.145880 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.145850 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gw696"] Jul 01 18:28:12.149548 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:12.149517 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08936d22_2399_47bc_a800_6c1e6fa98ce6.slice/crio-14ae628291c93743424b54d420d84930605cfdb140861efde439e668d9061cd8 WatchSource:0}: Error finding container 14ae628291c93743424b54d420d84930605cfdb140861efde439e668d9061cd8: Status 404 returned error can't find the container with id 14ae628291c93743424b54d420d84930605cfdb140861efde439e668d9061cd8 Jul 01 18:28:12.535990 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.535895 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:12.536147 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.536007 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:12.536147 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.536038 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:12.538340 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.538308 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:28:12.538912 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.538894 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tjgt\"" Jul 01 18:28:12.539012 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.538894 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:28:12.539012 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.538895 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:28:12.539130 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.539032 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l88pn\"" Jul 01 18:28:12.539206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.539193 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:28:12.649102 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.649066 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:12.750901 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.750854 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:12.866072 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.865988 2574 generic.go:356] "Generic (PLEG): container finished" podID="fd1d5d37-fb35-48f2-a5b4-e220af3d348f" containerID="8c1be45c7d0c81d3d191516ce73151c73c64960ba040b725154310dd22218ded" exitCode=0 Jul 01 18:28:12.866072 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.866043 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm47g" event={"ID":"fd1d5d37-fb35-48f2-a5b4-e220af3d348f","Type":"ContainerDied","Data":"8c1be45c7d0c81d3d191516ce73151c73c64960ba040b725154310dd22218ded"} Jul 01 18:28:12.867462 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:12.867434 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gw696" event={"ID":"08936d22-2399-47bc-a800-6c1e6fa98ce6","Type":"ContainerStarted","Data":"14ae628291c93743424b54d420d84930605cfdb140861efde439e668d9061cd8"} Jul 01 18:28:13.068897 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:13.068858 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:13.069081 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:13.069026 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:13.069150 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:13.069112 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls podName:bb083a92-6ac3-4fd6-8063-f10fa13a0bbc nodeName:}" failed. No retries permitted until 2026-07-01 18:28:15.069083874 +0000 UTC m=+40.003855670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls") pod "dns-default-28kk8" (UID: "bb083a92-6ac3-4fd6-8063-f10fa13a0bbc") : secret "dns-default-metrics-tls" not found Jul 01 18:28:13.874882 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:13.874844 2574 generic.go:356] "Generic (PLEG): container finished" podID="fd1d5d37-fb35-48f2-a5b4-e220af3d348f" containerID="a6ec087d1b2e2bc0865e042cb57083980ef931de7f18180028dec1baf0b12197" exitCode=0 Jul 01 18:28:13.875424 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:13.874900 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm47g" event={"ID":"fd1d5d37-fb35-48f2-a5b4-e220af3d348f","Type":"ContainerDied","Data":"a6ec087d1b2e2bc0865e042cb57083980ef931de7f18180028dec1baf0b12197"} Jul 01 18:28:14.089611 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.089560 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-df6bh"] Jul 01 18:28:14.104071 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.104023 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-df6bh"] Jul 01 18:28:14.104219 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.104163 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.106349 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.106322 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 01 18:28:14.106479 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.106372 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 01 18:28:14.106479 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.106331 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 01 18:28:14.106602 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.106478 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 01 18:28:14.106657 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.106619 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ngz2\"" Jul 01 18:28:14.125859 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.125572 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:14.176906 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.176656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.176906 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.176707 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3da6963d-9a99-44f9-ae2b-0803806be5c9-crio-socket\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.176906 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.176753 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.176906 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.176809 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3da6963d-9a99-44f9-ae2b-0803806be5c9-data-volume\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.176906 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.176896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx6bh\" (UniqueName: \"kubernetes.io/projected/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-api-access-dx6bh\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.193003 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.192969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:14.278079 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.278039 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.278250 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.278097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3da6963d-9a99-44f9-ae2b-0803806be5c9-data-volume\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.278250 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.278146 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx6bh\" (UniqueName: \"kubernetes.io/projected/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-api-access-dx6bh\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.278250 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:14.278171 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:28:14.278250 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.278200 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.278250 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.278224 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3da6963d-9a99-44f9-ae2b-0803806be5c9-crio-socket\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.278483 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:14.278258 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm podName:3da6963d-9a99-44f9-ae2b-0803806be5c9 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:14.778235852 +0000 UTC m=+39.713007653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-df6bh" (UID: "3da6963d-9a99-44f9-ae2b-0803806be5c9") : configmap "kube-rbac-proxy" not found Jul 01 18:28:14.278483 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:14.278381 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.278483 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.278435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3da6963d-9a99-44f9-ae2b-0803806be5c9-crio-socket\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.278483 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:14.278445 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls podName:3da6963d-9a99-44f9-ae2b-0803806be5c9 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:14.778425805 +0000 UTC m=+39.713197604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-df6bh" (UID: "3da6963d-9a99-44f9-ae2b-0803806be5c9") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.278819 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.278779 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3da6963d-9a99-44f9-ae2b-0803806be5c9-data-volume\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.288846 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.288817 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx6bh\" (UniqueName: \"kubernetes.io/projected/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-api-access-dx6bh\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.506546 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.506464 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:14.607697 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.607665 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:14.782708 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.782619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.782708 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.782687 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:14.782945 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:14.782810 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.782945 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:14.782819 2574 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 01 18:28:14.782945 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:14.782885 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm podName:3da6963d-9a99-44f9-ae2b-0803806be5c9 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:15.78286531 +0000 UTC m=+40.717637112 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-df6bh" (UID: "3da6963d-9a99-44f9-ae2b-0803806be5c9") : configmap "kube-rbac-proxy" not found Jul 01 18:28:14.782945 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:14.782905 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls podName:3da6963d-9a99-44f9-ae2b-0803806be5c9 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:15.782896102 +0000 UTC m=+40.717667886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-df6bh" (UID: "3da6963d-9a99-44f9-ae2b-0803806be5c9") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:14.881339 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.881299 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lm47g" event={"ID":"fd1d5d37-fb35-48f2-a5b4-e220af3d348f","Type":"ContainerStarted","Data":"9d18803f38a095544eed38e92133bd129effbaf6a6e70f0d39550e06d7af8a26"} Jul 01 18:28:14.905122 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:14.905068 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lm47g" podStartSLOduration=10.195505208 podStartE2EDuration="39.9050495s" totalImagesPullingTime="29.709544292s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:14.904750362 +0000 UTC m=+39.839522165" watchObservedRunningTime="2026-07-01 18:28:14.9050495 +0000 UTC m=+39.839821305" Jul 01 18:28:15.027108 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.027063 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:15.085494 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.085455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:15.085714 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:15.085630 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:15.085714 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:15.085705 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls podName:bb083a92-6ac3-4fd6-8063-f10fa13a0bbc nodeName:}" failed. No retries permitted until 2026-07-01 18:28:19.085685184 +0000 UTC m=+44.020456972 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls") pod "dns-default-28kk8" (UID: "bb083a92-6ac3-4fd6-8063-f10fa13a0bbc") : secret "dns-default-metrics-tls" not found Jul 01 18:28:15.128245 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.128210 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:15.227862 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.227823 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:15.681452 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.681427 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lsgd6_74dd95b0-3118-4585-82a2-d7aadcbcb385/dns-node-resolver/0.log" Jul 01 18:28:15.788945 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.788909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:15.789062 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.789003 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:15.789103 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:15.789093 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:15.789156 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:15.789148 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls podName:3da6963d-9a99-44f9-ae2b-0803806be5c9 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:17.789134502 +0000 UTC m=+42.723906285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-df6bh" (UID: "3da6963d-9a99-44f9-ae2b-0803806be5c9") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:15.789472 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.789452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3da6963d-9a99-44f9-ae2b-0803806be5c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:15.885534 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.885501 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gw696" event={"ID":"08936d22-2399-47bc-a800-6c1e6fa98ce6","Type":"ContainerStarted","Data":"48ac3959c599c3c1d791c42f592b14f966219807a194d77a0fa133f141bf3cce"} Jul 01 18:28:15.902341 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:15.902285 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gw696" podStartSLOduration=2.053478771 podStartE2EDuration="4.902265107s" totalImagesPullingTime="2.848786336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:15.902098807 +0000 UTC m=+40.836870611" watchObservedRunningTime="2026-07-01 18:28:15.902265107 +0000 UTC m=+40.837036911" Jul 01 18:28:16.281931 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.281856 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6k2jg_28784f12-79d9-4954-b1e3-522fea8dbdcf/node-ca/0.log" Jul 01 18:28:16.363510 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.363479 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5"] Jul 01 18:28:16.383127 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.383094 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5"] Jul 01 18:28:16.383274 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.383218 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.385258 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.385235 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 01 18:28:16.385381 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.385237 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:28:16.385687 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.385671 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 01 18:28:16.385803 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.385700 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-7w6lp\"" Jul 01 18:28:16.385803 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.385677 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 01 18:28:16.494521 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.494484 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d04f933-046b-45d7-a12c-408192ea11d4-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.494521 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.494520 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwc8m\" (UniqueName: \"kubernetes.io/projected/9d04f933-046b-45d7-a12c-408192ea11d4-kube-api-access-nwc8m\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.494735 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.494544 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d04f933-046b-45d7-a12c-408192ea11d4-config\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.595462 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.595351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d04f933-046b-45d7-a12c-408192ea11d4-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.595462 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.595394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwc8m\" (UniqueName: \"kubernetes.io/projected/9d04f933-046b-45d7-a12c-408192ea11d4-kube-api-access-nwc8m\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.595462 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.595445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d04f933-046b-45d7-a12c-408192ea11d4-config\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.596078 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.596052 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9d04f933-046b-45d7-a12c-408192ea11d4-config\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.597696 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.597677 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d04f933-046b-45d7-a12c-408192ea11d4-serving-cert\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.604470 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.604444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwc8m\" (UniqueName: \"kubernetes.io/projected/9d04f933-046b-45d7-a12c-408192ea11d4-kube-api-access-nwc8m\") pod \"service-ca-operator-5d7b7dc95c-fkbr5\" (UID: \"9d04f933-046b-45d7-a12c-408192ea11d4\") " pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.691992 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.691956 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" Jul 01 18:28:16.836691 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.836655 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5"] Jul 01 18:28:16.839354 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:16.839319 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d04f933_046b_45d7_a12c_408192ea11d4.slice/crio-3b8326b5b76e3cc713b1cb47930ca4877a2befb09c470a7b2eb786184241c422 WatchSource:0}: Error finding container 3b8326b5b76e3cc713b1cb47930ca4877a2befb09c470a7b2eb786184241c422: Status 404 returned error can't find the container with id 3b8326b5b76e3cc713b1cb47930ca4877a2befb09c470a7b2eb786184241c422 Jul 01 18:28:16.889713 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:16.889678 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" event={"ID":"9d04f933-046b-45d7-a12c-408192ea11d4","Type":"ContainerStarted","Data":"3b8326b5b76e3cc713b1cb47930ca4877a2befb09c470a7b2eb786184241c422"} Jul 01 18:28:17.190749 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:17.190669 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:17.282033 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:17.282006 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gw696_08936d22-2399-47bc-a800-6c1e6fa98ce6/serve-healthcheck-canary/0.log" Jul 01 18:28:17.299287 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:17.299257 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:17.804270 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:17.804227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:17.804437 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:17.804358 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:17.804437 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:17.804415 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls podName:3da6963d-9a99-44f9-ae2b-0803806be5c9 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:21.804400736 +0000 UTC m=+46.739172532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-df6bh" (UID: "3da6963d-9a99-44f9-ae2b-0803806be5c9") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:19.115169 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:19.115123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:19.115539 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:19.115279 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:19.115539 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:19.115344 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls podName:bb083a92-6ac3-4fd6-8063-f10fa13a0bbc nodeName:}" failed. No retries permitted until 2026-07-01 18:28:27.115326963 +0000 UTC m=+52.050098772 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls") pod "dns-default-28kk8" (UID: "bb083a92-6ac3-4fd6-8063-f10fa13a0bbc") : secret "dns-default-metrics-tls" not found Jul 01 18:28:20.007366 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:20.007335 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:20.121294 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:20.121261 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:20.900299 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:20.900267 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" event={"ID":"9d04f933-046b-45d7-a12c-408192ea11d4","Type":"ContainerStarted","Data":"4f1be71fb97454fa2100df00a7ee40b0cf852e905ed91024904197706159d3ad"} Jul 01 18:28:20.932863 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:20.932779 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" podStartSLOduration=1.844765282 podStartE2EDuration="4.932756358s" totalImagesPullingTime="3.087991076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:20.932605945 +0000 UTC m=+45.867377795" watchObservedRunningTime="2026-07-01 18:28:20.932756358 +0000 UTC m=+45.867528163" Jul 01 18:28:21.004234 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.004190 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:21.081001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.080970 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:21.166203 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.166120 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd"] Jul 01 18:28:21.172333 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.172306 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:21.186424 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.186392 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd"] Jul 01 18:28:21.186576 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.186493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" Jul 01 18:28:21.188777 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.188754 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 01 18:28:21.188927 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.188754 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 01 18:28:21.188927 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.188880 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bqgbv\"" Jul 01 18:28:21.265236 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.265193 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:21.333123 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.333085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8brw\" (UniqueName: \"kubernetes.io/projected/b8523b14-11c8-4379-80f7-daec3bb41afd-kube-api-access-v8brw\") pod \"migrator-786f9fbc5-krnpd\" (UID: \"b8523b14-11c8-4379-80f7-daec3bb41afd\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" Jul 01 18:28:21.365722 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.365689 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:21.434006 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.433915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8brw\" (UniqueName: \"kubernetes.io/projected/b8523b14-11c8-4379-80f7-daec3bb41afd-kube-api-access-v8brw\") pod \"migrator-786f9fbc5-krnpd\" (UID: \"b8523b14-11c8-4379-80f7-daec3bb41afd\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" Jul 01 18:28:21.443396 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.443364 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8brw\" (UniqueName: \"kubernetes.io/projected/b8523b14-11c8-4379-80f7-daec3bb41afd-kube-api-access-v8brw\") pod \"migrator-786f9fbc5-krnpd\" (UID: \"b8523b14-11c8-4379-80f7-daec3bb41afd\") " pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" Jul 01 18:28:21.495594 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.495560 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" Jul 01 18:28:21.641903 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.641870 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd"] Jul 01 18:28:21.644997 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:21.644968 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8523b14_11c8_4379_80f7_daec3bb41afd.slice/crio-0ecb33082e26cfbdcfc6b30daa85aa1b540c6faa0b905c66dce521d45a60b947 WatchSource:0}: Error finding container 0ecb33082e26cfbdcfc6b30daa85aa1b540c6faa0b905c66dce521d45a60b947: Status 404 returned error can't find the container with id 0ecb33082e26cfbdcfc6b30daa85aa1b540c6faa0b905c66dce521d45a60b947 Jul 01 18:28:21.838020 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.837916 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:21.838164 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:21.838102 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:21.838214 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:21.838177 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls podName:3da6963d-9a99-44f9-ae2b-0803806be5c9 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:29.838158962 +0000 UTC m=+54.772930764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-df6bh" (UID: "3da6963d-9a99-44f9-ae2b-0803806be5c9") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:21.904344 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.904308 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" event={"ID":"b8523b14-11c8-4379-80f7-daec3bb41afd","Type":"ContainerStarted","Data":"0ecb33082e26cfbdcfc6b30daa85aa1b540c6faa0b905c66dce521d45a60b947"} Jul 01 18:28:21.994601 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:21.994569 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:22.152941 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:22.152909 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:23.489288 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:23.489259 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:23.911487 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:23.911459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" event={"ID":"b8523b14-11c8-4379-80f7-daec3bb41afd","Type":"ContainerStarted","Data":"fe36c33760863d2d14b9a0e75296536fab009caba01629acfb71ca1faae0a532"} Jul 01 18:28:24.875733 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:24.875700 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:24.915703 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:24.915670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" event={"ID":"b8523b14-11c8-4379-80f7-daec3bb41afd","Type":"ContainerStarted","Data":"015264c842ce6297450e98f4ac788b4979394253f2fc86add205804d8588e1ee"} Jul 01 18:28:27.179979 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:27.179938 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:27.180371 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:27.180096 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 01 18:28:27.180371 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:27.180181 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls podName:bb083a92-6ac3-4fd6-8063-f10fa13a0bbc nodeName:}" failed. No retries permitted until 2026-07-01 18:28:43.18016409 +0000 UTC m=+68.114935871 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls") pod "dns-default-28kk8" (UID: "bb083a92-6ac3-4fd6-8063-f10fa13a0bbc") : secret "dns-default-metrics-tls" not found Jul 01 18:28:28.493957 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:28.493923 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:29.901571 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:29.901530 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:29.901990 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:29.901695 2574 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 01 18:28:29.901990 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:29.901776 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls podName:3da6963d-9a99-44f9-ae2b-0803806be5c9 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:45.901759774 +0000 UTC m=+70.836531573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-df6bh" (UID: "3da6963d-9a99-44f9-ae2b-0803806be5c9") : secret "insights-runtime-extractor-tls" not found Jul 01 18:28:30.695340 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:30.695305 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:30.835471 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:30.835437 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:30.949845 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:30.949745 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:31.050634 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:31.050594 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:31.154144 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:31.154114 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:31.644026 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:31.643991 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:32.208600 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:32.208573 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:32.813443 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:32.813408 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:33.014742 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:33.014711 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:33.398686 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:33.398649 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:33.485457 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:33.485417 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:33.613594 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:33.613562 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:34.013713 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:34.013678 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:34.444278 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:34.444249 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:34.637275 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:34.637244 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:34.743170 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:34.743079 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:35.280828 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:35.280759 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:35.401084 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:35.401046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:35.502327 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:35.502296 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:35.599533 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:35.599446 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:35.806076 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:35.806048 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:35.907539 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:35.907496 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:36.130743 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:36.130704 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:36.231213 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:36.231130 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:36.523169 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:36.523075 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:36.624227 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:36.624195 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:36.873770 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:36.873740 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pkt5l" Jul 01 18:28:36.902719 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:36.902660 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-786f9fbc5-krnpd" podStartSLOduration=13.758331254 podStartE2EDuration="15.902643954s" totalImagesPullingTime="2.1443127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:24.935137756 +0000 UTC m=+49.869909560" watchObservedRunningTime="2026-07-01 18:28:36.902643954 +0000 UTC m=+61.837415762" Jul 01 18:28:36.918916 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:36.918886 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:36.991034 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:36.990997 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:37.093032 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:37.093000 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:37.190891 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:37.190807 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:37.292695 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:37.292664 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:37.406006 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:37.405963 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:37.487107 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:37.487004 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:37.625156 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:37.625123 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:37.828837 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:37.828722 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:37.956848 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:37.956812 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:38.056340 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:38.056311 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:38.214330 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:38.214295 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:38.799233 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:38.799196 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:39.202639 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:39.202587 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:39.408176 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:39.408145 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:39.600645 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:39.600554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:40.024266 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:40.024231 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:40.607736 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:40.607700 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:41.005479 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.005447 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:41.290423 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.290327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:41.292647 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.292627 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 01 18:28:41.303718 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.303694 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/021c38e9-03d2-4dbc-bc8a-064de7a0c62f-metrics-certs\") pod \"network-metrics-daemon-947sf\" (UID: \"021c38e9-03d2-4dbc-bc8a-064de7a0c62f\") " pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:41.355639 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.355606 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-2tjgt\"" Jul 01 18:28:41.363431 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.363403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-947sf" Jul 01 18:28:41.391050 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.391020 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:41.391050 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.391052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:41.393449 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.393433 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 01 18:28:41.393525 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.393504 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 01 18:28:41.397400 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.397369 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:41.404245 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.404225 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 01 18:28:41.404419 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.404390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/16343865-65ff-4e09-a37f-d7ba4939141a-original-pull-secret\") pod \"global-pull-secret-syncer-sjcfw\" (UID: \"16343865-65ff-4e09-a37f-d7ba4939141a\") " pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:41.415984 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.415951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8dv\" (UniqueName: \"kubernetes.io/projected/3c157c07-028f-4f99-9c22-5ddecf22d171-kube-api-access-hl8dv\") pod \"network-check-target-qjf7l\" (UID: \"3c157c07-028f-4f99-9c22-5ddecf22d171\") " pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:41.487419 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.487364 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-947sf"] Jul 01 18:28:41.490756 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:41.490731 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod021c38e9_03d2_4dbc_bc8a_064de7a0c62f.slice/crio-ac4646a7d990d5cf8b370aa3d7a6901c261d3e56106c9f2457d65edac6f72349 WatchSource:0}: Error finding container ac4646a7d990d5cf8b370aa3d7a6901c261d3e56106c9f2457d65edac6f72349: Status 404 returned error can't find the container with id ac4646a7d990d5cf8b370aa3d7a6901c261d3e56106c9f2457d65edac6f72349 Jul 01 18:28:41.604307 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.604218 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:41.647210 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.647175 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjcfw" Jul 01 18:28:41.660918 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.660893 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l88pn\"" Jul 01 18:28:41.669664 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.669638 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:41.783483 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.783453 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sjcfw"] Jul 01 18:28:41.787026 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:41.786993 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16343865_65ff_4e09_a37f_d7ba4939141a.slice/crio-1eac0cecdddc3398d72f4dc050ecbf2a3230cb4f4f066dd6a55bec7102303d0d WatchSource:0}: Error finding container 1eac0cecdddc3398d72f4dc050ecbf2a3230cb4f4f066dd6a55bec7102303d0d: Status 404 returned error can't find the container with id 1eac0cecdddc3398d72f4dc050ecbf2a3230cb4f4f066dd6a55bec7102303d0d Jul 01 18:28:41.802333 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.802305 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qjf7l"] Jul 01 18:28:41.805636 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:41.805598 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c157c07_028f_4f99_9c22_5ddecf22d171.slice/crio-2d6bcf1b0423d11fcd9eeba81ad57d970358a23f27ce08ed5301bde4fe88e640 WatchSource:0}: Error finding container 2d6bcf1b0423d11fcd9eeba81ad57d970358a23f27ce08ed5301bde4fe88e640: Status 404 returned error can't find the container with id 2d6bcf1b0423d11fcd9eeba81ad57d970358a23f27ce08ed5301bde4fe88e640 Jul 01 18:28:41.808029 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.808003 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:41.958039 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.957999 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sjcfw" event={"ID":"16343865-65ff-4e09-a37f-d7ba4939141a","Type":"ContainerStarted","Data":"1eac0cecdddc3398d72f4dc050ecbf2a3230cb4f4f066dd6a55bec7102303d0d"} Jul 01 18:28:41.959548 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.959516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qjf7l" event={"ID":"3c157c07-028f-4f99-9c22-5ddecf22d171","Type":"ContainerStarted","Data":"2d6bcf1b0423d11fcd9eeba81ad57d970358a23f27ce08ed5301bde4fe88e640"} Jul 01 18:28:41.960918 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:41.960886 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-947sf" event={"ID":"021c38e9-03d2-4dbc-bc8a-064de7a0c62f","Type":"ContainerStarted","Data":"ac4646a7d990d5cf8b370aa3d7a6901c261d3e56106c9f2457d65edac6f72349"} Jul 01 18:28:42.968493 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:42.968425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-947sf" event={"ID":"021c38e9-03d2-4dbc-bc8a-064de7a0c62f","Type":"ContainerStarted","Data":"f4d76ef3ba5554b970580e24165b2d836aa54cb3eb542ea01f376904b5d9e457"} Jul 01 18:28:42.968493 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:42.968497 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-947sf" event={"ID":"021c38e9-03d2-4dbc-bc8a-064de7a0c62f","Type":"ContainerStarted","Data":"5632638c9cae571da6ba66863c02bdadafc7f0c810e774b021e2d8a2db48cd2a"} Jul 01 18:28:42.985307 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:42.985242 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-947sf" podStartSLOduration=67.014691496 podStartE2EDuration="1m7.985222055s" totalImagesPullingTime="970.530559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:42.983774003 +0000 UTC m=+67.918545808" watchObservedRunningTime="2026-07-01 18:28:42.985222055 +0000 UTC m=+67.919993859" Jul 01 18:28:43.207451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.207413 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:43.210595 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.210564 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bb083a92-6ac3-4fd6-8063-f10fa13a0bbc-metrics-tls\") pod \"dns-default-28kk8\" (UID: \"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc\") " pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:43.443882 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.443850 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5x58v\"" Jul 01 18:28:43.452591 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.452559 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:43.607491 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.607454 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-28kk8"] Jul 01 18:28:43.611427 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:43.611398 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb083a92_6ac3_4fd6_8063_f10fa13a0bbc.slice/crio-c032d7b7792555c85e853595b4eaf1fbe91f68fb13cef56c177a0081c06e46b0 WatchSource:0}: Error finding container c032d7b7792555c85e853595b4eaf1fbe91f68fb13cef56c177a0081c06e46b0: Status 404 returned error can't find the container with id c032d7b7792555c85e853595b4eaf1fbe91f68fb13cef56c177a0081c06e46b0 Jul 01 18:28:43.645100 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.645063 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:43.776863 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.776745 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:43.893390 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.893352 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:43.973890 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:43.973850 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-28kk8" event={"ID":"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc","Type":"ContainerStarted","Data":"c032d7b7792555c85e853595b4eaf1fbe91f68fb13cef56c177a0081c06e46b0"} Jul 01 18:28:44.028381 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.028284 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:44.780265 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.780230 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:44.805590 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.805544 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz"] Jul 01 18:28:44.821002 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.820963 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf"] Jul 01 18:28:44.821181 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.821100 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:44.824533 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.824494 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 01 18:28:44.824533 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.824494 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 01 18:28:44.824731 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.824583 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 01 18:28:44.824939 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.824920 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 01 18:28:44.835359 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.835124 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5499b6fb8f-k6jd9"] Jul 01 18:28:44.839406 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.838688 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" Jul 01 18:28:44.842191 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.842002 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-p2msh\"" Jul 01 18:28:44.843097 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.843075 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 01 18:28:44.861672 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.861089 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf"] Jul 01 18:28:44.861672 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.861128 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz"] Jul 01 18:28:44.861672 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.861149 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-k6jd9"] Jul 01 18:28:44.861672 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.861172 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-86df69b785-srmrm"] Jul 01 18:28:44.861672 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.861305 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-k6jd9" Jul 01 18:28:44.863577 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.863463 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 01 18:28:44.863577 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.863572 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 01 18:28:44.863778 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.863755 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-4xznt\"" Jul 01 18:28:44.887418 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.887364 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86df69b785-srmrm"] Jul 01 18:28:44.887599 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.887498 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.892447 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.892421 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 01 18:28:44.892766 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.892661 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 01 18:28:44.892766 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.892664 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:44.892766 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.892709 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 01 18:28:44.899423 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.899404 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 01 18:28:44.901773 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.901753 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-k8xwh\"" Jul 01 18:28:44.923302 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-bound-sa-token\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.923491 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923322 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-ca-trust-extracted\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.923491 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923369 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-registry-tls\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.923491 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/758409cf-af20-4177-8986-5b48d6251cbb-tmp\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:44.923642 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923514 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/758409cf-af20-4177-8986-5b48d6251cbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:44.923642 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-installation-pull-secrets\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.923642 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-trusted-ca\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.923642 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923579 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgbj7\" (UniqueName: \"kubernetes.io/projected/d1eed9c5-5d64-42f9-b679-c4fd0220fad5-kube-api-access-qgbj7\") pod \"downloads-5499b6fb8f-k6jd9\" (UID: \"d1eed9c5-5d64-42f9-b679-c4fd0220fad5\") " pod="openshift-console/downloads-5499b6fb8f-k6jd9" Jul 01 18:28:44.923642 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923605 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bx4l\" (UniqueName: \"kubernetes.io/projected/758409cf-af20-4177-8986-5b48d6251cbb-kube-api-access-2bx4l\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:44.923917 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923651 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-image-registry-private-configuration\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.923917 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmzz2\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-kube-api-access-jmzz2\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.923917 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b32898db-144d-402b-bf0f-bdae4aac04ba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf\" (UID: \"b32898db-144d-402b-bf0f-bdae4aac04ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" Jul 01 18:28:44.923917 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923764 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thzz8\" (UniqueName: \"kubernetes.io/projected/b32898db-144d-402b-bf0f-bdae4aac04ba-kube-api-access-thzz8\") pod \"managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf\" (UID: \"b32898db-144d-402b-bf0f-bdae4aac04ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" Jul 01 18:28:44.923917 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.923815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-registry-certificates\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:44.982164 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:44.982093 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:45.025169 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025132 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b32898db-144d-402b-bf0f-bdae4aac04ba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf\" (UID: \"b32898db-144d-402b-bf0f-bdae4aac04ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" Jul 01 18:28:45.025360 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thzz8\" (UniqueName: \"kubernetes.io/projected/b32898db-144d-402b-bf0f-bdae4aac04ba-kube-api-access-thzz8\") pod \"managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf\" (UID: \"b32898db-144d-402b-bf0f-bdae4aac04ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" Jul 01 18:28:45.025360 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-registry-certificates\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.025360 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-bound-sa-token\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.025360 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025288 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-ca-trust-extracted\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025743 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-registry-tls\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025820 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/758409cf-af20-4177-8986-5b48d6251cbb-tmp\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025861 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/758409cf-af20-4177-8986-5b48d6251cbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-installation-pull-secrets\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025919 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-trusted-ca\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025955 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgbj7\" (UniqueName: \"kubernetes.io/projected/d1eed9c5-5d64-42f9-b679-c4fd0220fad5-kube-api-access-qgbj7\") pod \"downloads-5499b6fb8f-k6jd9\" (UID: \"d1eed9c5-5d64-42f9-b679-c4fd0220fad5\") " pod="openshift-console/downloads-5499b6fb8f-k6jd9" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.025981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bx4l\" (UniqueName: \"kubernetes.io/projected/758409cf-af20-4177-8986-5b48d6251cbb-kube-api-access-2bx4l\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.026020 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-image-registry-private-configuration\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.026035 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-ca-trust-extracted\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.026054 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmzz2\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-kube-api-access-jmzz2\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.026336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.026254 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-registry-certificates\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.027030 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.026488 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/758409cf-af20-4177-8986-5b48d6251cbb-tmp\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:45.027146 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.027092 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-trusted-ca\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.029597 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.029575 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b32898db-144d-402b-bf0f-bdae4aac04ba-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf\" (UID: \"b32898db-144d-402b-bf0f-bdae4aac04ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" Jul 01 18:28:45.029717 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.029694 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-image-registry-private-configuration\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.030216 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.030169 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-registry-tls\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.030561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.030506 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-installation-pull-secrets\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.030561 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.030540 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/758409cf-af20-4177-8986-5b48d6251cbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:45.038202 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.038174 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bx4l\" (UniqueName: \"kubernetes.io/projected/758409cf-af20-4177-8986-5b48d6251cbb-kube-api-access-2bx4l\") pod \"klusterlet-addon-workmgr-74cf885df4-nmcvz\" (UID: \"758409cf-af20-4177-8986-5b48d6251cbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:45.038346 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.038272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-bound-sa-token\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.042584 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.042559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgbj7\" (UniqueName: \"kubernetes.io/projected/d1eed9c5-5d64-42f9-b679-c4fd0220fad5-kube-api-access-qgbj7\") pod \"downloads-5499b6fb8f-k6jd9\" (UID: \"d1eed9c5-5d64-42f9-b679-c4fd0220fad5\") " pod="openshift-console/downloads-5499b6fb8f-k6jd9" Jul 01 18:28:45.043117 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.043081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmzz2\" (UniqueName: \"kubernetes.io/projected/ee845f8f-b4c2-45f3-8475-bbf93e9c6204-kube-api-access-jmzz2\") pod \"image-registry-86df69b785-srmrm\" (UID: \"ee845f8f-b4c2-45f3-8475-bbf93e9c6204\") " pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.044107 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.044083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thzz8\" (UniqueName: \"kubernetes.io/projected/b32898db-144d-402b-bf0f-bdae4aac04ba-kube-api-access-thzz8\") pod \"managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf\" (UID: \"b32898db-144d-402b-bf0f-bdae4aac04ba\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" Jul 01 18:28:45.081268 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.081225 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:45.139753 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.139716 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:45.161464 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.161425 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" Jul 01 18:28:45.174852 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.174827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5499b6fb8f-k6jd9" Jul 01 18:28:45.183409 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.183365 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:45.198913 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.198880 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:45.934279 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.934237 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:45.937201 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:45.937175 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3da6963d-9a99-44f9-ae2b-0803806be5c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-df6bh\" (UID: \"3da6963d-9a99-44f9-ae2b-0803806be5c9\") " pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:46.216172 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:46.216090 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5ngz2\"" Jul 01 18:28:46.224373 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:46.224340 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-df6bh" Jul 01 18:28:46.875506 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:46.875471 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz"] Jul 01 18:28:47.183286 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.183249 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:47.198270 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:47.198235 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod758409cf_af20_4177_8986_5b48d6251cbb.slice/crio-6e9299f2b6985cb4bfd5fa39ac9d2c10cee9b3dca2b6843a61fef36df7fb7a70 WatchSource:0}: Error finding container 6e9299f2b6985cb4bfd5fa39ac9d2c10cee9b3dca2b6843a61fef36df7fb7a70: Status 404 returned error can't find the container with id 6e9299f2b6985cb4bfd5fa39ac9d2c10cee9b3dca2b6843a61fef36df7fb7a70 Jul 01 18:28:47.361615 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.361252 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:47.417188 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.417111 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf"] Jul 01 18:28:47.422737 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:47.422695 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb32898db_144d_402b_bf0f_bdae4aac04ba.slice/crio-9ffc25c18b430be24eb9ee50337eb7aaae9eed110c95c513648b935de8286a20 WatchSource:0}: Error finding container 9ffc25c18b430be24eb9ee50337eb7aaae9eed110c95c513648b935de8286a20: Status 404 returned error can't find the container with id 9ffc25c18b430be24eb9ee50337eb7aaae9eed110c95c513648b935de8286a20 Jul 01 18:28:47.432282 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.432249 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5499b6fb8f-k6jd9"] Jul 01 18:28:47.436920 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:47.436888 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1eed9c5_5d64_42f9_b679_c4fd0220fad5.slice/crio-ae071fbc4dd6cd96fb6adca9e820e43795b4e58b390914ca707d475c24fe572f WatchSource:0}: Error finding container ae071fbc4dd6cd96fb6adca9e820e43795b4e58b390914ca707d475c24fe572f: Status 404 returned error can't find the container with id ae071fbc4dd6cd96fb6adca9e820e43795b4e58b390914ca707d475c24fe572f Jul 01 18:28:47.456932 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.456873 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-86df69b785-srmrm"] Jul 01 18:28:47.458388 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.458313 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-df6bh"] Jul 01 18:28:47.461326 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:47.461300 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee845f8f_b4c2_45f3_8475_bbf93e9c6204.slice/crio-5c39c4a81a10d718c0fc636ad0dfdc9694319900496d9feda79a9fa5f072b38e WatchSource:0}: Error finding container 5c39c4a81a10d718c0fc636ad0dfdc9694319900496d9feda79a9fa5f072b38e: Status 404 returned error can't find the container with id 5c39c4a81a10d718c0fc636ad0dfdc9694319900496d9feda79a9fa5f072b38e Jul 01 18:28:47.462948 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:47.462914 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da6963d_9a99_44f9_ae2b_0803806be5c9.slice/crio-e230a6e4356754f84bebf8c2b565456cdd87f7584b4544a563639ead9862892b WatchSource:0}: Error finding container e230a6e4356754f84bebf8c2b565456cdd87f7584b4544a563639ead9862892b: Status 404 returned error can't find the container with id e230a6e4356754f84bebf8c2b565456cdd87f7584b4544a563639ead9862892b Jul 01 18:28:47.992918 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.992879 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sjcfw" event={"ID":"16343865-65ff-4e09-a37f-d7ba4939141a","Type":"ContainerStarted","Data":"7ec115c612a95ea947d23a9be43ae12384fc546362f390430bc805ca481168e5"} Jul 01 18:28:47.994103 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.994077 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-k6jd9" event={"ID":"d1eed9c5-5d64-42f9-b679-c4fd0220fad5","Type":"ContainerStarted","Data":"ae071fbc4dd6cd96fb6adca9e820e43795b4e58b390914ca707d475c24fe572f"} Jul 01 18:28:47.995247 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.995228 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86df69b785-srmrm" event={"ID":"ee845f8f-b4c2-45f3-8475-bbf93e9c6204","Type":"ContainerStarted","Data":"d7e4f9880cf1829eb94078e77db41e3ffd73fcb70c309eaf43c66d12c2f366a8"} Jul 01 18:28:47.995332 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.995263 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-86df69b785-srmrm" event={"ID":"ee845f8f-b4c2-45f3-8475-bbf93e9c6204","Type":"ContainerStarted","Data":"5c39c4a81a10d718c0fc636ad0dfdc9694319900496d9feda79a9fa5f072b38e"} Jul 01 18:28:47.995332 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.995280 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:28:47.996662 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.996641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qjf7l" event={"ID":"3c157c07-028f-4f99-9c22-5ddecf22d171","Type":"ContainerStarted","Data":"88f5511001be64f190af437ffeebeca788e32ce2077f083f94b61401adda90bf"} Jul 01 18:28:47.996747 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.996691 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:28:47.998382 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.998362 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-28kk8" event={"ID":"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc","Type":"ContainerStarted","Data":"5058a558c8fb5e1e7fdc4ac99392cd472ab8262200f976a6bd0b6600e1226cf3"} Jul 01 18:28:47.998470 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.998408 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-28kk8" event={"ID":"bb083a92-6ac3-4fd6-8063-f10fa13a0bbc","Type":"ContainerStarted","Data":"a0395de3d6dcaa3c9f2bbef7f21bded1a97781d2fd8b74d96868063bc33dfeb5"} Jul 01 18:28:47.998470 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.998441 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:47.999492 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:47.999470 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-df6bh" event={"ID":"3da6963d-9a99-44f9-ae2b-0803806be5c9","Type":"ContainerStarted","Data":"e230a6e4356754f84bebf8c2b565456cdd87f7584b4544a563639ead9862892b"} Jul 01 18:28:48.000477 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:48.000459 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" event={"ID":"b32898db-144d-402b-bf0f-bdae4aac04ba","Type":"ContainerStarted","Data":"9ffc25c18b430be24eb9ee50337eb7aaae9eed110c95c513648b935de8286a20"} Jul 01 18:28:48.001446 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:48.001427 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" event={"ID":"758409cf-af20-4177-8986-5b48d6251cbb","Type":"ContainerStarted","Data":"6e9299f2b6985cb4bfd5fa39ac9d2c10cee9b3dca2b6843a61fef36df7fb7a70"} Jul 01 18:28:48.009601 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:48.009556 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sjcfw" podStartSLOduration=67.596485224 podStartE2EDuration="1m13.009540509s" totalImagesPullingTime="5.413055285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:48.008799713 +0000 UTC m=+72.943571524" watchObservedRunningTime="2026-07-01 18:28:48.009540509 +0000 UTC m=+72.944312290" Jul 01 18:28:48.026259 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:48.026207 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qjf7l" podStartSLOduration=67.631399195 podStartE2EDuration="1m13.026188722s" totalImagesPullingTime="5.394789527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:27:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:48.025339577 +0000 UTC m=+72.960111385" watchObservedRunningTime="2026-07-01 18:28:48.026188722 +0000 UTC m=+72.960960534" Jul 01 18:28:48.060904 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:48.060839 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-86df69b785-srmrm" podStartSLOduration=4.060768238 podStartE2EDuration="4.060768238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:48.059970588 +0000 UTC m=+72.994742394" watchObservedRunningTime="2026-07-01 18:28:48.060768238 +0000 UTC m=+72.995540046" Jul 01 18:28:48.061601 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:48.061554 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-28kk8" podStartSLOduration=33.441357569 podStartE2EDuration="37.061539588s" totalImagesPullingTime="3.620182019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:48.041743999 +0000 UTC m=+72.976515804" watchObservedRunningTime="2026-07-01 18:28:48.061539588 +0000 UTC m=+72.996311418" Jul 01 18:28:49.359639 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:49.359367 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:51.764142 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:51.764107 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:51.930518 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:51.930478 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:52.031738 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:52.031651 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:52.105094 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:52.105064 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:52.282333 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:52.282193 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:52.383491 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:52.383458 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:52.891531 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:52.891493 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:52.994402 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:52.994364 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:53.288122 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:53.288029 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:53.601554 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:53.601475 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:53.675182 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:53.675110 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:54.357187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:54.357137 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:55.038036 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:55.037913 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" event={"ID":"758409cf-af20-4177-8986-5b48d6251cbb","Type":"ContainerStarted","Data":"f37bfadc670111c090f52110a7a5b106f16c1a56b5d32b3779c92c8fa48b6e0f"} Jul 01 18:28:55.038195 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:55.038174 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:55.040436 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:55.040319 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" podUID="758409cf-af20-4177-8986-5b48d6251cbb" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.11:8000/readyz\": dial tcp 10.133.0.11:8000: connect: connection refused" Jul 01 18:28:55.040974 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:55.040897 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-df6bh" event={"ID":"3da6963d-9a99-44f9-ae2b-0803806be5c9","Type":"ContainerStarted","Data":"4d50bae6f56a8e3c227875a934681f037b52cee8babb2b637af2dbfe3a8b60e6"} Jul 01 18:28:55.043648 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:55.043603 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" event={"ID":"b32898db-144d-402b-bf0f-bdae4aac04ba","Type":"ContainerStarted","Data":"c0f209bb04196c1aabb62f8d580a7feaea3f58ce24851cb240a19cfc6613decb"} Jul 01 18:28:55.052910 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:55.052772 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" podStartSLOduration=3.312298409 podStartE2EDuration="11.052756465s" totalImagesPullingTime="7.740458056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:55.052042239 +0000 UTC m=+79.986814051" watchObservedRunningTime="2026-07-01 18:28:55.052756465 +0000 UTC m=+79.987528268" Jul 01 18:28:55.070475 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:55.070408 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d6c4d5d7d-gfstf" podStartSLOduration=3.592641327 podStartE2EDuration="11.070384866s" totalImagesPullingTime="7.477743539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:55.069554359 +0000 UTC m=+80.004326164" watchObservedRunningTime="2026-07-01 18:28:55.070384866 +0000 UTC m=+80.005156671" Jul 01 18:28:55.947637 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:55.947600 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:56.049735 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:56.049697 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-df6bh" event={"ID":"3da6963d-9a99-44f9-ae2b-0803806be5c9","Type":"ContainerStarted","Data":"6514d0bff596291af4af4594307b72b13b1a4e7bb497cb86be0cafe5937986df"} Jul 01 18:28:56.050663 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:56.050639 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-74cf885df4-nmcvz" Jul 01 18:28:58.009303 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.009154 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:58.011904 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.011849 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-28kk8" Jul 01 18:28:58.250862 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.250825 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:58.338469 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.338390 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f5whm"] Jul 01 18:28:58.355503 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.355462 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.358418 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.358267 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 01 18:28:58.358661 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.358643 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 01 18:28:58.358897 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.358881 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 01 18:28:58.359102 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.359084 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 01 18:28:58.359385 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.359363 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q7jwb\"" Jul 01 18:28:58.359460 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.359439 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 01 18:28:58.359514 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.359456 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 01 18:28:58.360999 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.360557 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:58.442564 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.442762 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442582 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf2d6\" (UniqueName: \"kubernetes.io/projected/780ab5db-e848-4a39-a93a-cbc862f05810-kube-api-access-mf2d6\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.442762 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442615 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-root\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.442762 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442658 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-textfile\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.442762 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-tls\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.442762 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-sys\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.442762 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780ab5db-e848-4a39-a93a-cbc862f05810-metrics-client-ca\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.443017 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-accelerators-collector-config\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.443017 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.442819 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-wtmp\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.449982 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.449945 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:58.543871 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.543836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-textfile\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544106 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.543896 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-tls\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544106 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.543937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-sys\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544106 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.543964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780ab5db-e848-4a39-a93a-cbc862f05810-metrics-client-ca\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544106 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.543991 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-accelerators-collector-config\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544106 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.544022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-wtmp\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544106 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.544088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544393 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.544122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf2d6\" (UniqueName: \"kubernetes.io/projected/780ab5db-e848-4a39-a93a-cbc862f05810-kube-api-access-mf2d6\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544393 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.544148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-root\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544393 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.544225 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-root\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544393 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.544357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-sys\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544539 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:58.544483 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 01 18:28:58.544572 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:28:58.544562 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-tls podName:780ab5db-e848-4a39-a93a-cbc862f05810 nodeName:}" failed. No retries permitted until 2026-07-01 18:28:59.044539252 +0000 UTC m=+83.979311035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-tls") pod "node-exporter-f5whm" (UID: "780ab5db-e848-4a39-a93a-cbc862f05810") : secret "node-exporter-tls" not found Jul 01 18:28:58.544612 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.544581 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-textfile\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.544927 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.544898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-wtmp\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.545059 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.545000 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-accelerators-collector-config\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.545301 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.545279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/780ab5db-e848-4a39-a93a-cbc862f05810-metrics-client-ca\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.547489 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.547459 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.550739 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.550714 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:58.553248 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.553227 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf2d6\" (UniqueName: \"kubernetes.io/projected/780ab5db-e848-4a39-a93a-cbc862f05810-kube-api-access-mf2d6\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:58.650539 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.650490 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:58.754524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.754491 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:58.852921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:58.852883 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:59.047666 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.047563 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-tls\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:59.050327 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.050294 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/780ab5db-e848-4a39-a93a-cbc862f05810-node-exporter-tls\") pod \"node-exporter-f5whm\" (UID: \"780ab5db-e848-4a39-a93a-cbc862f05810\") " pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:59.065010 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.064971 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-df6bh" event={"ID":"3da6963d-9a99-44f9-ae2b-0803806be5c9","Type":"ContainerStarted","Data":"3bd29908170509d3d72f3bc0ea79ea9d4e6a1673bc73a9b9a8531d9249f833a0"} Jul 01 18:28:59.085545 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.085481 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-df6bh" podStartSLOduration=34.010973735 podStartE2EDuration="45.085457075s" totalImagesPullingTime="11.07448334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:28:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:28:59.084515454 +0000 UTC m=+84.019287258" watchObservedRunningTime="2026-07-01 18:28:59.085457075 +0000 UTC m=+84.020228883" Jul 01 18:28:59.255537 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.255485 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:59.269227 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.269192 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f5whm" Jul 01 18:28:59.280950 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:59.280915 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod780ab5db_e848_4a39_a93a_cbc862f05810.slice/crio-23ea8918e6d03bcc74ec5375a3fb50af837cb3513338e29bc80151cff8397952 WatchSource:0}: Error finding container 23ea8918e6d03bcc74ec5375a3fb50af837cb3513338e29bc80151cff8397952: Status 404 returned error can't find the container with id 23ea8918e6d03bcc74ec5375a3fb50af837cb3513338e29bc80151cff8397952 Jul 01 18:28:59.345659 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.345565 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:59.350364 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.350339 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 18:28:59.354753 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.354736 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.356985 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.356962 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 01 18:28:59.357128 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.357093 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 01 18:28:59.357128 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.357100 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 01 18:28:59.357128 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.357124 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-nwkr2\"" Jul 01 18:28:59.357443 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.357426 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 01 18:28:59.357528 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.357454 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 01 18:28:59.357528 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.357505 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 01 18:28:59.357528 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.357522 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 01 18:28:59.357689 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.357658 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 01 18:28:59.358097 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.358076 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 01 18:28:59.371148 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.371115 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 18:28:59.450628 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450595 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b24b23bc-baf3-4158-93f2-d4848142cdf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.450628 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450630 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.450881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b24b23bc-baf3-4158-93f2-d4848142cdf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.450881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.450881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450731 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-web-config\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.450881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450832 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfv8m\" (UniqueName: \"kubernetes.io/projected/b24b23bc-baf3-4158-93f2-d4848142cdf3-kube-api-access-rfv8m\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.451043 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.451043 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.451043 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450959 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24b23bc-baf3-4158-93f2-d4848142cdf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.451043 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.450991 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.451194 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.451058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b24b23bc-baf3-4158-93f2-d4848142cdf3-config-out\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.451194 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.451103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.451194 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.451134 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b24b23bc-baf3-4158-93f2-d4848142cdf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.465288 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.465234 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:28:59.551756 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.551721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24b23bc-baf3-4158-93f2-d4848142cdf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.551945 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.551775 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.551945 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.551831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b24b23bc-baf3-4158-93f2-d4848142cdf3-config-out\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.551945 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.551875 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.551945 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.551911 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b24b23bc-baf3-4158-93f2-d4848142cdf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.551945 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.551944 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b24b23bc-baf3-4158-93f2-d4848142cdf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.552255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.551977 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.552255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.552007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b24b23bc-baf3-4158-93f2-d4848142cdf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.552255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.552038 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.552255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.552081 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-web-config\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.552255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.552135 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfv8m\" (UniqueName: \"kubernetes.io/projected/b24b23bc-baf3-4158-93f2-d4848142cdf3-kube-api-access-rfv8m\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.552255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.552192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.552255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.552223 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.553640 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.553469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b24b23bc-baf3-4158-93f2-d4848142cdf3-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.553640 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.553574 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b24b23bc-baf3-4158-93f2-d4848142cdf3-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.553856 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.553838 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b24b23bc-baf3-4158-93f2-d4848142cdf3-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.556050 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.556006 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-web-config\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.556548 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.556357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.556548 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.556514 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.556548 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.556542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.556893 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.556867 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b24b23bc-baf3-4158-93f2-d4848142cdf3-config-out\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.557776 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.557753 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-config-volume\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.558158 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.558125 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.558158 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.558141 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b24b23bc-baf3-4158-93f2-d4848142cdf3-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.558541 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.558515 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b24b23bc-baf3-4158-93f2-d4848142cdf3-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.562078 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.562055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfv8m\" (UniqueName: \"kubernetes.io/projected/b24b23bc-baf3-4158-93f2-d4848142cdf3-kube-api-access-rfv8m\") pod \"alertmanager-main-0\" (UID: \"b24b23bc-baf3-4158-93f2-d4848142cdf3\") " pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.664468 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.664432 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 01 18:28:59.815395 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:28:59.815363 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 01 18:28:59.819900 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:28:59.819857 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24b23bc_baf3_4158_93f2_d4848142cdf3.slice/crio-bf48f4d0ec3fe6b4f00a6248b298b588743d8f96a3dbc8fa1608bf35230668b8 WatchSource:0}: Error finding container bf48f4d0ec3fe6b4f00a6248b298b588743d8f96a3dbc8fa1608bf35230668b8: Status 404 returned error can't find the container with id bf48f4d0ec3fe6b4f00a6248b298b588743d8f96a3dbc8fa1608bf35230668b8 Jul 01 18:29:00.071161 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:00.071033 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f5whm" event={"ID":"780ab5db-e848-4a39-a93a-cbc862f05810","Type":"ContainerStarted","Data":"23ea8918e6d03bcc74ec5375a3fb50af837cb3513338e29bc80151cff8397952"} Jul 01 18:29:00.072473 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:00.072372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b24b23bc-baf3-4158-93f2-d4848142cdf3","Type":"ContainerStarted","Data":"bf48f4d0ec3fe6b4f00a6248b298b588743d8f96a3dbc8fa1608bf35230668b8"} Jul 01 18:29:01.078019 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:01.077975 2574 generic.go:356] "Generic (PLEG): container finished" podID="780ab5db-e848-4a39-a93a-cbc862f05810" containerID="d6bafa2639884dd8a8ff4ea04f1b46f78e6755603065ee770988d10738e818c8" exitCode=0 Jul 01 18:29:01.078467 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:01.078067 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f5whm" event={"ID":"780ab5db-e848-4a39-a93a-cbc862f05810","Type":"ContainerDied","Data":"d6bafa2639884dd8a8ff4ea04f1b46f78e6755603065ee770988d10738e818c8"} Jul 01 18:29:01.202409 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:01.202364 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:01.279758 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:01.279717 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:01.654332 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:01.654290 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:01.748264 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:01.748228 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:02.117097 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.117009 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:02.193891 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.193854 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:02.691872 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.691837 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7895c6b6c9-s5sqm"] Jul 01 18:29:02.695436 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.695415 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.698256 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.698154 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 01 18:29:02.698256 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.698173 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 01 18:29:02.698256 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.698186 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-au9behrmh1eu3\"" Jul 01 18:29:02.698256 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.698188 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dt4nd\"" Jul 01 18:29:02.698256 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.698204 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 01 18:29:02.698849 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.698826 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 01 18:29:02.708890 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.708864 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7895c6b6c9-s5sqm"] Jul 01 18:29:02.781157 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.781116 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-metrics-server-audit-profiles\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.781360 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.781224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-client-ca-bundle\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.781360 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.781275 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.781487 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.781366 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-secret-metrics-server-tls\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.781487 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.781421 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-secret-metrics-server-client-certs\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.781487 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.781450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfxsj\" (UniqueName: \"kubernetes.io/projected/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-kube-api-access-zfxsj\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.781487 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.781468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-audit-log\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.882702 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.882660 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-metrics-server-audit-profiles\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.882926 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.882733 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-client-ca-bundle\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.882926 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.882777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.882926 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.882840 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-secret-metrics-server-tls\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.883103 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.883033 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-secret-metrics-server-client-certs\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.883103 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.883087 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfxsj\" (UniqueName: \"kubernetes.io/projected/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-kube-api-access-zfxsj\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.883194 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.883122 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-audit-log\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.883700 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.883606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-audit-log\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.883700 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.883635 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.883971 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.883942 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-metrics-server-audit-profiles\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.886287 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.886228 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-secret-metrics-server-tls\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.886446 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.886428 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-secret-metrics-server-client-certs\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.886770 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.886746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-client-ca-bundle\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:02.895930 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:02.895903 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfxsj\" (UniqueName: \"kubernetes.io/projected/6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771-kube-api-access-zfxsj\") pod \"metrics-server-7895c6b6c9-s5sqm\" (UID: \"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771\") " pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:03.007674 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.007580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:03.055768 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.055721 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:03.081318 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.081281 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc"] Jul 01 18:29:03.084835 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.084811 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:03.087735 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.087699 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rk8dj\"" Jul 01 18:29:03.088088 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.088063 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 01 18:29:03.098015 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.097991 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc"] Jul 01 18:29:03.181064 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.181024 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:03.186133 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.186098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e632116e-076d-40c0-b9a2-7b4f8315b8de-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-mmmtc\" (UID: \"e632116e-076d-40c0-b9a2-7b4f8315b8de\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:03.186293 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.186143 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hblhg\" (UniqueName: \"kubernetes.io/projected/e632116e-076d-40c0-b9a2-7b4f8315b8de-kube-api-access-hblhg\") pod \"monitoring-plugin-cd8656b8-mmmtc\" (UID: \"e632116e-076d-40c0-b9a2-7b4f8315b8de\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:03.285130 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.285035 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:03.287123 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.287091 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e632116e-076d-40c0-b9a2-7b4f8315b8de-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-mmmtc\" (UID: \"e632116e-076d-40c0-b9a2-7b4f8315b8de\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:03.287271 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.287140 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hblhg\" (UniqueName: \"kubernetes.io/projected/e632116e-076d-40c0-b9a2-7b4f8315b8de-kube-api-access-hblhg\") pod \"monitoring-plugin-cd8656b8-mmmtc\" (UID: \"e632116e-076d-40c0-b9a2-7b4f8315b8de\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:03.290139 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.290115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e632116e-076d-40c0-b9a2-7b4f8315b8de-monitoring-plugin-cert\") pod \"monitoring-plugin-cd8656b8-mmmtc\" (UID: \"e632116e-076d-40c0-b9a2-7b4f8315b8de\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:03.296520 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.296463 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hblhg\" (UniqueName: \"kubernetes.io/projected/e632116e-076d-40c0-b9a2-7b4f8315b8de-kube-api-access-hblhg\") pod \"monitoring-plugin-cd8656b8-mmmtc\" (UID: \"e632116e-076d-40c0-b9a2-7b4f8315b8de\") " pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:03.396072 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.396037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:03.680677 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.680627 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:03.809005 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:03.808948 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:04.246321 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.246278 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:04.347384 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.347346 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:04.480614 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.480504 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 18:29:04.485621 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.485591 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:04.487290 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.487255 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.489339 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.489314 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 01 18:29:04.489812 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.489611 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 01 18:29:04.490336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.490155 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 01 18:29:04.490336 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.490256 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 01 18:29:04.491446 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.491425 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 01 18:29:04.491985 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.491960 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 01 18:29:04.492075 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.492051 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 01 18:29:04.492075 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.492069 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 01 18:29:04.492748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.492243 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 01 18:29:04.492748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.492262 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7dr8z\"" Jul 01 18:29:04.492748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.492299 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 01 18:29:04.492748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.492355 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 01 18:29:04.492748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.492407 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 01 18:29:04.492748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.492641 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fgk6mm0o7lovp\"" Jul 01 18:29:04.493897 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.493878 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 01 18:29:04.498033 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.497972 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 01 18:29:04.514166 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.514130 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 18:29:04.600174 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600174 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600427 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600263 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wn5gq\" (UniqueName: \"kubernetes.io/projected/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-kube-api-access-wn5gq\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600427 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600321 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600427 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600368 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600427 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600597 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600597 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600597 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600603 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600655 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600748 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600737 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-config\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600971 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600971 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600971 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600856 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600971 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600971 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600907 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.600971 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600958 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.601314 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.600994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.701548 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.701745 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.701745 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.701745 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701654 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.701949 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701839 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wn5gq\" (UniqueName: \"kubernetes.io/projected/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-kube-api-access-wn5gq\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.701949 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.701949 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701926 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702056 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701954 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702056 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.701992 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702056 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702023 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702056 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702050 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702245 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702084 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702245 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702125 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702245 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702168 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702245 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-config\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702439 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702255 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702439 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702439 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702314 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702439 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702439 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702366 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702439 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702717 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.702717 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.702512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.703041 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.703015 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.704524 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.704490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.705177 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.704804 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.705177 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.704947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.705177 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.705139 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.705745 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.705699 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.705745 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.705730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.705898 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.705842 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-web-config\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.706453 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.706319 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.706453 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.706327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-config-out\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.706952 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.706911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-config\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.708331 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.708311 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.708429 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.708327 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.708491 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.708443 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.708491 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.708474 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.708867 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.708849 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.711513 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.711494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wn5gq\" (UniqueName: \"kubernetes.io/projected/e63f4a1d-0e36-46ba-a4a3-7162bf80f75c-kube-api-access-wn5gq\") pod \"prometheus-k8s-0\" (UID: \"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:04.799718 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:04.799622 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:05.114317 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:05.114220 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:05.215282 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:05.215227 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:06.592281 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:06.592236 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:06.693017 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:06.692975 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:07.165943 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:07.165915 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:07.233422 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:07.233386 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:08.321779 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:08.321748 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc"] Jul 01 18:29:08.332354 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:08.332333 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7895c6b6c9-s5sqm"] Jul 01 18:29:08.357314 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:08.357205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 01 18:29:08.364710 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:29:08.364665 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode632116e_076d_40c0_b9a2_7b4f8315b8de.slice/crio-6e43bb8c493f3dc90393854e46fa2f991935fe16d1478afe39451e7fa9ba9489 WatchSource:0}: Error finding container 6e43bb8c493f3dc90393854e46fa2f991935fe16d1478afe39451e7fa9ba9489: Status 404 returned error can't find the container with id 6e43bb8c493f3dc90393854e46fa2f991935fe16d1478afe39451e7fa9ba9489 Jul 01 18:29:08.371838 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:29:08.371809 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffd5d68_0bc1_497e_9a44_e2b9a4cf6771.slice/crio-36ca7785761ae5304f3f8248e0a39041e94ccaf8c0494910941b470b10fc1ad3 WatchSource:0}: Error finding container 36ca7785761ae5304f3f8248e0a39041e94ccaf8c0494910941b470b10fc1ad3: Status 404 returned error can't find the container with id 36ca7785761ae5304f3f8248e0a39041e94ccaf8c0494910941b470b10fc1ad3 Jul 01 18:29:08.372068 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:29:08.372050 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode63f4a1d_0e36_46ba_a4a3_7162bf80f75c.slice/crio-2985193c27141885459606448db1db636d4330abcedd4dc69f59c7df532b1b1d WatchSource:0}: Error finding container 2985193c27141885459606448db1db636d4330abcedd4dc69f59c7df532b1b1d: Status 404 returned error can't find the container with id 2985193c27141885459606448db1db636d4330abcedd4dc69f59c7df532b1b1d Jul 01 18:29:09.015228 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.014949 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-86df69b785-srmrm" Jul 01 18:29:09.112386 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.112345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5499b6fb8f-k6jd9" event={"ID":"d1eed9c5-5d64-42f9-b679-c4fd0220fad5","Type":"ContainerStarted","Data":"9a1e80f189e5ab86cb4614f870510a8e321578dab54de666329d398d1c86382d"} Jul 01 18:29:09.112710 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.112652 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5499b6fb8f-k6jd9" Jul 01 18:29:09.114667 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.114524 2574 generic.go:356] "Generic (PLEG): container finished" podID="b24b23bc-baf3-4158-93f2-d4848142cdf3" containerID="813c0b021ab13775291e16991bfc6affe0cd44439576fc936d64a6d48c48001f" exitCode=0 Jul 01 18:29:09.115003 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.114750 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b24b23bc-baf3-4158-93f2-d4848142cdf3","Type":"ContainerDied","Data":"813c0b021ab13775291e16991bfc6affe0cd44439576fc936d64a6d48c48001f"} Jul 01 18:29:09.117609 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.117583 2574 generic.go:356] "Generic (PLEG): container finished" podID="e63f4a1d-0e36-46ba-a4a3-7162bf80f75c" containerID="1b2ea6c78a96f3cee391f0a6299b757395b6fe3ee8c961e162308758134cc0a2" exitCode=0 Jul 01 18:29:09.118061 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.117960 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c","Type":"ContainerDied","Data":"1b2ea6c78a96f3cee391f0a6299b757395b6fe3ee8c961e162308758134cc0a2"} Jul 01 18:29:09.118061 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.118038 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c","Type":"ContainerStarted","Data":"2985193c27141885459606448db1db636d4330abcedd4dc69f59c7df532b1b1d"} Jul 01 18:29:09.124716 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.124449 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5499b6fb8f-k6jd9" Jul 01 18:29:09.127956 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.126956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f5whm" event={"ID":"780ab5db-e848-4a39-a93a-cbc862f05810","Type":"ContainerStarted","Data":"c402966eb257a0fe56d1bd4223e94893f8cfc5d9921906acdee8eaa99bdfaedd"} Jul 01 18:29:09.127956 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.127003 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f5whm" event={"ID":"780ab5db-e848-4a39-a93a-cbc862f05810","Type":"ContainerStarted","Data":"5ece9ebd45cd4c4ad9b47d4c9f67716f66db5838ca141372765f77deeace1f44"} Jul 01 18:29:09.130907 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.130842 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" event={"ID":"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771","Type":"ContainerStarted","Data":"36ca7785761ae5304f3f8248e0a39041e94ccaf8c0494910941b470b10fc1ad3"} Jul 01 18:29:09.132497 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.132466 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" event={"ID":"e632116e-076d-40c0-b9a2-7b4f8315b8de","Type":"ContainerStarted","Data":"6e43bb8c493f3dc90393854e46fa2f991935fe16d1478afe39451e7fa9ba9489"} Jul 01 18:29:09.151504 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.151076 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5499b6fb8f-k6jd9" podStartSLOduration=4.416918394 podStartE2EDuration="25.151053042s" totalImagesPullingTime="20.734134648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:09.149139453 +0000 UTC m=+94.083911258" watchObservedRunningTime="2026-07-01 18:29:09.151053042 +0000 UTC m=+94.085824847" Jul 01 18:29:09.189428 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.186940 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:09.224193 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.223877 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f5whm" podStartSLOduration=10.197470225 podStartE2EDuration="11.223853208s" totalImagesPullingTime="949.772993ms" totalInitContainerRuntime="76.60999ms" isStatefulPod=true podCreationTimestamp="2026-07-01 18:28:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:09.222545804 +0000 UTC m=+94.157317609" watchObservedRunningTime="2026-07-01 18:29:09.223853208 +0000 UTC m=+94.158625014" Jul 01 18:29:09.262504 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.262469 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:09.386530 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.386493 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:09.455458 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:09.455412 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:10.060310 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:10.060271 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:12.140192 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:12.140149 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:12.239395 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:12.239363 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:13.967392 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:13.967302 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:14.068187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.068151 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:14.161541 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.161502 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" event={"ID":"e632116e-076d-40c0-b9a2-7b4f8315b8de","Type":"ContainerStarted","Data":"5e582a789058ad672edae05fea0478fcf46df7fd8bd8fb51818a02cae7d529a9"} Jul 01 18:29:14.161867 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.161757 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:14.164892 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.164263 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b24b23bc-baf3-4158-93f2-d4848142cdf3","Type":"ContainerStarted","Data":"d1fe075244a28f46902d05bf8de18ebb8752ebbd515c4da80197753d1901a506"} Jul 01 18:29:14.167684 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.167639 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" event={"ID":"6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771","Type":"ContainerStarted","Data":"1cd2c269358d99ad4e0ea18a000dc56bf36ad630db4ec38a973f771769cbe288"} Jul 01 18:29:14.168212 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.168191 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" Jul 01 18:29:14.170711 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.170685 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:14.182596 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.182528 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-cd8656b8-mmmtc" podStartSLOduration=5.841732457 podStartE2EDuration="11.182508162s" totalImagesPullingTime="5.340775705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:14.18206148 +0000 UTC m=+99.116833285" watchObservedRunningTime="2026-07-01 18:29:14.182508162 +0000 UTC m=+99.117279967" Jul 01 18:29:14.201898 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.201743 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" podStartSLOduration=6.867781625 podStartE2EDuration="12.20172168s" totalImagesPullingTime="5.333940055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:29:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:14.200132082 +0000 UTC m=+99.134903900" watchObservedRunningTime="2026-07-01 18:29:14.20172168 +0000 UTC m=+99.136493486" Jul 01 18:29:14.929706 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:14.929643 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:15.040193 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.040154 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:15.182855 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.182750 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b24b23bc-baf3-4158-93f2-d4848142cdf3","Type":"ContainerStarted","Data":"3802c42c42359272f271ee0c8de15d915224490e767f2acc4bfe6a6767d2e155"} Jul 01 18:29:15.183095 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.182905 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b24b23bc-baf3-4158-93f2-d4848142cdf3","Type":"ContainerStarted","Data":"da4fc58b981067ddede52eb4be56e27726acccc53f470497ce6b2722d487507d"} Jul 01 18:29:15.183095 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.182941 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b24b23bc-baf3-4158-93f2-d4848142cdf3","Type":"ContainerStarted","Data":"80ec48ff49d48922d29881e4732fc83d2c600c64e03e85b671eb1b0207223d5f"} Jul 01 18:29:15.183095 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.182980 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b24b23bc-baf3-4158-93f2-d4848142cdf3","Type":"ContainerStarted","Data":"ef1d485e671b3bd390fce5a00c3f1a6e0347e482c06e23caa0d260da42593b83"} Jul 01 18:29:15.190015 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.189985 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c","Type":"ContainerStarted","Data":"6d602ebf39d99b884e864873666fe544cedddb5792650bc57d642c3f75e095f8"} Jul 01 18:29:15.190226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.190063 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c","Type":"ContainerStarted","Data":"eb9e2bbc57d930103c7eb24b50b631fb9b9dbe0b71cab5b2f9437b4dc49b3dd0"} Jul 01 18:29:15.796234 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.796194 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:15.899302 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.899263 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:15.998105 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:15.998065 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:16.199196 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:16.199160 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b24b23bc-baf3-4158-93f2-d4848142cdf3","Type":"ContainerStarted","Data":"642063b181c3f68ae74d4bfcffcc1952121d154f3834dd482e6083981782fb43"} Jul 01 18:29:16.228414 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:16.227446 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.863393516 podStartE2EDuration="17.227423531s" totalImagesPullingTime="14.329689539s" totalInitContainerRuntime="34.340476ms" isStatefulPod=false podCreationTimestamp="2026-07-01 18:28:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:16.225698249 +0000 UTC m=+101.160470054" watchObservedRunningTime="2026-07-01 18:29:16.227423531 +0000 UTC m=+101.162195335" Jul 01 18:29:17.224891 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:17.224852 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:17.366338 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:17.366298 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:19.012081 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:19.012052 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qjf7l" Jul 01 18:29:19.218292 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:19.218249 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c","Type":"ContainerStarted","Data":"98ff7ade0f1607eaa4fe88a734c32dbee61dfc03eabeb9b4ad61f14485438d91"} Jul 01 18:29:19.218584 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:19.218329 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c","Type":"ContainerStarted","Data":"3568a059171e74effe09c74fad15789398fc79aaf96a15ae8d33fb40f7602c71"} Jul 01 18:29:19.218584 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:19.218367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c","Type":"ContainerStarted","Data":"70925489fdbe15248225d74fe3f3bcdeedfd95389593b9df92bd1e2b421d3d8c"} Jul 01 18:29:19.218584 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:19.218403 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e63f4a1d-0e36-46ba-a4a3-7162bf80f75c","Type":"ContainerStarted","Data":"6cafc6c8a9d5582df0735f228a78b48d30b249ec8f7ac4ca301653385ec4d76b"} Jul 01 18:29:19.253805 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:19.253724 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.4538254760000004 podStartE2EDuration="15.253699487s" totalImagesPullingTime="8.774178186s" totalInitContainerRuntime="25.695825ms" isStatefulPod=false podCreationTimestamp="2026-07-01 18:29:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:29:19.252767369 +0000 UTC m=+104.187539188" watchObservedRunningTime="2026-07-01 18:29:19.253699487 +0000 UTC m=+104.188471293" Jul 01 18:29:19.799999 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:19.799959 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:29:23.008550 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:23.008508 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:23.008977 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:23.008573 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:24.565537 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:24.565500 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gw696_08936d22-2399-47bc-a800-6c1e6fa98ce6/serve-healthcheck-canary/0.log" Jul 01 18:29:25.170111 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:25.170069 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:25.230459 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:25.230424 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:27.055804 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:27.055769 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:27.155227 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:27.155176 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:28.929589 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:28.929560 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:28.996349 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:28.996316 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:32.118927 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:32.118889 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:32.221014 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:32.220982 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:34.996001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:34.995967 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:35.058398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:35.058360 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:43.013797 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:43.013752 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:43.017921 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:43.017898 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7895c6b6c9-s5sqm" Jul 01 18:29:46.330740 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:46.330702 2574 generic.go:356] "Generic (PLEG): container finished" podID="9d04f933-046b-45d7-a12c-408192ea11d4" containerID="4f1be71fb97454fa2100df00a7ee40b0cf852e905ed91024904197706159d3ad" exitCode=0 Jul 01 18:29:46.331146 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:46.330778 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" event={"ID":"9d04f933-046b-45d7-a12c-408192ea11d4","Type":"ContainerDied","Data":"4f1be71fb97454fa2100df00a7ee40b0cf852e905ed91024904197706159d3ad"} Jul 01 18:29:46.331205 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:46.331158 2574 scope.go:117] "RemoveContainer" containerID="4f1be71fb97454fa2100df00a7ee40b0cf852e905ed91024904197706159d3ad" Jul 01 18:29:47.336669 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:47.336641 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d7b7dc95c-fkbr5" event={"ID":"9d04f933-046b-45d7-a12c-408192ea11d4","Type":"ContainerStarted","Data":"958ac6ecdca44ffed56b00133c30ab71686f17e3964d9fbcc9e9cc6a2f7c2faf"} Jul 01 18:29:47.613948 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:47.613859 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:29:47.692475 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:29:47.692442 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:04.800663 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:04.800626 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:30:04.820149 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:04.820121 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:30:05.420349 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:05.420320 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 01 18:30:17.480303 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:17.480258 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:17.731867 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:17.731766 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:29.013520 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:29.013436 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:32.760017 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:32.759981 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:32.831499 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:32.831467 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:44.695877 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:44.695841 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:44.796249 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:44.796219 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:46.340268 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:46.340214 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:46.441133 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:46.441095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:46.552949 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:46.552915 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:54.645489 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:54.645456 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:30:54.746795 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:30:54.746750 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:31:02.124884 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:31:02.124847 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:31:02.226230 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:31:02.226203 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:31:02.324808 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:31:02.324754 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:31:28.383004 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:31:28.382969 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:31:28.483343 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:31:28.483308 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:00.297311 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:00.297231 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:01.056316 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:01.056283 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:03.888638 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:03.888602 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:04.027936 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:04.027903 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:05.931594 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:05.931562 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:06.044162 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:06.044128 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:06.270965 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:06.270878 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:06.398545 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:06.398510 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:09.629456 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:09.629423 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:10.455398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:10.455367 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:10.890888 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:10.890856 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:10.965500 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:10.965461 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:15.234493 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:15.234461 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:15.344494 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:15.344463 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:16.846635 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:16.846596 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:22.296391 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:22.296354 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:22.394870 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:22.394841 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:29.383732 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:29.383694 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:29.531983 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:29.531927 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:31.524373 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:31.524341 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:35.486960 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:35.486908 2574 kubelet.go:1648] "Image garbage collection succeeded" Jul 01 18:32:43.301187 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.301149 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:43.931824 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.931775 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m"] Jul 01 18:32:43.933964 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.933946 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:43.937530 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.937504 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 01 18:32:43.937668 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.937617 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 01 18:32:43.938147 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.938130 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 01 18:32:43.938280 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.938187 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-s57l5\"" Jul 01 18:32:43.938280 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.938240 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 01 18:32:43.947377 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.947353 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m"] Jul 01 18:32:43.951750 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:43.951726 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 01 18:32:44.032543 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.032500 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b67cda04-d874-40c0-9a87-efa714e00792-manager-config\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.032720 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.032581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvtx5\" (UniqueName: \"kubernetes.io/projected/b67cda04-d874-40c0-9a87-efa714e00792-kube-api-access-hvtx5\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.032720 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.032608 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b67cda04-d874-40c0-9a87-efa714e00792-cert\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.032720 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.032636 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b67cda04-d874-40c0-9a87-efa714e00792-metrics-cert\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.133377 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.133333 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvtx5\" (UniqueName: \"kubernetes.io/projected/b67cda04-d874-40c0-9a87-efa714e00792-kube-api-access-hvtx5\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.133652 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.133387 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b67cda04-d874-40c0-9a87-efa714e00792-cert\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.133652 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.133425 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b67cda04-d874-40c0-9a87-efa714e00792-metrics-cert\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.133652 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.133467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b67cda04-d874-40c0-9a87-efa714e00792-manager-config\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.134201 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.134179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b67cda04-d874-40c0-9a87-efa714e00792-manager-config\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.135905 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.135888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b67cda04-d874-40c0-9a87-efa714e00792-cert\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.136041 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.136025 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b67cda04-d874-40c0-9a87-efa714e00792-metrics-cert\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.142607 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.142585 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvtx5\" (UniqueName: \"kubernetes.io/projected/b67cda04-d874-40c0-9a87-efa714e00792-kube-api-access-hvtx5\") pod \"lws-controller-manager-56879d7496-6sf4m\" (UID: \"b67cda04-d874-40c0-9a87-efa714e00792\") " pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.243492 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.243398 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:44.381918 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.381856 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m"] Jul 01 18:32:44.384254 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:32:44.384220 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb67cda04_d874_40c0_9a87_efa714e00792.slice/crio-b3c7e2f8e251513a624fca11a88b934cca22bf7ead73df448302a95756ce24be WatchSource:0}: Error finding container b3c7e2f8e251513a624fca11a88b934cca22bf7ead73df448302a95756ce24be: Status 404 returned error can't find the container with id b3c7e2f8e251513a624fca11a88b934cca22bf7ead73df448302a95756ce24be Jul 01 18:32:44.386200 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.386186 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:32:44.406904 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.406871 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc"] Jul 01 18:32:44.410053 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.410030 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.413513 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.413494 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 01 18:32:44.413513 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.413508 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 01 18:32:44.413678 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.413644 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 01 18:32:44.413886 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.413873 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nzsjd\"" Jul 01 18:32:44.415913 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.415891 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 01 18:32:44.433329 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.433294 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc"] Jul 01 18:32:44.536512 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.536414 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.536512 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.536450 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.536512 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.536496 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.536756 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.536521 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st979\" (UniqueName: \"kubernetes.io/projected/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-kube-api-access-st979\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.536756 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.536602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.637263 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.637213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.637263 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.637261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.637505 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.637301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.637505 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.637319 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st979\" (UniqueName: \"kubernetes.io/projected/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-kube-api-access-st979\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.637605 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.637527 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.637836 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.637815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-manifests\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.639678 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.639655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-tmp\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.639909 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.639891 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.639963 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.639947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.646705 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.646678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-st979\" (UniqueName: \"kubernetes.io/projected/9dd0c94f-3a59-4356-bb4b-03d4b3ebf767-kube-api-access-st979\") pod \"opendatahub-operator-controller-manager-7bfc969986-xwbdc\" (UID: \"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767\") " pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.721029 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.721000 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:44.857505 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:44.857468 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc"] Jul 01 18:32:44.861416 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:32:44.861390 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd0c94f_3a59_4356_bb4b_03d4b3ebf767.slice/crio-38ca311cfe0941afbc0f87e6e21d7c645110e45ece8bbe35bc9159e2cd2c7c13 WatchSource:0}: Error finding container 38ca311cfe0941afbc0f87e6e21d7c645110e45ece8bbe35bc9159e2cd2c7c13: Status 404 returned error can't find the container with id 38ca311cfe0941afbc0f87e6e21d7c645110e45ece8bbe35bc9159e2cd2c7c13 Jul 01 18:32:45.021517 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:45.021472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" event={"ID":"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767","Type":"ContainerStarted","Data":"38ca311cfe0941afbc0f87e6e21d7c645110e45ece8bbe35bc9159e2cd2c7c13"} Jul 01 18:32:45.022626 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:45.022598 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" event={"ID":"b67cda04-d874-40c0-9a87-efa714e00792","Type":"ContainerStarted","Data":"b3c7e2f8e251513a624fca11a88b934cca22bf7ead73df448302a95756ce24be"} Jul 01 18:32:45.175092 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:45.175052 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:45.270464 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:45.270432 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:32:51.060844 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:51.060806 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" event={"ID":"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767","Type":"ContainerStarted","Data":"d535f116780888466683dd20ae580a8a70bbe49c89fd4cf5ac807d9faa60d06f"} Jul 01 18:32:51.062239 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:51.062212 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" event={"ID":"b67cda04-d874-40c0-9a87-efa714e00792","Type":"ContainerStarted","Data":"6087bc739c66f0c39c874b0c36ac2657c7822431c5d48c63b9146880f9df5ed0"} Jul 01 18:32:51.062398 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:51.062329 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:32:51.098833 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:51.098761 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" podStartSLOduration=2.170989546 podStartE2EDuration="8.098743569s" totalImagesPullingTime="5.927754023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:51.097209903 +0000 UTC m=+316.031981708" watchObservedRunningTime="2026-07-01 18:32:51.098743569 +0000 UTC m=+316.033515435" Jul 01 18:32:52.067943 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:52.067901 2574 generic.go:356] "Generic (PLEG): container finished" podID="9dd0c94f-3a59-4356-bb4b-03d4b3ebf767" containerID="d535f116780888466683dd20ae580a8a70bbe49c89fd4cf5ac807d9faa60d06f" exitCode=0 Jul 01 18:32:52.067943 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:52.067934 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" event={"ID":"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767","Type":"ContainerDied","Data":"d535f116780888466683dd20ae580a8a70bbe49c89fd4cf5ac807d9faa60d06f"} Jul 01 18:32:53.074370 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:53.074336 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" event={"ID":"9dd0c94f-3a59-4356-bb4b-03d4b3ebf767","Type":"ContainerStarted","Data":"4673748cf983ea0a28f0571c5a85db7a2036c1c358163ff8b967e7b44c90114b"} Jul 01 18:32:53.074771 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:53.074448 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:32:53.094597 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:32:53.094541 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" podStartSLOduration=2.122784811 podStartE2EDuration="9.094520805s" totalImagesPullingTime="5.925628481s" totalInitContainerRuntime="1.046107513s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:32:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:32:53.093311406 +0000 UTC m=+318.028083210" watchObservedRunningTime="2026-07-01 18:32:53.094520805 +0000 UTC m=+318.029292613" Jul 01 18:33:02.070867 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:02.070834 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-56879d7496-6sf4m" Jul 01 18:33:04.081379 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:04.081348 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bfc969986-xwbdc" Jul 01 18:33:05.710418 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:05.710387 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:05.827147 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:05.827093 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:11.382316 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:11.382264 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:11.629091 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:11.629055 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:11.710010 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:11.709916 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:11.805468 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:11.805430 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:12.216590 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:12.216545 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:12.321026 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:12.320991 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:12.685230 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:12.685191 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:12.764720 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:12.764690 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:12.840523 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:12.840490 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:13.745120 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:13.745087 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:19.075275 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.075238 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2"] Jul 01 18:33:19.083705 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.083682 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.086086 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.086062 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 01 18:33:19.086238 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.086062 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 01 18:33:19.086293 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.086281 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 01 18:33:19.086343 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.086311 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 01 18:33:19.086343 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.086330 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-b2dcm\"" Jul 01 18:33:19.086525 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.086501 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 01 18:33:19.086594 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.086531 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 01 18:33:19.095146 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.095128 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2"] Jul 01 18:33:19.148138 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.148095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.148138 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.148140 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvnb4\" (UniqueName: \"kubernetes.io/projected/196d4de1-8b7a-446b-ad7e-cb1904919c60-kube-api-access-pvnb4\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.148365 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.148174 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.148365 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.148232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.148365 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.148288 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.148365 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.148311 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.148365 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.148337 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/196d4de1-8b7a-446b-ad7e-cb1904919c60-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.249035 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.248990 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/196d4de1-8b7a-446b-ad7e-cb1904919c60-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.249035 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.249041 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.249283 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.249066 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvnb4\" (UniqueName: \"kubernetes.io/projected/196d4de1-8b7a-446b-ad7e-cb1904919c60-kube-api-access-pvnb4\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.249283 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.249089 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.249283 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.249128 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.249440 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.249286 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.249440 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.249331 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.249814 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.249757 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.251400 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.251373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/196d4de1-8b7a-446b-ad7e-cb1904919c60-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.251559 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.251542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.251658 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.251637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.251698 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.251637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.264879 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.264851 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/196d4de1-8b7a-446b-ad7e-cb1904919c60-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.265670 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.265649 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvnb4\" (UniqueName: \"kubernetes.io/projected/196d4de1-8b7a-446b-ad7e-cb1904919c60-kube-api-access-pvnb4\") pod \"istiod-openshift-gateway-94bb8fbfd-fh5s2\" (UID: \"196d4de1-8b7a-446b-ad7e-cb1904919c60\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.278001 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.277959 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:19.393617 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.393583 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:19.428150 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.428118 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:19.532267 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.532235 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2"] Jul 01 18:33:19.534865 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:33:19.534837 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196d4de1_8b7a_446b_ad7e_cb1904919c60.slice/crio-083b05edb8656d2735eef1d2a439de1aad81db1c429d8a0fcd4c9795fb283c87 WatchSource:0}: Error finding container 083b05edb8656d2735eef1d2a439de1aad81db1c429d8a0fcd4c9795fb283c87: Status 404 returned error can't find the container with id 083b05edb8656d2735eef1d2a439de1aad81db1c429d8a0fcd4c9795fb283c87 Jul 01 18:33:19.836061 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.835953 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:19.942180 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:19.942148 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:20.156002 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:20.155965 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:20.199735 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:20.199702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" event={"ID":"196d4de1-8b7a-446b-ad7e-cb1904919c60","Type":"ContainerStarted","Data":"083b05edb8656d2735eef1d2a439de1aad81db1c429d8a0fcd4c9795fb283c87"} Jul 01 18:33:20.347138 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:20.347105 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:20.492226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:20.492133 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:21.799356 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:21.799318 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:21.852007 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:21.851961 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 18:33:21.852124 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:21.852033 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 01 18:33:21.904113 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:21.904077 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:22.086206 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:22.086114 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:22.213139 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:22.213106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" event={"ID":"196d4de1-8b7a-446b-ad7e-cb1904919c60","Type":"ContainerStarted","Data":"8872187eb59f859f4e37231ad74aae44084d361259ad8c02da5faec05afc06a6"} Jul 01 18:33:22.213334 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:22.213313 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:22.215149 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:22.215120 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-fh5s2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 01 18:33:22.215276 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:22.215177 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" podUID="196d4de1-8b7a-446b-ad7e-cb1904919c60" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 01 18:33:22.268503 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:22.268448 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" podStartSLOduration=0.953675357 podStartE2EDuration="3.268428995s" totalImagesPullingTime="2.314753638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:22.265564716 +0000 UTC m=+347.200336532" watchObservedRunningTime="2026-07-01 18:33:22.268428995 +0000 UTC m=+347.203200798" Jul 01 18:33:22.857837 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:22.857780 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:23.143190 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:23.143156 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:23.219186 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:23.219161 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-fh5s2" Jul 01 18:33:23.378974 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:23.378927 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:26.633337 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.633263 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-84b695bfbb-dfwl2"] Jul 01 18:33:26.635931 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.635914 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" Jul 01 18:33:26.637973 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.637951 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mjrjx\"" Jul 01 18:33:26.638076 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.637988 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jul 01 18:33:26.644778 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.644750 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84b695bfbb-dfwl2"] Jul 01 18:33:26.694071 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.694035 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:26.715378 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.715340 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7-redirect-config\") pod \"dashboard-redirect-84b695bfbb-dfwl2\" (UID: \"a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7\") " pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" Jul 01 18:33:26.715552 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.715408 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5grq\" (UniqueName: \"kubernetes.io/projected/a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7-kube-api-access-n5grq\") pod \"dashboard-redirect-84b695bfbb-dfwl2\" (UID: \"a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7\") " pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" Jul 01 18:33:26.816781 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.816744 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5grq\" (UniqueName: \"kubernetes.io/projected/a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7-kube-api-access-n5grq\") pod \"dashboard-redirect-84b695bfbb-dfwl2\" (UID: \"a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7\") " pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" Jul 01 18:33:26.816985 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.816886 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7-redirect-config\") pod \"dashboard-redirect-84b695bfbb-dfwl2\" (UID: \"a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7\") " pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" Jul 01 18:33:26.817539 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.817520 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7-redirect-config\") pod \"dashboard-redirect-84b695bfbb-dfwl2\" (UID: \"a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7\") " pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" Jul 01 18:33:26.826131 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.826097 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5grq\" (UniqueName: \"kubernetes.io/projected/a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7-kube-api-access-n5grq\") pod \"dashboard-redirect-84b695bfbb-dfwl2\" (UID: \"a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7\") " pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" Jul 01 18:33:26.946846 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:26.946749 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" Jul 01 18:33:27.097285 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:27.097259 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-84b695bfbb-dfwl2"] Jul 01 18:33:27.099833 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:33:27.099802 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f5bcf8_f8f4_4d34_9bd5_895ff85951a7.slice/crio-b58cd821dbc70c3abe3d961713185e8357202d5db8dc00729bb1111b17dd431e WatchSource:0}: Error finding container b58cd821dbc70c3abe3d961713185e8357202d5db8dc00729bb1111b17dd431e: Status 404 returned error can't find the container with id b58cd821dbc70c3abe3d961713185e8357202d5db8dc00729bb1111b17dd431e Jul 01 18:33:27.236853 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:27.236743 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" event={"ID":"a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7","Type":"ContainerStarted","Data":"b58cd821dbc70c3abe3d961713185e8357202d5db8dc00729bb1111b17dd431e"} Jul 01 18:33:31.874764 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:31.874729 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:31.950130 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:31.950101 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:34.270048 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:34.270012 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" event={"ID":"a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7","Type":"ContainerStarted","Data":"bad7b3c5aa35f2ae4b0a428fcaf9cb89aac8f76afbb33abfd38cdbdccf3dfa7f"} Jul 01 18:33:34.287614 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:34.287563 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-84b695bfbb-dfwl2" podStartSLOduration=1.874344156 podStartE2EDuration="8.287547264s" totalImagesPullingTime="6.413203108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:33:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:33:34.285953553 +0000 UTC m=+359.220725361" watchObservedRunningTime="2026-07-01 18:33:34.287547264 +0000 UTC m=+359.222319067" Jul 01 18:33:49.181442 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:49.181409 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:49.320521 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:49.320490 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:52.305128 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:52.305095 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:33:52.443674 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:33:52.443642 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:00.991795 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:00.991761 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:07.383656 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:07.383625 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:07.479325 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:07.479290 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:07.577097 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:07.577067 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:12.816771 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:12.816738 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:12.888237 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:12.888204 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:36.407538 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:36.407504 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:39.815435 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:39.815403 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:40.664586 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:40.664531 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:44.201107 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:44.201075 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:44.432735 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:44.432704 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:44.537222 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:44.537145 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:46.498955 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:46.498918 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:47.000108 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:47.000067 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:47.534954 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:47.534912 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:49.450626 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:49.450595 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:52.425284 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:52.425246 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:52.522511 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:52.522478 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:57.874387 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:57.874298 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:57.989925 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:57.989895 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:58.217199 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:58.217126 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:34:58.317263 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:34:58.317228 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:00.982007 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:00.981968 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:01.189589 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:01.189554 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:01.296472 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:01.296394 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:01.635014 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:01.634977 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:01.889491 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:01.889400 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:04.172038 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:04.172002 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:04.312057 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:04.312023 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:10.441798 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.441753 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f"] Jul 01 18:35:10.445003 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.444982 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.447082 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.447057 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 18:35:10.447182 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.447126 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 18:35:10.447229 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.447208 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rh66x\"" Jul 01 18:35:10.457223 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.457202 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f"] Jul 01 18:35:10.538922 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.538889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-982x4\" (UniqueName: \"kubernetes.io/projected/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-kube-api-access-982x4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-frk9f\" (UID: \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.539166 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.538938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-frk9f\" (UID: \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.549557 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.549522 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f"] Jul 01 18:35:10.549838 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:35:10.549817 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-982x4], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" podUID="2c51aa03-8bae-4f8c-979a-6eca49a64fd7" Jul 01 18:35:10.639875 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.639827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-982x4\" (UniqueName: \"kubernetes.io/projected/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-kube-api-access-982x4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-frk9f\" (UID: \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.640067 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.639890 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-frk9f\" (UID: \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.640226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.640207 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-frk9f\" (UID: \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.648296 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.648276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-982x4\" (UniqueName: \"kubernetes.io/projected/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-kube-api-access-982x4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-frk9f\" (UID: \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.682224 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.682190 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.689226 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.689203 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:10.741077 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.740989 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-extensions-socket-volume\") pod \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\" (UID: \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\") " Jul 01 18:35:10.741077 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.741037 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-982x4\" (UniqueName: \"kubernetes.io/projected/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-kube-api-access-982x4\") pod \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\" (UID: \"2c51aa03-8bae-4f8c-979a-6eca49a64fd7\") " Jul 01 18:35:10.741269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.741243 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c51aa03-8bae-4f8c-979a-6eca49a64fd7" (UID: "2c51aa03-8bae-4f8c-979a-6eca49a64fd7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 01 18:35:10.743376 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.743346 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-kube-api-access-982x4" (OuterVolumeSpecName: "kube-api-access-982x4") pod "2c51aa03-8bae-4f8c-979a-6eca49a64fd7" (UID: "2c51aa03-8bae-4f8c-979a-6eca49a64fd7"). InnerVolumeSpecName "kube-api-access-982x4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:35:10.842459 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.842416 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-extensions-socket-volume\") on node \"ip-10-0-128-190.ec2.internal\" DevicePath \"\"" Jul 01 18:35:10.842459 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.842453 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-982x4\" (UniqueName: \"kubernetes.io/projected/2c51aa03-8bae-4f8c-979a-6eca49a64fd7-kube-api-access-982x4\") on node \"ip-10-0-128-190.ec2.internal\" DevicePath \"\"" Jul 01 18:35:10.858945 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:10.858917 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:11.005173 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:11.005087 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:11.131544 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:11.131485 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f"] Jul 01 18:35:11.139709 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:11.139683 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f"] Jul 01 18:35:11.541260 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:11.541227 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c51aa03-8bae-4f8c-979a-6eca49a64fd7" path="/var/lib/kubelet/pods/2c51aa03-8bae-4f8c-979a-6eca49a64fd7/volumes" Jul 01 18:35:11.686560 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:11.686526 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-frk9f" Jul 01 18:35:15.992739 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:15.992698 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:16.053593 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:16.053566 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:16.584532 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:16.584497 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:16.650854 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:16.650822 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:20.457684 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:20.457652 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:20.560030 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:20.559992 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:24.205968 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:24.201428 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:24.298146 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:24.298116 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:35.473179 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:35.473144 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:35:58.395722 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:35:58.395686 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:00.228464 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:00.228426 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:00.768402 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:00.768371 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:02.791353 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:02.791324 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:02.893497 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:02.893460 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:03.054485 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.054402 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:03.299810 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.299758 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:36:03.303045 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.303025 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:03.305209 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.305151 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 01 18:36:03.305377 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.305357 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 01 18:36:03.305442 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.305398 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 01 18:36:03.305645 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.305633 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fxcgl\"" Jul 01 18:36:03.308667 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.308642 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlglb\" (UniqueName: \"kubernetes.io/projected/eaf837ba-39e8-42c1-a35d-5c4c1d26b289-kube-api-access-vlglb\") pod \"limitador-limitador-54d6d988d5-6jl5d\" (UID: \"eaf837ba-39e8-42c1-a35d-5c4c1d26b289\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:03.308760 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.308690 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eaf837ba-39e8-42c1-a35d-5c4c1d26b289-config-file\") pod \"limitador-limitador-54d6d988d5-6jl5d\" (UID: \"eaf837ba-39e8-42c1-a35d-5c4c1d26b289\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:03.312238 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.312216 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:36:03.345329 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.345298 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:36:03.409443 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.409411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlglb\" (UniqueName: \"kubernetes.io/projected/eaf837ba-39e8-42c1-a35d-5c4c1d26b289-kube-api-access-vlglb\") pod \"limitador-limitador-54d6d988d5-6jl5d\" (UID: \"eaf837ba-39e8-42c1-a35d-5c4c1d26b289\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:03.409602 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.409450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eaf837ba-39e8-42c1-a35d-5c4c1d26b289-config-file\") pod \"limitador-limitador-54d6d988d5-6jl5d\" (UID: \"eaf837ba-39e8-42c1-a35d-5c4c1d26b289\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:03.410073 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.410055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/eaf837ba-39e8-42c1-a35d-5c4c1d26b289-config-file\") pod \"limitador-limitador-54d6d988d5-6jl5d\" (UID: \"eaf837ba-39e8-42c1-a35d-5c4c1d26b289\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:03.418028 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.418007 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlglb\" (UniqueName: \"kubernetes.io/projected/eaf837ba-39e8-42c1-a35d-5c4c1d26b289-kube-api-access-vlglb\") pod \"limitador-limitador-54d6d988d5-6jl5d\" (UID: \"eaf837ba-39e8-42c1-a35d-5c4c1d26b289\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:03.613814 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.613709 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:03.634553 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.634516 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:03.746936 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.746911 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:36:03.749510 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:36:03.749485 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaf837ba_39e8_42c1_a35d_5c4c1d26b289.slice/crio-f7bdc8c41c114c94e10e6eb35b0f8192e33538ebd000b2bf0f2ac2356ff4569e WatchSource:0}: Error finding container f7bdc8c41c114c94e10e6eb35b0f8192e33538ebd000b2bf0f2ac2356ff4569e: Status 404 returned error can't find the container with id f7bdc8c41c114c94e10e6eb35b0f8192e33538ebd000b2bf0f2ac2356ff4569e Jul 01 18:36:03.888905 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.888869 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:03.909222 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:03.909190 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" event={"ID":"eaf837ba-39e8-42c1-a35d-5c4c1d26b289","Type":"ContainerStarted","Data":"f7bdc8c41c114c94e10e6eb35b0f8192e33538ebd000b2bf0f2ac2356ff4569e"} Jul 01 18:36:06.926516 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:06.926477 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" event={"ID":"eaf837ba-39e8-42c1-a35d-5c4c1d26b289","Type":"ContainerStarted","Data":"5e1afaf348e67f7d14130f9c2ba28df10d01b09419fc83ace94ad36f37b83d51"} Jul 01 18:36:06.926941 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:06.926602 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:06.945428 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:06.945371 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" podStartSLOduration=1.309547034 podStartE2EDuration="3.945355247s" totalImagesPullingTime="2.635808213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:36:06.943567446 +0000 UTC m=+511.878339251" watchObservedRunningTime="2026-07-01 18:36:06.945355247 +0000 UTC m=+511.880127113" Jul 01 18:36:17.933119 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:17.933092 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-6jl5d" Jul 01 18:36:18.529124 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:18.529091 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:24.392915 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:24.392879 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:37.560173 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:37.560094 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:36:37.672304 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:36:37.672269 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:06.842765 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:06.842725 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:06.952928 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:06.952896 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:15.150891 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:15.150860 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:15.251674 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:15.251646 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:37.361878 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:37.361842 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:37.635122 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:37.635090 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:43.924141 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:43.924109 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69c8c58646-nsrvd"] Jul 01 18:37:43.927454 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:43.927438 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:43.930998 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:43.930956 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-db8w5\"" Jul 01 18:37:43.931508 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:43.931493 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 01 18:37:43.931619 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:43.931581 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 01 18:37:43.940142 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:43.940116 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:43.947704 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:43.947674 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69c8c58646-nsrvd"] Jul 01 18:37:44.017632 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.017594 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert\") pod \"maas-controller-69c8c58646-nsrvd\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:44.017632 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.017637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dffbh\" (UniqueName: \"kubernetes.io/projected/625a3bff-f875-469a-95fb-94d901039522-kube-api-access-dffbh\") pod \"maas-controller-69c8c58646-nsrvd\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:44.035084 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.035054 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:44.118691 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.118661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dffbh\" (UniqueName: \"kubernetes.io/projected/625a3bff-f875-469a-95fb-94d901039522-kube-api-access-dffbh\") pod \"maas-controller-69c8c58646-nsrvd\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:44.118934 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.118821 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert\") pod \"maas-controller-69c8c58646-nsrvd\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:44.119015 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:37:44.118956 2574 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 01 18:37:44.119076 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:37:44.119030 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert podName:625a3bff-f875-469a-95fb-94d901039522 nodeName:}" failed. No retries permitted until 2026-07-01 18:37:44.619010758 +0000 UTC m=+609.553782559 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert") pod "maas-controller-69c8c58646-nsrvd" (UID: "625a3bff-f875-469a-95fb-94d901039522") : secret "maas-controller-webhook-cert" not found Jul 01 18:37:44.130104 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.130072 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dffbh\" (UniqueName: \"kubernetes.io/projected/625a3bff-f875-469a-95fb-94d901039522-kube-api-access-dffbh\") pod \"maas-controller-69c8c58646-nsrvd\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:44.314896 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.314816 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:44.622674 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.622645 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert\") pod \"maas-controller-69c8c58646-nsrvd\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:44.625122 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.625089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert\") pod \"maas-controller-69c8c58646-nsrvd\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:44.837665 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.837625 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:44.970846 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.970820 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69c8c58646-nsrvd"] Jul 01 18:37:44.973062 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:37:44.973034 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod625a3bff_f875_469a_95fb_94d901039522.slice/crio-4f273d9dd8427a102d09e81fd5fb869552164b972621d2072427d7f07926fabc WatchSource:0}: Error finding container 4f273d9dd8427a102d09e81fd5fb869552164b972621d2072427d7f07926fabc: Status 404 returned error can't find the container with id 4f273d9dd8427a102d09e81fd5fb869552164b972621d2072427d7f07926fabc Jul 01 18:37:44.974451 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:44.974431 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 01 18:37:45.353962 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:45.353875 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c8c58646-nsrvd" event={"ID":"625a3bff-f875-469a-95fb-94d901039522","Type":"ContainerStarted","Data":"4f273d9dd8427a102d09e81fd5fb869552164b972621d2072427d7f07926fabc"} Jul 01 18:37:47.236680 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:47.236642 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:47.364954 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:47.364920 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c8c58646-nsrvd" event={"ID":"625a3bff-f875-469a-95fb-94d901039522","Type":"ContainerStarted","Data":"35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c"} Jul 01 18:37:47.365160 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:47.365054 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:47.400260 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:47.400196 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69c8c58646-nsrvd" podStartSLOduration=2.125146435 podStartE2EDuration="4.400177335s" totalImagesPullingTime="2.2750309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:37:47.397411511 +0000 UTC m=+612.332183314" watchObservedRunningTime="2026-07-01 18:37:47.400177335 +0000 UTC m=+612.334949138" Jul 01 18:37:48.650702 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:48.650667 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:37:58.375630 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.375553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:58.453022 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.452993 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69c8c58646-nsrvd"] Jul 01 18:37:58.453236 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.453176 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69c8c58646-nsrvd" podUID="625a3bff-f875-469a-95fb-94d901039522" containerName="manager" containerID="cri-o://35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c" gracePeriod=30 Jul 01 18:37:58.703502 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.703479 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:58.854846 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.854815 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dffbh\" (UniqueName: \"kubernetes.io/projected/625a3bff-f875-469a-95fb-94d901039522-kube-api-access-dffbh\") pod \"625a3bff-f875-469a-95fb-94d901039522\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " Jul 01 18:37:58.855009 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.854876 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert\") pod \"625a3bff-f875-469a-95fb-94d901039522\" (UID: \"625a3bff-f875-469a-95fb-94d901039522\") " Jul 01 18:37:58.856990 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.856944 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "625a3bff-f875-469a-95fb-94d901039522" (UID: "625a3bff-f875-469a-95fb-94d901039522"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 01 18:37:58.857134 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.857018 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/625a3bff-f875-469a-95fb-94d901039522-kube-api-access-dffbh" (OuterVolumeSpecName: "kube-api-access-dffbh") pod "625a3bff-f875-469a-95fb-94d901039522" (UID: "625a3bff-f875-469a-95fb-94d901039522"). InnerVolumeSpecName "kube-api-access-dffbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 01 18:37:58.956019 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.955925 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dffbh\" (UniqueName: \"kubernetes.io/projected/625a3bff-f875-469a-95fb-94d901039522-kube-api-access-dffbh\") on node \"ip-10-0-128-190.ec2.internal\" DevicePath \"\"" Jul 01 18:37:58.956019 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:58.955958 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/625a3bff-f875-469a-95fb-94d901039522-webhook-cert\") on node \"ip-10-0-128-190.ec2.internal\" DevicePath \"\"" Jul 01 18:37:59.418749 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.418715 2574 generic.go:356] "Generic (PLEG): container finished" podID="625a3bff-f875-469a-95fb-94d901039522" containerID="35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c" exitCode=0 Jul 01 18:37:59.419176 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.418757 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69c8c58646-nsrvd" Jul 01 18:37:59.419176 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.418817 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c8c58646-nsrvd" event={"ID":"625a3bff-f875-469a-95fb-94d901039522","Type":"ContainerDied","Data":"35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c"} Jul 01 18:37:59.419176 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.418882 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69c8c58646-nsrvd" event={"ID":"625a3bff-f875-469a-95fb-94d901039522","Type":"ContainerDied","Data":"4f273d9dd8427a102d09e81fd5fb869552164b972621d2072427d7f07926fabc"} Jul 01 18:37:59.419176 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.418906 2574 scope.go:117] "RemoveContainer" containerID="35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c" Jul 01 18:37:59.436578 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.436530 2574 scope.go:117] "RemoveContainer" containerID="35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c" Jul 01 18:37:59.437157 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:37:59.437129 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c\": container with ID starting with 35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c not found: ID does not exist" containerID="35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c" Jul 01 18:37:59.437277 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.437167 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c"} err="failed to get container status \"35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c\": rpc error: code = NotFound desc = could not find container \"35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c\": container with ID starting with 35f90de25725ad3539aa53de5ab9a40ffbcddc9fae43b03d65e9b98d9e5dca5c not found: ID does not exist" Jul 01 18:37:59.451213 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.451185 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69c8c58646-nsrvd"] Jul 01 18:37:59.457240 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.457216 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69c8c58646-nsrvd"] Jul 01 18:37:59.542755 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:37:59.542718 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="625a3bff-f875-469a-95fb-94d901039522" path="/var/lib/kubelet/pods/625a3bff-f875-469a-95fb-94d901039522/volumes" Jul 01 18:38:15.314726 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:15.314693 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:18.712042 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:18.712006 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:19.192975 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.192934 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:19.244498 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.244464 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-798549b7b7-59mw6"] Jul 01 18:38:19.244814 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.244800 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="625a3bff-f875-469a-95fb-94d901039522" containerName="manager" Jul 01 18:38:19.244869 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.244815 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="625a3bff-f875-469a-95fb-94d901039522" containerName="manager" Jul 01 18:38:19.244907 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.244880 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="625a3bff-f875-469a-95fb-94d901039522" containerName="manager" Jul 01 18:38:19.249229 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.249214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.251305 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.251282 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rl95x\"" Jul 01 18:38:19.251518 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.251503 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 01 18:38:19.262558 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.262533 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-798549b7b7-59mw6"] Jul 01 18:38:19.332171 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.332132 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c15282f-d704-402f-9c7f-cdab63dee14d-maas-api-tls\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.332357 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.332233 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c15282f-d704-402f-9c7f-cdab63dee14d-openshift-service-ca\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.332357 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.332291 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrdwq\" (UniqueName: \"kubernetes.io/projected/5c15282f-d704-402f-9c7f-cdab63dee14d-kube-api-access-nrdwq\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.433292 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.433248 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c15282f-d704-402f-9c7f-cdab63dee14d-maas-api-tls\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.433502 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.433342 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c15282f-d704-402f-9c7f-cdab63dee14d-openshift-service-ca\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.433502 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.433402 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrdwq\" (UniqueName: \"kubernetes.io/projected/5c15282f-d704-402f-9c7f-cdab63dee14d-kube-api-access-nrdwq\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.433502 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:38:19.433403 2574 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 01 18:38:19.433681 ip-10-0-128-190 kubenswrapper[2574]: E0701 18:38:19.433524 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c15282f-d704-402f-9c7f-cdab63dee14d-maas-api-tls podName:5c15282f-d704-402f-9c7f-cdab63dee14d nodeName:}" failed. No retries permitted until 2026-07-01 18:38:19.933499855 +0000 UTC m=+644.868271652 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5c15282f-d704-402f-9c7f-cdab63dee14d-maas-api-tls") pod "maas-api-798549b7b7-59mw6" (UID: "5c15282f-d704-402f-9c7f-cdab63dee14d") : secret "maas-api-serving-cert" not found Jul 01 18:38:19.434015 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.433996 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c15282f-d704-402f-9c7f-cdab63dee14d-openshift-service-ca\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.445370 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.445304 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrdwq\" (UniqueName: \"kubernetes.io/projected/5c15282f-d704-402f-9c7f-cdab63dee14d-kube-api-access-nrdwq\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.650538 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.650502 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:19.845812 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.845712 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:19.895063 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.895027 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:38:19.938171 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.938139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c15282f-d704-402f-9c7f-cdab63dee14d-maas-api-tls\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:19.940566 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:19.940546 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c15282f-d704-402f-9c7f-cdab63dee14d-maas-api-tls\") pod \"maas-api-798549b7b7-59mw6\" (UID: \"5c15282f-d704-402f-9c7f-cdab63dee14d\") " pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:20.159127 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:20.159078 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:20.315002 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:20.314965 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-798549b7b7-59mw6"] Jul 01 18:38:20.318204 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:38:20.318174 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c15282f_d704_402f_9c7f_cdab63dee14d.slice/crio-6c4cf8ea6ee273249ddbc3495cb49a920dcd7fc4f9680c78d272b074e8862529 WatchSource:0}: Error finding container 6c4cf8ea6ee273249ddbc3495cb49a920dcd7fc4f9680c78d272b074e8862529: Status 404 returned error can't find the container with id 6c4cf8ea6ee273249ddbc3495cb49a920dcd7fc4f9680c78d272b074e8862529 Jul 01 18:38:20.513011 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:20.512923 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-798549b7b7-59mw6" event={"ID":"5c15282f-d704-402f-9c7f-cdab63dee14d","Type":"ContainerStarted","Data":"6c4cf8ea6ee273249ddbc3495cb49a920dcd7fc4f9680c78d272b074e8862529"} Jul 01 18:38:22.522995 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:22.522954 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-798549b7b7-59mw6" event={"ID":"5c15282f-d704-402f-9c7f-cdab63dee14d","Type":"ContainerStarted","Data":"22b85011320b4e7ce4710824516f3d470b92a10571588f887db15e7b6f3edee1"} Jul 01 18:38:22.523455 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:22.523024 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:22.543685 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:22.543629 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-798549b7b7-59mw6" podStartSLOduration=1.450907451 podStartE2EDuration="3.543611872s" totalImagesPullingTime="2.092704421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:38:22.542645069 +0000 UTC m=+647.477416871" watchObservedRunningTime="2026-07-01 18:38:22.543611872 +0000 UTC m=+647.478383674" Jul 01 18:38:28.534197 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:28.534164 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-798549b7b7-59mw6" Jul 01 18:38:47.363979 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:47.363942 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:38:55.165618 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:38:55.165582 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:10.763957 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:10.763926 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:10.876975 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:10.876942 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:18.870915 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:18.870875 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:19.443335 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:19.443292 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:39:31.723345 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.723269 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-t6njg"] Jul 01 18:39:31.726658 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.726640 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.729281 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.729258 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-7tk72\"" Jul 01 18:39:31.729456 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.729421 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 01 18:39:31.729549 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.729494 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 01 18:39:31.729549 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.729424 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 01 18:39:31.741456 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.741430 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-t6njg"] Jul 01 18:39:31.761916 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.761879 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:31.786520 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.786485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.786686 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.786523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.786686 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.786679 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47750c86-d70b-4618-a77b-3c6d23ee3c06-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.786829 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.786705 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.786829 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.786729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5p7z\" (UniqueName: \"kubernetes.io/projected/47750c86-d70b-4618-a77b-3c6d23ee3c06-kube-api-access-v5p7z\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.887465 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.887432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47750c86-d70b-4618-a77b-3c6d23ee3c06-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.887465 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.887467 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.887693 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.887487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5p7z\" (UniqueName: \"kubernetes.io/projected/47750c86-d70b-4618-a77b-3c6d23ee3c06-kube-api-access-v5p7z\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.887693 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.887515 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.887693 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.887531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.888010 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.887991 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.888010 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.888005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.889834 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.889807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/47750c86-d70b-4618-a77b-3c6d23ee3c06-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.889967 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.889951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47750c86-d70b-4618-a77b-3c6d23ee3c06-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:31.895911 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:31.895889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5p7z\" (UniqueName: \"kubernetes.io/projected/47750c86-d70b-4618-a77b-3c6d23ee3c06-kube-api-access-v5p7z\") pod \"e2e-distinct-simulated-kserve-ff95456df-t6njg\" (UID: \"47750c86-d70b-4618-a77b-3c6d23ee3c06\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:32.036175 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:32.036076 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:32.169509 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:32.169481 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-t6njg"] Jul 01 18:39:32.171974 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:39:32.171943 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47750c86_d70b_4618_a77b_3c6d23ee3c06.slice/crio-ec9419188414120768d5453b8e165174843ee13d586f79059f38dc3dcc36d2cc WatchSource:0}: Error finding container ec9419188414120768d5453b8e165174843ee13d586f79059f38dc3dcc36d2cc: Status 404 returned error can't find the container with id ec9419188414120768d5453b8e165174843ee13d586f79059f38dc3dcc36d2cc Jul 01 18:39:32.337016 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:32.336929 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:39:32.832670 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:32.832634 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" event={"ID":"47750c86-d70b-4618-a77b-3c6d23ee3c06","Type":"ContainerStarted","Data":"ec9419188414120768d5453b8e165174843ee13d586f79059f38dc3dcc36d2cc"} Jul 01 18:39:33.838707 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:33.838670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" event={"ID":"47750c86-d70b-4618-a77b-3c6d23ee3c06","Type":"ContainerStarted","Data":"3eb230b44833eb834add75dc78ce3b8388af848d53e9bfdb73acb38e5bc8a51e"} Jul 01 18:39:33.866077 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:33.866012 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" podStartSLOduration=1.87271804 podStartE2EDuration="2.865989345s" totalImagesPullingTime="993.271305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:33.862856842 +0000 UTC m=+718.797628646" watchObservedRunningTime="2026-07-01 18:39:33.865989345 +0000 UTC m=+718.800761148" Jul 01 18:39:35.931255 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:35.931206 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:40.341174 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.341137 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm"] Jul 01 18:39:40.344662 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.344642 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.347747 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.347725 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 01 18:39:40.358671 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.358645 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm"] Jul 01 18:39:40.387457 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.387420 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:40.470413 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.470372 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b448t\" (UniqueName: \"kubernetes.io/projected/23acdaac-c693-43cd-96ea-19eeaaadc134-kube-api-access-b448t\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.470614 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.470459 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.470614 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.470515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23acdaac-c693-43cd-96ea-19eeaaadc134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.470614 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.470548 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.470614 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.470569 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.571364 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.571329 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23acdaac-c693-43cd-96ea-19eeaaadc134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.571626 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.571375 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.571626 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.571400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.571626 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.571432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b448t\" (UniqueName: \"kubernetes.io/projected/23acdaac-c693-43cd-96ea-19eeaaadc134-kube-api-access-b448t\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.571626 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.571488 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.571953 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.571930 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.572018 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.571959 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.573672 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.573647 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23acdaac-c693-43cd-96ea-19eeaaadc134-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.573918 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.573897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23acdaac-c693-43cd-96ea-19eeaaadc134-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.581150 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.581120 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b448t\" (UniqueName: \"kubernetes.io/projected/23acdaac-c693-43cd-96ea-19eeaaadc134-kube-api-access-b448t\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm\" (UID: \"23acdaac-c693-43cd-96ea-19eeaaadc134\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.654743 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.654712 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:40.790446 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.790421 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm"] Jul 01 18:39:40.792673 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:39:40.792646 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23acdaac_c693_43cd_96ea_19eeaaadc134.slice/crio-3460b78923368e234f20125ab836a55cca99bd22afad8c7f46f9e29a59f5d955 WatchSource:0}: Error finding container 3460b78923368e234f20125ab836a55cca99bd22afad8c7f46f9e29a59f5d955: Status 404 returned error can't find the container with id 3460b78923368e234f20125ab836a55cca99bd22afad8c7f46f9e29a59f5d955 Jul 01 18:39:40.869724 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:40.869688 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" event={"ID":"23acdaac-c693-43cd-96ea-19eeaaadc134","Type":"ContainerStarted","Data":"3460b78923368e234f20125ab836a55cca99bd22afad8c7f46f9e29a59f5d955"} Jul 01 18:39:41.232100 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:41.232065 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:39:41.876014 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:41.875980 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" event={"ID":"23acdaac-c693-43cd-96ea-19eeaaadc134","Type":"ContainerStarted","Data":"51f1090d6ff6e8f61ba13e701b32d0adc6c9197888612c733cc7e62ab2876b9f"} Jul 01 18:39:41.895096 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:41.895040 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" podStartSLOduration=1.70314642 podStartE2EDuration="1.895022862s" totalImagesPullingTime="191.876442ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-01 18:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:39:41.894220992 +0000 UTC m=+726.828992819" watchObservedRunningTime="2026-07-01 18:39:41.895022862 +0000 UTC m=+726.829794664" Jul 01 18:39:42.036595 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:42.036553 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:42.036838 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:42.036649 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:42.049110 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:42.049084 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:42.891654 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:42.891627 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-t6njg" Jul 01 18:39:47.762123 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:47.762086 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:48.531653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:48.531615 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:39:50.655697 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:50.655654 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:50.656174 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:50.655718 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:50.668044 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:50.668015 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:50.926686 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:50.926608 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm" Jul 01 18:39:51.566905 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:51.566867 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:39:52.831007 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:52.830960 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:39:59.837368 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:39:59.837333 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:40:01.233511 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:40:01.233473 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-6jl5d"] Jul 01 18:41:13.328022 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:41:13.327923 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:41:20.424272 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:41:20.424217 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:41:44.369302 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:41:44.369261 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:41:46.003137 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:41:46.003098 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:41:46.090130 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:41:46.090096 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:41:47.172260 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:41:47.172223 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:41:47.276003 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:41:47.275968 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:42:16.307095 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:16.307046 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:42:29.969980 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:29.969902 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84b695bfbb-dfwl2_a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7/nginx/0.log" Jul 01 18:42:30.448600 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:30.448569 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-798549b7b7-59mw6_5c15282f-d704-402f-9c7f-cdab63dee14d/maas-api/0.log" Jul 01 18:42:31.177969 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:31.177936 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-xwbdc_9dd0c94f-3a59-4356-bb4b-03d4b3ebf767/copy-manifests/0.log" Jul 01 18:42:31.186023 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:31.185997 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-xwbdc_9dd0c94f-3a59-4356-bb4b-03d4b3ebf767/manager/0.log" Jul 01 18:42:33.311033 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:33.310993 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6jl5d_eaf837ba-39e8-42c1-a35d-5c4c1d26b289/limitador/0.log" Jul 01 18:42:33.897018 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:33.896988 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fh5s2_196d4de1-8b7a-446b-ad7e-cb1904919c60/discovery/0.log" Jul 01 18:42:35.033297 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:35.033269 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-ff95456df-t6njg_47750c86-d70b-4618-a77b-3c6d23ee3c06/main/0.log" Jul 01 18:42:35.143024 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:35.142999 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-74dcdbf7f6-7sgkm_23acdaac-c693-43cd-96ea-19eeaaadc134/main/0.log" Jul 01 18:42:39.313881 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:39.313840 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:42:39.409968 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:39.409928 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:42:42.419328 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:42.419289 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sjcfw_16343865-65ff-4e09-a37f-d7ba4939141a/global-pull-secret-syncer/0.log" Jul 01 18:42:42.540279 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:42.540252 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" Jul 01 18:42:42.658368 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:42.658340 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-190.ec2.internal_00432cb5944b7b354bb07d8bbaf4574d/haproxy/0.log" Jul 01 18:42:47.529125 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:47.529087 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-6jl5d_eaf837ba-39e8-42c1-a35d-5c4c1d26b289/limitador/0.log" Jul 01 18:42:49.124728 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.124702 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b24b23bc-baf3-4158-93f2-d4848142cdf3/alertmanager/0.log" Jul 01 18:42:49.152347 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.152318 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b24b23bc-baf3-4158-93f2-d4848142cdf3/config-reloader/0.log" Jul 01 18:42:49.177251 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.177223 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b24b23bc-baf3-4158-93f2-d4848142cdf3/kube-rbac-proxy-web/0.log" Jul 01 18:42:49.201773 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.201741 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b24b23bc-baf3-4158-93f2-d4848142cdf3/kube-rbac-proxy/0.log" Jul 01 18:42:49.229268 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.229237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b24b23bc-baf3-4158-93f2-d4848142cdf3/kube-rbac-proxy-metric/0.log" Jul 01 18:42:49.254877 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.254851 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b24b23bc-baf3-4158-93f2-d4848142cdf3/prom-label-proxy/0.log" Jul 01 18:42:49.281087 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.281064 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_b24b23bc-baf3-4158-93f2-d4848142cdf3/init-config-reloader/0.log" Jul 01 18:42:49.456505 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.456483 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7895c6b6c9-s5sqm_6ffd5d68-0bc1-497e-9a44-e2b9a4cf6771/metrics-server/0.log" Jul 01 18:42:49.483630 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.483602 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-cd8656b8-mmmtc_e632116e-076d-40c0-b9a2-7b4f8315b8de/monitoring-plugin/0.log" Jul 01 18:42:49.621563 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.621532 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f5whm_780ab5db-e848-4a39-a93a-cbc862f05810/node-exporter/0.log" Jul 01 18:42:49.655108 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.655082 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f5whm_780ab5db-e848-4a39-a93a-cbc862f05810/kube-rbac-proxy/0.log" Jul 01 18:42:49.699653 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.699631 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f5whm_780ab5db-e848-4a39-a93a-cbc862f05810/init-textfile/0.log" Jul 01 18:42:49.944313 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.944285 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e63f4a1d-0e36-46ba-a4a3-7162bf80f75c/prometheus/0.log" Jul 01 18:42:49.969306 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.969277 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e63f4a1d-0e36-46ba-a4a3-7162bf80f75c/config-reloader/0.log" Jul 01 18:42:49.993521 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:49.993496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e63f4a1d-0e36-46ba-a4a3-7162bf80f75c/thanos-sidecar/0.log" Jul 01 18:42:50.023094 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:50.023019 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e63f4a1d-0e36-46ba-a4a3-7162bf80f75c/kube-rbac-proxy-web/0.log" Jul 01 18:42:50.048080 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:50.048045 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e63f4a1d-0e36-46ba-a4a3-7162bf80f75c/kube-rbac-proxy/0.log" Jul 01 18:42:50.071522 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:50.071496 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e63f4a1d-0e36-46ba-a4a3-7162bf80f75c/kube-rbac-proxy-thanos/0.log" Jul 01 18:42:50.097468 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:50.097446 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e63f4a1d-0e36-46ba-a4a3-7162bf80f75c/init-config-reloader/0.log" Jul 01 18:42:52.586842 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.586809 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh"] Jul 01 18:42:52.590273 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.590247 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.592660 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.592640 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ljr9\"/\"openshift-service-ca.crt\"" Jul 01 18:42:52.593108 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.593085 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9ljr9\"/\"default-dockercfg-4r7cl\"" Jul 01 18:42:52.593225 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.593085 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9ljr9\"/\"kube-root-ca.crt\"" Jul 01 18:42:52.603717 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.603692 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh"] Jul 01 18:42:52.706855 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.706818 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-sys\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.706855 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.706861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-lib-modules\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.707083 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.706941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-proc\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.707083 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.706973 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmt8x\" (UniqueName: \"kubernetes.io/projected/a0128080-9557-4ea6-b6c0-871500ae2f4d-kube-api-access-rmt8x\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.707083 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.707028 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-podres\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808139 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-podres\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808139 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808151 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-sys\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808415 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-sys\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808415 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808269 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-lib-modules\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808415 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808288 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-podres\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808415 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808383 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-proc\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808601 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808421 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmt8x\" (UniqueName: \"kubernetes.io/projected/a0128080-9557-4ea6-b6c0-871500ae2f4d-kube-api-access-rmt8x\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808601 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808392 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-lib-modules\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.808601 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.808483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0128080-9557-4ea6-b6c0-871500ae2f4d-proc\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.825269 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.825222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmt8x\" (UniqueName: \"kubernetes.io/projected/a0128080-9557-4ea6-b6c0-871500ae2f4d-kube-api-access-rmt8x\") pod \"perf-node-gather-daemonset-bz8rh\" (UID: \"a0128080-9557-4ea6-b6c0-871500ae2f4d\") " pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.899943 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.899904 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:52.968110 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:52.968069 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5499b6fb8f-k6jd9_d1eed9c5-5d64-42f9-b679-c4fd0220fad5/download-server/0.log" Jul 01 18:42:53.035313 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:53.035281 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh"] Jul 01 18:42:53.038575 ip-10-0-128-190 kubenswrapper[2574]: W0701 18:42:53.038545 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda0128080_9557_4ea6_b6c0_871500ae2f4d.slice/crio-9963bbb804a50b453eb00f29ce2e280d81e467e69557ab5363d56b560c3582a4 WatchSource:0}: Error finding container 9963bbb804a50b453eb00f29ce2e280d81e467e69557ab5363d56b560c3582a4: Status 404 returned error can't find the container with id 9963bbb804a50b453eb00f29ce2e280d81e467e69557ab5363d56b560c3582a4 Jul 01 18:42:53.736476 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:53.736442 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" event={"ID":"a0128080-9557-4ea6-b6c0-871500ae2f4d","Type":"ContainerStarted","Data":"5e5d2aadf631dba832fc0e0d8d8a1b72e70aa3ff5745f932ff0af8931f62125d"} Jul 01 18:42:53.736988 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:53.736492 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" event={"ID":"a0128080-9557-4ea6-b6c0-871500ae2f4d","Type":"ContainerStarted","Data":"9963bbb804a50b453eb00f29ce2e280d81e467e69557ab5363d56b560c3582a4"} Jul 01 18:42:53.736988 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:53.736573 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:42:53.755819 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:53.755756 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" podStartSLOduration=1.755738224 podStartE2EDuration="1.755738224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-01 18:42:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-01 18:42:53.753600251 +0000 UTC m=+918.688372055" watchObservedRunningTime="2026-07-01 18:42:53.755738224 +0000 UTC m=+918.690510049" Jul 01 18:42:54.591520 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:54.591490 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-28kk8_bb083a92-6ac3-4fd6-8063-f10fa13a0bbc/dns/0.log" Jul 01 18:42:54.615875 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:54.615849 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-28kk8_bb083a92-6ac3-4fd6-8063-f10fa13a0bbc/kube-rbac-proxy/0.log" Jul 01 18:42:54.781888 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:54.781856 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lsgd6_74dd95b0-3118-4585-82a2-d7aadcbcb385/dns-node-resolver/0.log" Jul 01 18:42:55.347678 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:55.347646 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-86df69b785-srmrm_ee845f8f-b4c2-45f3-8475-bbf93e9c6204/registry/0.log" Jul 01 18:42:55.369650 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:55.369609 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-6k2jg_28784f12-79d9-4954-b1e3-522fea8dbdcf/node-ca/0.log" Jul 01 18:42:56.014999 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:56.014951 2574 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4cptw_bdadd096-1f5c-4d29-88ae-2901deac0104/konnectivity-agent/0.log" limit=1024 Jul 01 18:42:56.426065 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:56.426026 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fh5s2_196d4de1-8b7a-446b-ad7e-cb1904919c60/discovery/0.log" Jul 01 18:42:57.220244 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:57.220213 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gw696_08936d22-2399-47bc-a800-6c1e6fa98ce6/serve-healthcheck-canary/0.log" Jul 01 18:42:57.751797 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:57.751765 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-df6bh_3da6963d-9a99-44f9-ae2b-0803806be5c9/kube-rbac-proxy/0.log" Jul 01 18:42:57.773294 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:57.773268 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-df6bh_3da6963d-9a99-44f9-ae2b-0803806be5c9/exporter/0.log" Jul 01 18:42:57.795538 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:57.795510 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-df6bh_3da6963d-9a99-44f9-ae2b-0803806be5c9/extractor/0.log" Jul 01 18:42:59.755553 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:42:59.755525 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9ljr9/perf-node-gather-daemonset-bz8rh" Jul 01 18:43:00.109728 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:00.109647 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-84b695bfbb-dfwl2_a3f5bcf8-f8f4-4d34-9bd5-895ff85951a7/nginx/0.log" Jul 01 18:43:00.221727 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:00.221700 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-798549b7b7-59mw6_5c15282f-d704-402f-9c7f-cdab63dee14d/maas-api/0.log" Jul 01 18:43:00.487879 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:00.487846 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-xwbdc_9dd0c94f-3a59-4356-bb4b-03d4b3ebf767/manager/0.log" Jul 01 18:43:00.510112 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:00.510086 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bfc969986-xwbdc_9dd0c94f-3a59-4356-bb4b-03d4b3ebf767/copy-manifests/0.log" Jul 01 18:43:02.111687 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:02.111657 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-56879d7496-6sf4m_b67cda04-d874-40c0-9a87-efa714e00792/manager/0.log" Jul 01 18:43:02.725256 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:02.725224 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fh5s2_196d4de1-8b7a-446b-ad7e-cb1904919c60/discovery/0.log" Jul 01 18:43:03.915533 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:03.915501 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-fh5s2_196d4de1-8b7a-446b-ad7e-cb1904919c60/discovery/0.log" Jul 01 18:43:07.321622 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:07.321586 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-krnpd_b8523b14-11c8-4379-80f7-daec3bb41afd/migrator/0.log" Jul 01 18:43:07.343859 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:07.343825 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-786f9fbc5-krnpd_b8523b14-11c8-4379-80f7-daec3bb41afd/graceful-termination/0.log" Jul 01 18:43:09.168424 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.168393 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm47g_fd1d5d37-fb35-48f2-a5b4-e220af3d348f/kube-multus-additional-cni-plugins/0.log" Jul 01 18:43:09.192183 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.192158 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm47g_fd1d5d37-fb35-48f2-a5b4-e220af3d348f/egress-router-binary-copy/0.log" Jul 01 18:43:09.222314 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.222285 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm47g_fd1d5d37-fb35-48f2-a5b4-e220af3d348f/cni-plugins/0.log" Jul 01 18:43:09.246409 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.246384 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm47g_fd1d5d37-fb35-48f2-a5b4-e220af3d348f/bond-cni-plugin/0.log" Jul 01 18:43:09.270297 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.270268 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm47g_fd1d5d37-fb35-48f2-a5b4-e220af3d348f/routeoverride-cni/0.log" Jul 01 18:43:09.293476 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.293445 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm47g_fd1d5d37-fb35-48f2-a5b4-e220af3d348f/whereabouts-cni-bincopy/0.log" Jul 01 18:43:09.318015 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.317986 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lm47g_fd1d5d37-fb35-48f2-a5b4-e220af3d348f/whereabouts-cni/0.log" Jul 01 18:43:09.348761 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.348727 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jvljf_b4c3f4ea-0b74-4470-92c3-75ae69b9b2cf/kube-multus/0.log" Jul 01 18:43:09.426209 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.426128 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-947sf_021c38e9-03d2-4dbc-bc8a-064de7a0c62f/network-metrics-daemon/0.log" Jul 01 18:43:09.446796 ip-10-0-128-190 kubenswrapper[2574]: I0701 18:43:09.446755 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-947sf_021c38e9-03d2-4dbc-bc8a-064de7a0c62f/kube-rbac-proxy/0.log"