Jul 16 16:50:46.499923 ip-10-0-136-73 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 16 16:50:46.499935 ip-10-0-136-73 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 16 16:50:46.499957 ip-10-0-136-73 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 16 16:50:46.500232 ip-10-0-136-73 systemd[1]: Failed to start Kubernetes Kubelet. Jul 16 16:50:56.749202 ip-10-0-136-73 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 16 16:50:56.749223 ip-10-0-136-73 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 3788b6dec69246f6871a7b578affdd86 -- Jul 16 16:52:48.631660 ip-10-0-136-73 systemd[1]: Starting Kubernetes Kubelet... Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.051196 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057322 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057336 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057340 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057343 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057357 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057361 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057364 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:49.107138 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057366 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057370 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057374 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057378 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057381 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057384 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057387 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057390 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057393 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057395 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057398 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057407 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057410 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057413 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057416 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057419 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057422 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057425 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057427 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:49.107944 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057430 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057432 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057435 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057438 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057441 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057443 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057446 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057448 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057451 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057454 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057456 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057459 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057462 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057464 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057466 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057469 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057471 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057474 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057477 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057480 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:49.108616 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057482 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057485 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057488 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057490 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057493 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057495 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057498 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057500 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057502 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057505 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057508 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057510 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057513 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057515 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057518 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057520 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057523 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057526 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057528 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:49.109153 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057531 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057533 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057536 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057539 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057541 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057544 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057546 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057549 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057551 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057554 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057557 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057559 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057563 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057567 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057570 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057572 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057576 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057579 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057582 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057585 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:49.109768 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057587 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057590 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057593 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057596 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057599 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057601 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057604 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057606 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057609 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057611 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057614 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057618 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057622 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.057624 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058331 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058337 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058341 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058344 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058361 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058364 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:49.110284 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058367 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058370 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058372 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058376 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058379 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058381 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058384 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058386 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058389 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058392 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058394 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058397 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058400 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058402 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058405 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058408 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058411 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058414 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058416 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058418 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:49.110881 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058421 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058424 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058426 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058429 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058431 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058434 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058437 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058440 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058442 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058445 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058448 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058450 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058453 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058455 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058458 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058460 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058463 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058466 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058469 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058472 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:49.111493 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058474 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058477 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058479 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058482 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058485 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058487 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058490 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058493 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058496 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058499 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058501 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058504 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058506 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058511 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058515 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058518 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058522 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058524 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058527 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:49.112107 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058530 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058532 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058535 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058538 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058541 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058545 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058547 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058550 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058553 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058556 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058560 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058562 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058565 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058568 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058570 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058573 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058575 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058578 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058580 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058583 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:49.112839 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058586 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058588 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058591 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058594 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058596 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058599 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058602 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058604 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058607 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058610 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058613 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058616 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058619 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.058622 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059031 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059036 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059039 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059043 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059046 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059049 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:49.113689 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059052 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059055 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059058 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059061 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059066 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059069 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059072 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059075 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059078 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059081 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059084 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059087 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059091 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059094 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059097 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059099 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059102 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059105 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059108 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:49.114752 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059110 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059113 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059116 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059119 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059122 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059125 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059127 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059130 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059132 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059134 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059137 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059140 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059142 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059145 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059148 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059151 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059154 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059157 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059159 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059162 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:49.115340 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059164 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059167 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059171 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059174 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059177 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059180 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059184 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059186 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059189 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059192 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059194 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059197 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059200 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059202 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059205 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059208 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059210 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059212 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059215 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:49.115942 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059218 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059221 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059224 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059226 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059229 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059231 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059234 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059236 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059239 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059241 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059244 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059247 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059249 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059253 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059255 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059258 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059260 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059263 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059266 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059268 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059271 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:49.116553 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059283 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059285 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059289 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059291 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059294 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059296 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059299 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059302 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059304 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059307 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059310 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059314 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059318 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.059321 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059399 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059412 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059419 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059424 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059428 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059431 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059435 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 16:52:49.117176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059439 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059443 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059446 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059450 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059453 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059456 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059459 2580 flags.go:64] FLAG: --cgroup-root="" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059462 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059465 2580 flags.go:64] FLAG: --client-ca-file="" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059469 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059472 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059476 2580 flags.go:64] FLAG: --cluster-domain="" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059479 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059482 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059485 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059489 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059492 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059495 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059499 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059502 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059505 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059508 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059511 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059514 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 16:52:49.117834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059517 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059521 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059524 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059527 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059530 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059533 2580 flags.go:64] FLAG: --enable-server="true" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059537 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059542 2580 flags.go:64] FLAG: --event-burst="100" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059546 2580 flags.go:64] FLAG: --event-qps="50" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059549 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059553 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059556 2580 flags.go:64] FLAG: --eviction-hard="" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059560 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059563 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059565 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059568 2580 flags.go:64] FLAG: --eviction-soft="" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059571 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059574 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059577 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059580 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059582 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059585 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059588 2580 flags.go:64] FLAG: --feature-gates="" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059591 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059595 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 16:52:49.118458 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059598 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059601 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059604 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059607 2580 flags.go:64] FLAG: --help="false" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059610 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-136-73.ec2.internal" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059613 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059618 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059621 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059624 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059628 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059630 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059633 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059636 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059639 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059642 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059645 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059648 2580 flags.go:64] FLAG: --kube-reserved="" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059650 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059655 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059658 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059661 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059664 2580 flags.go:64] FLAG: --lock-file="" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059667 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059670 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 16:52:49.119184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059673 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059678 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059681 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059683 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059687 2580 flags.go:64] FLAG: --logging-format="text" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059689 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059693 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059695 2580 flags.go:64] FLAG: --manifest-url="" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059698 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059702 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059705 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059709 2580 flags.go:64] FLAG: --max-pods="110" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059712 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059715 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059719 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059722 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059725 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059728 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059731 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059738 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059741 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059744 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059747 2580 flags.go:64] FLAG: --pod-cidr="" Jul 16 16:52:49.242600 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059750 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 16:52:49.142073 ip-10-0-136-73 systemd[1]: Started Kubernetes Kubelet. Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059755 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059758 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059763 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059766 2580 flags.go:64] FLAG: --port="10250" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059769 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059772 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bb341fc6d21c1ab8" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059775 2580 flags.go:64] FLAG: --qos-reserved="" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059778 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059781 2580 flags.go:64] FLAG: --register-node="true" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059784 2580 flags.go:64] FLAG: --register-with-taints="" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059788 2580 flags.go:64] FLAG: --registry-burst="10" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059791 2580 flags.go:64] FLAG: --registry-qps="5" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059793 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059796 2580 flags.go:64] FLAG: --reserved-memory="" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059800 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059803 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059805 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059809 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059811 2580 flags.go:64] FLAG: --runonce="false" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059814 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059817 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059820 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059823 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059829 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059832 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 16:52:49.243795 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059835 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059838 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059841 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059844 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059846 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059849 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059852 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059855 2580 flags.go:64] FLAG: --system-cgroups="" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059858 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059865 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059868 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059871 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059875 2580 flags.go:64] FLAG: --tls-min-version="" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059878 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059881 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059883 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059886 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059889 2580 flags.go:64] FLAG: --v="2" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059893 2580 flags.go:64] FLAG: --version="false" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059897 2580 flags.go:64] FLAG: --vmodule="" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059900 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.059903 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060030 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060034 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:49.244783 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060037 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060040 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060043 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060045 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060048 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060050 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060054 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060057 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060059 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060062 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060065 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060067 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060071 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060075 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060079 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060082 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060085 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060089 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:49.245512 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060092 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060095 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060112 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060115 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060118 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060120 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060123 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060126 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060128 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060131 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060133 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060136 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060139 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060141 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060144 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060146 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060149 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060151 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060154 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060157 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:49.246119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060160 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060163 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060166 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060168 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060171 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060173 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060176 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060179 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060181 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060184 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060186 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060193 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060196 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060198 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060201 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060209 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060212 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060214 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060217 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060220 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:49.246740 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060222 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060225 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060227 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060230 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060233 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060235 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060238 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060240 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060243 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060245 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060247 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060250 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060254 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060256 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060259 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060261 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060265 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060269 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060271 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060274 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:49.247729 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060277 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060279 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060282 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060286 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060288 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060291 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060293 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060296 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060304 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060307 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060309 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060312 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060314 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060317 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060319 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060322 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060324 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060327 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:49.248374 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.060329 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.061377 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.068319 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.068335 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.068361 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.068370 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068425 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068431 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068435 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068438 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068442 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068445 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068449 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068452 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068455 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:49.248993 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068458 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068461 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068464 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068467 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068470 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068472 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068475 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068477 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068480 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068483 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068485 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068488 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068491 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068493 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068496 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068498 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068501 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068503 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068506 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068509 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:49.249482 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068513 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068516 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068518 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068521 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068524 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068526 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068528 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068531 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068533 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068536 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068539 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068541 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068544 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068546 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068549 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068551 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068554 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068557 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068560 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068562 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:49.250112 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068565 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068567 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068573 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068576 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068579 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068582 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068584 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068587 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068589 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068592 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068595 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068598 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068600 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068603 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068606 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068608 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068611 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068613 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068615 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:50.869132 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068620 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068624 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068627 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068630 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068632 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068635 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068637 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068640 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068643 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068645 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068648 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068650 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068654 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068657 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068661 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068665 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068672 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068675 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068678 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:50.870120 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068681 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068684 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068687 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068690 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068709 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068713 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068716 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068719 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068722 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068726 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068728 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068731 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.068736 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068849 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068854 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 16:52:50.870830 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068857 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068860 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068862 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068865 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068868 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068870 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068873 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068876 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068878 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068880 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068883 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068886 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068888 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068892 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068896 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068902 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068905 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068907 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068910 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 16:52:50.871433 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068913 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068915 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068918 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068921 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068923 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068926 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068928 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068931 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068934 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068938 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068941 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068944 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068947 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068949 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068952 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068954 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068957 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068960 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068962 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068965 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 16:52:50.872027 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068967 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068970 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068972 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068974 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068977 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068979 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068983 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068986 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068990 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068992 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068995 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.068998 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069000 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069003 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069005 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069008 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069010 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069013 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069015 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069018 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 16:52:50.872623 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069021 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069023 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069026 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069028 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069031 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069033 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069036 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069038 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069041 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069043 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069045 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069048 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069051 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069053 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069055 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069058 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069060 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069063 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069068 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069071 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 16:52:50.873418 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069075 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069079 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069083 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069086 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069089 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069092 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069094 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069097 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069100 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069102 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069105 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069107 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069110 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069113 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069116 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069118 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069121 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 16:52:50.873995 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:49.069123 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.069128 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.069226 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.074649 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.075976 2580 server.go:1019] "Starting client certificate rotation" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.076078 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.076522 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.080135 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.088361 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.101729 2580 log.go:25] "Validated CRI v1 runtime API" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.103828 2580 log.go:25] "Validated CRI v1 image API" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.104772 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 16:52:50.874612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.109644 2580 fs.go:135] Filesystem UUIDs: map[4a4849c7-951f-49cf-bfaf-febe1593d78a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 dc9d6f1e-03b4-4e7f-9d26-1a113a326193:/dev/nvme0n1p4] Jul 16 16:52:50.875108 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.109659 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 16:52:50.875364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.116036 2580 manager.go:216] Machine: {Timestamp:2026-07-16 16:52:49.113342987 +0000 UTC m=+0.362360104 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3067831 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28488486dff86b0760760e98903ef3 SystemUUID:ec284884-86df-f86b-0760-760e98903ef3 BootID:3788b6de-c692-46f6-871a-7b578affdd86 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:6f:e1:3a:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:6f:e1:3a:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:c6:d4:26:bb:61 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 16:52:50.875364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.116140 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 16:52:50.875364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.116243 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 16:52:50.875364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.117635 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 16:52:50.875364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.119175 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 16:52:50.875364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.119206 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-73.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 16:52:50.875364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.120391 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.120404 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.120412 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.120940 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.121721 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.124422 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.124724 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.124757 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.124773 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.124789 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.124800 2580 kubelet.go:398] "Adding apiserver pod source" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.124810 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.125145 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.125159 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.134489 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.135764 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zfcgs" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136016 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136045 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136612 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136630 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136637 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136642 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136652 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136657 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136665 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136671 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136681 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136689 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136698 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.136703 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.137431 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.137439 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.138513 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-73.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.138514 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.140753 2580 server.go:1268] "Started kubelet" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.140837 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.141181 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.141244 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.142302 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.142793 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-73.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 16:52:50.875689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.143272 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.145689 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zfcgs" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.146971 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.147066 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.147133 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.147481 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.147536 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.147552 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.147536 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.147625 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.147635 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.147854 2580 factory.go:55] Registering systemd factory Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.147867 2580 factory.go:223] Registration of the systemd container factory successfully Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.148138 2580 factory.go:153] Registering CRI-O factory Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.148151 2580 factory.go:223] Registration of the crio container factory successfully Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.148218 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.148236 2580 factory.go:103] Registering Raw factory Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.148246 2580 manager.go:1196] Started watching for new ooms in manager Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.148553 2580 manager.go:349] Starting recovery of all containers Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.148129 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-73.ec2.internal.18c2d3561981d29d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-73.ec2.internal,UID:ip-10-0-136-73.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-73.ec2.internal,},FirstTimestamp:2026-07-16 16:52:49.140724381 +0000 UTC m=+0.389741497,LastTimestamp:2026-07-16 16:52:49.140724381 +0000 UTC m=+0.389741497,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-73.ec2.internal,}" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.157068 2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-73.ec2.internal\" not found" node="ip-10-0-136-73.ec2.internal" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.160810 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.168459 2580 manager.go:354] Recovery completed Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.172905 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.177396 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.177424 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.177438 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.177994 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.178004 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.178018 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.178021 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.179088 2580 policy_none.go:49] "None policy: Start" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.179098 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.179119 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.179129 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.179102 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 16:52:50.876909 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.179158 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.180150 2580 policy_none.go:47] "Start" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.222940 2580 manager.go:337] "Starting Device Plugin manager" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.222969 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.222979 2580 server.go:87] "Starting device plugin registration server" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.223234 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.223246 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.223326 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.223521 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:49.223532 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.229498 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:49.229540 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.740282 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.741752 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.741784 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.741807 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:50.741839 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.744690 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.760720 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.761753 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.761781 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.761791 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.761813 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-73.ec2.internal" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.770795 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-73.ec2.internal" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:50.770815 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-73.ec2.internal\": node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:50.787353 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.842158 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal"] Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.842265 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.843200 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.843243 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.843263 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.844628 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.844732 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.844758 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.845294 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.845323 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.845331 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:50.878147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.845349 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.845361 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.845338 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.846488 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.846508 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.847160 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientMemory" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.847177 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.847185 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeHasSufficientPID" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:50.874823 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-73.ec2.internal\" not found" node="ip-10-0-136-73.ec2.internal" Jul 16 16:52:50.879170 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:50.878851 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-73.ec2.internal\" not found" node="ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.886027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/320e521b0274a0e04ffabbd3c3db7b05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal\" (UID: \"320e521b0274a0e04ffabbd3c3db7b05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.886057 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/320e521b0274a0e04ffabbd3c3db7b05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal\" (UID: \"320e521b0274a0e04ffabbd3c3db7b05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.886078 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6f3facf9c1c8cc108a10ba497ba47ba-config\") pod \"kube-apiserver-proxy-ip-10-0-136-73.ec2.internal\" (UID: \"b6f3facf9c1c8cc108a10ba497ba47ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:50.887726 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.987058 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/320e521b0274a0e04ffabbd3c3db7b05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal\" (UID: \"320e521b0274a0e04ffabbd3c3db7b05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.987086 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/320e521b0274a0e04ffabbd3c3db7b05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal\" (UID: \"320e521b0274a0e04ffabbd3c3db7b05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.987104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6f3facf9c1c8cc108a10ba497ba47ba-config\") pod \"kube-apiserver-proxy-ip-10-0-136-73.ec2.internal\" (UID: \"b6f3facf9c1c8cc108a10ba497ba47ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.987146 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/320e521b0274a0e04ffabbd3c3db7b05-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal\" (UID: \"320e521b0274a0e04ffabbd3c3db7b05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.987166 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b6f3facf9c1c8cc108a10ba497ba47ba-config\") pod \"kube-apiserver-proxy-ip-10-0-136-73.ec2.internal\" (UID: \"b6f3facf9c1c8cc108a10ba497ba47ba\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:50.987146 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/320e521b0274a0e04ffabbd3c3db7b05-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal\" (UID: \"320e521b0274a0e04ffabbd3c3db7b05\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:50.988083 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.091525 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.089084 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.242118 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.177325 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.242118 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.183013 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" Jul 16 16:52:51.242118 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.189775 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.402242 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.290253 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.402242 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.390859 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.575133 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.488561 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:51.575133 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.491581 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.575133 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.512746 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 16:52:51.575133 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.512905 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:52:51.575133 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.512932 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:52:51.575133 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.512932 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 16:52:51.748548 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.586752 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 16:47:50 +0000 UTC" deadline="2028-01-21 09:09:48.66260966 +0000 UTC" Jul 16 16:52:51.748548 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.586779 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13288h16m57.075834046s" Jul 16 16:52:51.748548 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.591908 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.748548 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.692129 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.918119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:51.770116 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6f3facf9c1c8cc108a10ba497ba47ba.slice/crio-0ca0c1b808a966656061037faf8a7878c042b1521b1edae69994b4ee5ad7b8c3 WatchSource:0}: Error finding container 0ca0c1b808a966656061037faf8a7878c042b1521b1edae69994b4ee5ad7b8c3: Status 404 returned error can't find the container with id 0ca0c1b808a966656061037faf8a7878c042b1521b1edae69994b4ee5ad7b8c3 Jul 16 16:52:51.918119 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:51.770360 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod320e521b0274a0e04ffabbd3c3db7b05.slice/crio-cbb54e37027825d91da9f1dec49c2567e5780c88a382ec70ee5294fe9d957b9d WatchSource:0}: Error finding container cbb54e37027825d91da9f1dec49c2567e5780c88a382ec70ee5294fe9d957b9d: Status 404 returned error can't find the container with id cbb54e37027825d91da9f1dec49c2567e5780c88a382ec70ee5294fe9d957b9d Jul 16 16:52:51.918119 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:51.776521 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 16:52:51.918119 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.792615 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:51.918119 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.893041 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:52.064591 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:51.993468 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-73.ec2.internal\" not found" Jul 16 16:52:52.064591 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.012499 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:52.240985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.085149 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" Jul 16 16:52:52.240985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.098158 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:52:52.240985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.099030 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" Jul 16 16:52:52.240985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.108288 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 16:52:52.562941 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.562910 2580 apiserver.go:52] "Watching apiserver" Jul 16 16:52:52.573982 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.573957 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 16:52:52.574342 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.574319 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vvrx9","kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp","openshift-dns/node-resolver-klbb5","openshift-image-registry/node-ca-sxph4","openshift-multus/network-metrics-daemon-bp45h","openshift-network-diagnostics/network-check-target-6n9c5","openshift-network-operator/iptables-alerter-rtzbr","kube-system/konnectivity-agent-vfwdl","openshift-cluster-node-tuning-operator/tuned-hrt25","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal","openshift-multus/multus-additional-cni-plugins-qstln","openshift-multus/multus-fwl75","openshift-ovn-kubernetes/ovnkube-node-k5jjk"] Jul 16 16:52:52.575939 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.575914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:52.576567 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.576005 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:52:52.576955 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.576935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.578061 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.578035 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.579109 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.579088 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.580109 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580088 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gl8d8\"" Jul 16 16:52:52.580109 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580099 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 16:52:52.580280 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580111 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 16:52:52.580280 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580097 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 16:52:52.580280 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580097 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 16:52:52.580542 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580525 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 16:52:52.580717 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580702 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 16:52:52.580877 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580857 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 16:52:52.581002 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580985 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bgqps\"" Jul 16 16:52:52.581058 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.580987 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.581058 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.581028 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 16:52:52.583889 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.583875 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 16:52:52.583984 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.583925 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7cx88\"" Jul 16 16:52:52.584481 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.584463 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:52.584618 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.584584 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:52:52.584712 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.584697 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 16:52:52.585860 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.585607 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:52:52.586028 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.586009 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 16:52:52.586121 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.586036 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 16:52:52.586121 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.586052 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 16:52:52.586121 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.586095 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bv228\"" Jul 16 16:52:52.586935 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.586918 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.587013 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.586986 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:52:52.587906 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.587890 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 16:52:52.587997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.587988 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 16:52:52.588058 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.588035 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-glxlq\"" Jul 16 16:52:52.588360 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.588343 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.589670 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.589650 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.590603 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.590581 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 16:52:52.590692 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.590618 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 16:52:52.590940 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.590920 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 16:52:52.591024 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.590921 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 16:52:52.591024 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.590979 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 16:52:52.591310 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.591292 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.591388 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.591371 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b9svw\"" Jul 16 16:52:52.591985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.591922 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:52.591985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.591958 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 16:52:52.592263 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.592245 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-q97kz\"" Jul 16 16:52:52.592381 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.592361 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:52.593290 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.593272 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-24fp4\"" Jul 16 16:52:52.594054 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.593569 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:52:52.594054 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.593618 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 16:52:52.594054 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.593633 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.594054 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.593860 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 16:52:52.596265 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596245 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-cnibin\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596368 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596273 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3da308f-8883-4d50-bce7-0a07d8b731c3-cni-binary-copy\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596368 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-hostroot\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596368 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20aa97c5-7150-489a-8fed-362759235062-hosts-file\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.596368 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-serviceca\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.596575 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596375 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kblr\" (UniqueName: \"kubernetes.io/projected/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-kube-api-access-9kblr\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.596575 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596431 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-system-cni-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596575 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596480 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-etc-kubernetes\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596575 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596502 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.596575 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596527 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-k8s-cni-cncf-io\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596575 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596570 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-socket-dir-parent\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596592 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-multus-certs\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596616 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx4vq\" (UniqueName: \"kubernetes.io/projected/d3da308f-8883-4d50-bce7-0a07d8b731c3-kube-api-access-sx4vq\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596647 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ljb4\" (UniqueName: \"kubernetes.io/projected/088fb053-f6ca-4786-b9b2-fa2aecf8df41-kube-api-access-6ljb4\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596662 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxtxd\" (UniqueName: \"kubernetes.io/projected/20aa97c5-7150-489a-8fed-362759235062-kube-api-access-kxtxd\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596732 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7brwr\" (UniqueName: \"kubernetes.io/projected/2397c0af-6512-4e92-955b-101a5a49a461-kube-api-access-7brwr\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596806 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-cni-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.596848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596824 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-conf-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596852 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-device-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae9cca3b-0682-44d8-a759-70ebef4ed6a2-agent-certs\") pod \"konnectivity-agent-vfwdl\" (UID: \"ae9cca3b-0682-44d8-a759-70ebef4ed6a2\") " pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae9cca3b-0682-44d8-a759-70ebef4ed6a2-konnectivity-ca\") pod \"konnectivity-agent-vfwdl\" (UID: \"ae9cca3b-0682-44d8-a759-70ebef4ed6a2\") " pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-netns\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596958 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-cni-multus\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.596998 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20aa97c5-7150-489a-8fed-362759235062-tmp-dir\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597018 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-host\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597039 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-os-release\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597061 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-cni-bin\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-registration-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597130 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-sys-fs\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597158 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-kubelet\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.597284 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-daemon-config\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.597920 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597234 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-socket-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.597920 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597877 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-md6bd\"" Jul 16 16:52:52.598003 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.597983 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 16:52:52.598781 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.598748 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 16:52:52.603140 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.603122 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 16:52:52.617644 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.617617 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pvlbj" Jul 16 16:52:52.625299 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.625277 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pvlbj" Jul 16 16:52:52.686278 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.686199 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 16:52:52.697970 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.697937 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-host\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.698131 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.697978 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-registration-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.698131 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698003 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-sys-fs\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.698131 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-host\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.698131 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698074 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-sys-fs\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.698131 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698087 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-registration-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.698131 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-slash\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698144 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-systemd\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698171 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovnkube-config\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-daemon-config\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698245 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-socket-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698269 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-ovn\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-iptables-alerter-script\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698339 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-cnibin\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698373 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3da308f-8883-4d50-bce7-0a07d8b731c3-cni-binary-copy\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698395 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-hostroot\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698403 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-socket-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.698414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698418 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-run\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698422 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-cnibin\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698443 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-kubelet\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698468 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-serviceca\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698474 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-hostroot\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698491 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-system-cni-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698515 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-etc-kubernetes\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-var-lib-kubelet\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698608 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-cni-netd\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698633 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-env-overrides\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698655 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698678 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-var-lib-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-node-log\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.698894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698719 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698722 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovnkube-script-lib\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698751 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-system-cni-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698772 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx4vq\" (UniqueName: \"kubernetes.io/projected/d3da308f-8883-4d50-bce7-0a07d8b731c3-kube-api-access-sx4vq\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698814 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7brwr\" (UniqueName: \"kubernetes.io/projected/2397c0af-6512-4e92-955b-101a5a49a461-kube-api-access-7brwr\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698864 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-etc-kubernetes\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-daemon-config\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae9cca3b-0682-44d8-a759-70ebef4ed6a2-agent-certs\") pod \"konnectivity-agent-vfwdl\" (UID: \"ae9cca3b-0682-44d8-a759-70ebef4ed6a2\") " pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698916 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-serviceca\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698931 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhplq\" (UniqueName: \"kubernetes.io/projected/9fd8ed59-c971-4072-8b19-08ec7c7d913e-kube-api-access-mhplq\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.698937 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3da308f-8883-4d50-bce7-0a07d8b731c3-cni-binary-copy\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-host-slash\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699068 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-cni-binary-copy\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysctl-d\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.699611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699115 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysctl-conf\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699136 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699159 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-etc-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-cni-multus\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699209 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmpkd\" (UniqueName: \"kubernetes.io/projected/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-kube-api-access-bmpkd\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699241 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699277 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-system-cni-dir\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699300 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-os-release\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699318 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-cni-bin\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699314 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-etc-selinux\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699354 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-modprobe-d\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699257 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-cni-multus\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699401 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-os-release\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699415 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-cni-bin\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.700202 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699444 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-systemd\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699478 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-cni-bin\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699500 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699528 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699560 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-kubelet\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699580 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-sys\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8xh7\" (UniqueName: \"kubernetes.io/projected/202c2db5-d772-469c-9053-8270b3348cdc-kube-api-access-c8xh7\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20aa97c5-7150-489a-8fed-362759235062-hosts-file\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699642 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-var-lib-kubelet\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27c86020-4e43-4edb-a525-cc87067db0af-dbus\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699686 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovn-node-metrics-cert\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699718 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-cnibin\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kblr\" (UniqueName: \"kubernetes.io/projected/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-kube-api-access-9kblr\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/202c2db5-d772-469c-9053-8270b3348cdc-etc-tuned\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.700961 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699785 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/20aa97c5-7150-489a-8fed-362759235062-hosts-file\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699811 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/202c2db5-d772-469c-9053-8270b3348cdc-tmp\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-systemd-units\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699860 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-log-socket\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699882 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-k8s-cni-cncf-io\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699940 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysconfig\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699963 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-lib-modules\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699980 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-k8s-cni-cncf-io\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.699987 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27c86020-4e43-4edb-a525-cc87067db0af-kubelet-config\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700035 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-host\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700069 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-socket-dir-parent\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-multus-certs\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ljb4\" (UniqueName: \"kubernetes.io/projected/088fb053-f6ca-4786-b9b2-fa2aecf8df41-kube-api-access-6ljb4\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.701493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700178 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-multus-certs\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700178 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-socket-dir-parent\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700209 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxtxd\" (UniqueName: \"kubernetes.io/projected/20aa97c5-7150-489a-8fed-362759235062-kube-api-access-kxtxd\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700377 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae9cca3b-0682-44d8-a759-70ebef4ed6a2-konnectivity-ca\") pod \"konnectivity-agent-vfwdl\" (UID: \"ae9cca3b-0682-44d8-a759-70ebef4ed6a2\") " pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700442 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-cni-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.700443 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-cni-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.700531 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs podName:2397c0af-6512-4e92-955b-101a5a49a461 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:53.200496 +0000 UTC m=+3.012642746 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs") pod "network-metrics-daemon-bp45h" (UID: "2397c0af-6512-4e92-955b-101a5a49a461") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-conf-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700580 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-device-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700606 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-kubernetes\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700630 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.701997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700645 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-multus-conf-dir\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5pvv\" (UniqueName: \"kubernetes.io/projected/e950fbbf-eec7-444e-8931-97364a85ccee-kube-api-access-r5pvv\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700677 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/088fb053-f6ca-4786-b9b2-fa2aecf8df41-device-dir\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700685 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-netns\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20aa97c5-7150-489a-8fed-362759235062-tmp-dir\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700792 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3da308f-8883-4d50-bce7-0a07d8b731c3-host-run-netns\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700816 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-run-netns\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700841 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-os-release\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.700940 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae9cca3b-0682-44d8-a759-70ebef4ed6a2-konnectivity-ca\") pod \"konnectivity-agent-vfwdl\" (UID: \"ae9cca3b-0682-44d8-a759-70ebef4ed6a2\") " pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.701495 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20aa97c5-7150-489a-8fed-362759235062-tmp-dir\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.702664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.702646 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae9cca3b-0682-44d8-a759-70ebef4ed6a2-agent-certs\") pod \"konnectivity-agent-vfwdl\" (UID: \"ae9cca3b-0682-44d8-a759-70ebef4ed6a2\") " pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:52:52.709374 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.709348 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx4vq\" (UniqueName: \"kubernetes.io/projected/d3da308f-8883-4d50-bce7-0a07d8b731c3-kube-api-access-sx4vq\") pod \"multus-fwl75\" (UID: \"d3da308f-8883-4d50-bce7-0a07d8b731c3\") " pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.709668 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.709649 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:52.709668 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.709668 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:52.709880 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.709678 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgcxm for pod openshift-network-diagnostics/network-check-target-6n9c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:52.709880 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.709729 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm podName:3cfd8afe-9393-4e0d-8271-37acee2a7eb1 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:53.209712406 +0000 UTC m=+3.021859135 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fgcxm" (UniqueName: "kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm") pod "network-check-target-6n9c5" (UID: "3cfd8afe-9393-4e0d-8271-37acee2a7eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:52.710130 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.710109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kblr\" (UniqueName: \"kubernetes.io/projected/6fd8a22e-e8ee-4b1a-972b-dd45feb99961-kube-api-access-9kblr\") pod \"node-ca-sxph4\" (UID: \"6fd8a22e-e8ee-4b1a-972b-dd45feb99961\") " pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.710987 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.710963 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7brwr\" (UniqueName: \"kubernetes.io/projected/2397c0af-6512-4e92-955b-101a5a49a461-kube-api-access-7brwr\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:52.711840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.711818 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxtxd\" (UniqueName: \"kubernetes.io/projected/20aa97c5-7150-489a-8fed-362759235062-kube-api-access-kxtxd\") pod \"node-resolver-klbb5\" (UID: \"20aa97c5-7150-489a-8fed-362759235062\") " pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.711988 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.711964 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ljb4\" (UniqueName: \"kubernetes.io/projected/088fb053-f6ca-4786-b9b2-fa2aecf8df41-kube-api-access-6ljb4\") pod \"aws-ebs-csi-driver-node-qr5hp\" (UID: \"088fb053-f6ca-4786-b9b2-fa2aecf8df41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.722450 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.722427 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:52.747571 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.747501 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" event={"ID":"320e521b0274a0e04ffabbd3c3db7b05","Type":"ContainerStarted","Data":"cbb54e37027825d91da9f1dec49c2567e5780c88a382ec70ee5294fe9d957b9d"} Jul 16 16:52:52.749157 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.749131 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" event={"ID":"b6f3facf9c1c8cc108a10ba497ba47ba","Type":"ContainerStarted","Data":"0ca0c1b808a966656061037faf8a7878c042b1521b1edae69994b4ee5ad7b8c3"} Jul 16 16:52:52.801435 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-run\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.801435 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801440 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-kubelet\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801465 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-var-lib-kubelet\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801532 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-var-lib-kubelet\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801544 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-run\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801553 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-kubelet\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-cni-netd\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-env-overrides\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801615 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801639 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-var-lib-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801652 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-cni-netd\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.801675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-node-log\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801687 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovnkube-script-lib\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801704 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-var-lib-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801735 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-node-log\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhplq\" (UniqueName: \"kubernetes.io/projected/9fd8ed59-c971-4072-8b19-08ec7c7d913e-kube-api-access-mhplq\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-host-slash\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-cni-binary-copy\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801850 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801858 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysctl-d\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801883 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysctl-conf\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801908 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-etc-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801957 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmpkd\" (UniqueName: \"kubernetes.io/projected/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-kube-api-access-bmpkd\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801979 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-system-cni-dir\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.802182 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801996 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysctl-d\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802004 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-modprobe-d\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.801883 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-host-slash\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-systemd\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-cni-bin\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-sys\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802201 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-env-overrides\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802269 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-system-cni-dir\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802306 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8xh7\" (UniqueName: \"kubernetes.io/projected/202c2db5-d772-469c-9053-8270b3348cdc-kube-api-access-c8xh7\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802325 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27c86020-4e43-4edb-a525-cc87067db0af-dbus\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802333 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovnkube-script-lib\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802340 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovn-node-metrics-cert\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.802840 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802385 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-cnibin\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802441 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-cnibin\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802386 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-modprobe-d\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/202c2db5-d772-469c-9053-8270b3348cdc-etc-tuned\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802499 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysctl-conf\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802498 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/202c2db5-d772-469c-9053-8270b3348cdc-tmp\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802536 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-cni-binary-copy\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802539 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-etc-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802541 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-systemd-units\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802563 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802567 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-openvswitch\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802580 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-systemd-units\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802617 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-log-socket\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802619 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.803534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802649 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802662 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-cni-bin\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802703 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-log-socket\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-systemd\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802752 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-sys\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802758 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27c86020-4e43-4edb-a525-cc87067db0af-dbus\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802792 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysconfig\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802894 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-sysconfig\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-lib-modules\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.802967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27c86020-4e43-4edb-a525-cc87067db0af-kubelet-config\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803009 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-host\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27c86020-4e43-4edb-a525-cc87067db0af-kubelet-config\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803074 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-kubernetes\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803079 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-lib-modules\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.804198 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803120 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-host\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803134 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5pvv\" (UniqueName: \"kubernetes.io/projected/e950fbbf-eec7-444e-8931-97364a85ccee-kube-api-access-r5pvv\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803163 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803169 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-run-ovn-kubernetes\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803135 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/202c2db5-d772-469c-9053-8270b3348cdc-etc-kubernetes\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803186 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-run-netns\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803210 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e950fbbf-eec7-444e-8931-97364a85ccee-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-os-release\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.803278 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803282 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-run-netns\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803289 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-slash\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803314 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-systemd\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:52.803334 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret podName:27c86020-4e43-4edb-a525-cc87067db0af nodeName:}" failed. No retries permitted until 2026-07-16 16:52:53.303316227 +0000 UTC m=+3.115462973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret") pod "global-pull-secret-syncer-vvrx9" (UID: "27c86020-4e43-4edb-a525-cc87067db0af") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803341 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e950fbbf-eec7-444e-8931-97364a85ccee-os-release\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.804887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803362 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovnkube-config\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803382 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-systemd\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-ovn\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803395 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-host-slash\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803411 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-iptables-alerter-script\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803481 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9fd8ed59-c971-4072-8b19-08ec7c7d913e-run-ovn\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803903 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovnkube-config\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.803929 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-iptables-alerter-script\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.805051 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/202c2db5-d772-469c-9053-8270b3348cdc-tmp\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.805109 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/202c2db5-d772-469c-9053-8270b3348cdc-etc-tuned\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.805533 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.805155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fd8ed59-c971-4072-8b19-08ec7c7d913e-ovn-node-metrics-cert\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.812513 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.812479 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmpkd\" (UniqueName: \"kubernetes.io/projected/decc38bf-d7d6-4f4d-b7a3-bea0a92f0990-kube-api-access-bmpkd\") pod \"iptables-alerter-rtzbr\" (UID: \"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990\") " pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.813982 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.813953 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8xh7\" (UniqueName: \"kubernetes.io/projected/202c2db5-d772-469c-9053-8270b3348cdc-kube-api-access-c8xh7\") pod \"tuned-hrt25\" (UID: \"202c2db5-d772-469c-9053-8270b3348cdc\") " pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.814309 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.814285 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhplq\" (UniqueName: \"kubernetes.io/projected/9fd8ed59-c971-4072-8b19-08ec7c7d913e-kube-api-access-mhplq\") pod \"ovnkube-node-k5jjk\" (UID: \"9fd8ed59-c971-4072-8b19-08ec7c7d913e\") " pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.814402 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.814336 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5pvv\" (UniqueName: \"kubernetes.io/projected/e950fbbf-eec7-444e-8931-97364a85ccee-kube-api-access-r5pvv\") pod \"multus-additional-cni-plugins-qstln\" (UID: \"e950fbbf-eec7-444e-8931-97364a85ccee\") " pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.856595 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.856557 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:52.891324 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.891291 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fwl75" Jul 16 16:52:52.898937 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.898906 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" Jul 16 16:52:52.899600 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.899575 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3da308f_8883_4d50_bce7_0a07d8b731c3.slice/crio-9cfb3b4a5739ac96b8b14a3e51240b5027b00c272f73bf7fe493cfc46aaa7262 WatchSource:0}: Error finding container 9cfb3b4a5739ac96b8b14a3e51240b5027b00c272f73bf7fe493cfc46aaa7262: Status 404 returned error can't find the container with id 9cfb3b4a5739ac96b8b14a3e51240b5027b00c272f73bf7fe493cfc46aaa7262 Jul 16 16:52:52.907088 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.907060 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod088fb053_f6ca_4786_b9b2_fa2aecf8df41.slice/crio-efaeae7a84e3c1abdd92dbe258581c9a759d56796305a2eff506903a48947b00 WatchSource:0}: Error finding container efaeae7a84e3c1abdd92dbe258581c9a759d56796305a2eff506903a48947b00: Status 404 returned error can't find the container with id efaeae7a84e3c1abdd92dbe258581c9a759d56796305a2eff506903a48947b00 Jul 16 16:52:52.910098 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.910082 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-klbb5" Jul 16 16:52:52.913196 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.913037 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sxph4" Jul 16 16:52:52.919709 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.919674 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:52:52.920585 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.920558 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20aa97c5_7150_489a_8fed_362759235062.slice/crio-ac8bd2e69fd17d7c4745a43182a75ae0c0699f133b69aa99c9a8ba7f0814340d WatchSource:0}: Error finding container ac8bd2e69fd17d7c4745a43182a75ae0c0699f133b69aa99c9a8ba7f0814340d: Status 404 returned error can't find the container with id ac8bd2e69fd17d7c4745a43182a75ae0c0699f133b69aa99c9a8ba7f0814340d Jul 16 16:52:52.922501 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.922475 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd8a22e_e8ee_4b1a_972b_dd45feb99961.slice/crio-907239d76678059a4ea11c866b2d9b75da7d226d0a7c8e1be153b1e97bdac55d WatchSource:0}: Error finding container 907239d76678059a4ea11c866b2d9b75da7d226d0a7c8e1be153b1e97bdac55d: Status 404 returned error can't find the container with id 907239d76678059a4ea11c866b2d9b75da7d226d0a7c8e1be153b1e97bdac55d Jul 16 16:52:52.927791 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.927767 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae9cca3b_0682_44d8_a759_70ebef4ed6a2.slice/crio-6a80fbf0808a8ee4a5dc0e19921498579c576296b3a10c53998f05eb105cf578 WatchSource:0}: Error finding container 6a80fbf0808a8ee4a5dc0e19921498579c576296b3a10c53998f05eb105cf578: Status 404 returned error can't find the container with id 6a80fbf0808a8ee4a5dc0e19921498579c576296b3a10c53998f05eb105cf578 Jul 16 16:52:52.931160 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.931137 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:52:52.937528 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.937502 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hrt25" Jul 16 16:52:52.939314 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.939281 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd8ed59_c971_4072_8b19_08ec7c7d913e.slice/crio-10c2ee58fde0de0c75898072d397c99ade647e71dea4ff3b8bbe511ce07ea7a7 WatchSource:0}: Error finding container 10c2ee58fde0de0c75898072d397c99ade647e71dea4ff3b8bbe511ce07ea7a7: Status 404 returned error can't find the container with id 10c2ee58fde0de0c75898072d397c99ade647e71dea4ff3b8bbe511ce07ea7a7 Jul 16 16:52:52.943936 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.943774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rtzbr" Jul 16 16:52:52.945061 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.945034 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod202c2db5_d772_469c_9053_8270b3348cdc.slice/crio-49ab945f5c3896c956517d17139e4bb402b246e96b78fe5c96d9d25e3e70df7a WatchSource:0}: Error finding container 49ab945f5c3896c956517d17139e4bb402b246e96b78fe5c96d9d25e3e70df7a: Status 404 returned error can't find the container with id 49ab945f5c3896c956517d17139e4bb402b246e96b78fe5c96d9d25e3e70df7a Jul 16 16:52:52.949724 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:52.949706 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qstln" Jul 16 16:52:52.950776 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.950724 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddecc38bf_d7d6_4f4d_b7a3_bea0a92f0990.slice/crio-aaea31bb943e2e9772cfd71eb8043d2360a7504af357f4672fc2b66e5578f16f WatchSource:0}: Error finding container aaea31bb943e2e9772cfd71eb8043d2360a7504af357f4672fc2b66e5578f16f: Status 404 returned error can't find the container with id aaea31bb943e2e9772cfd71eb8043d2360a7504af357f4672fc2b66e5578f16f Jul 16 16:52:52.957684 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:52:52.957660 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode950fbbf_eec7_444e_8931_97364a85ccee.slice/crio-ba503423e32c856eaab6034688d3cae7d31bcd17c7b369c2c3e3b7c9c31938dc WatchSource:0}: Error finding container ba503423e32c856eaab6034688d3cae7d31bcd17c7b369c2c3e3b7c9c31938dc: Status 404 returned error can't find the container with id ba503423e32c856eaab6034688d3cae7d31bcd17c7b369c2c3e3b7c9c31938dc Jul 16 16:52:53.205293 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.205174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:53.205415 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.205326 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:53.205415 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.205393 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs podName:2397c0af-6512-4e92-955b-101a5a49a461 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:54.205378802 +0000 UTC m=+4.017525532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs") pod "network-metrics-daemon-bp45h" (UID: "2397c0af-6512-4e92-955b-101a5a49a461") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:53.306437 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.305859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:53.306437 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.305909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:53.306437 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.306028 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:53.306437 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.306031 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:53.306437 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.306056 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:53.306437 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.306069 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgcxm for pod openshift-network-diagnostics/network-check-target-6n9c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:53.306437 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.306089 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret podName:27c86020-4e43-4edb-a525-cc87067db0af nodeName:}" failed. No retries permitted until 2026-07-16 16:52:54.306070684 +0000 UTC m=+4.118217415 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret") pod "global-pull-secret-syncer-vvrx9" (UID: "27c86020-4e43-4edb-a525-cc87067db0af") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:53.306437 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.306127 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm podName:3cfd8afe-9393-4e0d-8271-37acee2a7eb1 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:54.306110694 +0000 UTC m=+4.118257446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgcxm" (UniqueName: "kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm") pod "network-check-target-6n9c5" (UID: "3cfd8afe-9393-4e0d-8271-37acee2a7eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:53.627698 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.627597 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:47:52 +0000 UTC" deadline="2028-05-01 08:12:30.027441944 +0000 UTC" Jul 16 16:52:53.627698 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.627651 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15711h19m36.399795377s" Jul 16 16:52:53.729508 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.729473 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 16:52:53.744268 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.742657 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:53.744268 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.742828 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:52:53.744268 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.742657 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:53.744268 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:53.743372 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:52:53.767487 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.767451 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerStarted","Data":"ba503423e32c856eaab6034688d3cae7d31bcd17c7b369c2c3e3b7c9c31938dc"} Jul 16 16:52:53.792758 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.792561 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hrt25" event={"ID":"202c2db5-d772-469c-9053-8270b3348cdc","Type":"ContainerStarted","Data":"49ab945f5c3896c956517d17139e4bb402b246e96b78fe5c96d9d25e3e70df7a"} Jul 16 16:52:53.797799 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.797521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sxph4" event={"ID":"6fd8a22e-e8ee-4b1a-972b-dd45feb99961","Type":"ContainerStarted","Data":"907239d76678059a4ea11c866b2d9b75da7d226d0a7c8e1be153b1e97bdac55d"} Jul 16 16:52:53.826426 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.826340 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" event={"ID":"088fb053-f6ca-4786-b9b2-fa2aecf8df41","Type":"ContainerStarted","Data":"efaeae7a84e3c1abdd92dbe258581c9a759d56796305a2eff506903a48947b00"} Jul 16 16:52:53.845770 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.845725 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fwl75" event={"ID":"d3da308f-8883-4d50-bce7-0a07d8b731c3","Type":"ContainerStarted","Data":"9cfb3b4a5739ac96b8b14a3e51240b5027b00c272f73bf7fe493cfc46aaa7262"} Jul 16 16:52:53.869487 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.869452 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" event={"ID":"320e521b0274a0e04ffabbd3c3db7b05","Type":"ContainerDied","Data":"85da03cd9f5f31869b50e7a92e0d58d7e3c449a3aa8faa93f9ed103b6c587b3f"} Jul 16 16:52:53.869487 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.869404 2580 generic.go:356] "Generic (PLEG): container finished" podID="320e521b0274a0e04ffabbd3c3db7b05" containerID="85da03cd9f5f31869b50e7a92e0d58d7e3c449a3aa8faa93f9ed103b6c587b3f" exitCode=0 Jul 16 16:52:53.878803 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.878736 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rtzbr" event={"ID":"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990","Type":"ContainerStarted","Data":"aaea31bb943e2e9772cfd71eb8043d2360a7504af357f4672fc2b66e5578f16f"} Jul 16 16:52:53.895758 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.895719 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"10c2ee58fde0de0c75898072d397c99ade647e71dea4ff3b8bbe511ce07ea7a7"} Jul 16 16:52:53.926895 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.924063 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vfwdl" event={"ID":"ae9cca3b-0682-44d8-a759-70ebef4ed6a2","Type":"ContainerStarted","Data":"6a80fbf0808a8ee4a5dc0e19921498579c576296b3a10c53998f05eb105cf578"} Jul 16 16:52:53.941424 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:53.941355 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-klbb5" event={"ID":"20aa97c5-7150-489a-8fed-362759235062","Type":"ContainerStarted","Data":"ac8bd2e69fd17d7c4745a43182a75ae0c0699f133b69aa99c9a8ba7f0814340d"} Jul 16 16:52:54.214496 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:54.213836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:54.214496 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.214019 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:54.214496 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.214096 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs podName:2397c0af-6512-4e92-955b-101a5a49a461 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.214078411 +0000 UTC m=+6.026225143 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs") pod "network-metrics-daemon-bp45h" (UID: "2397c0af-6512-4e92-955b-101a5a49a461") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:54.315071 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:54.315034 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:54.315260 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:54.315082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:54.316002 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.315214 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:54.316002 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.315511 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret podName:27c86020-4e43-4edb-a525-cc87067db0af nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.315478226 +0000 UTC m=+6.127624962 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret") pod "global-pull-secret-syncer-vvrx9" (UID: "27c86020-4e43-4edb-a525-cc87067db0af") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:54.316002 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.315366 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:54.316002 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.315865 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:54.316002 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.315881 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgcxm for pod openshift-network-diagnostics/network-check-target-6n9c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:54.316002 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.315927 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm podName:3cfd8afe-9393-4e0d-8271-37acee2a7eb1 nodeName:}" failed. No retries permitted until 2026-07-16 16:52:56.315912805 +0000 UTC m=+6.128059537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgcxm" (UniqueName: "kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm") pod "network-check-target-6n9c5" (UID: "3cfd8afe-9393-4e0d-8271-37acee2a7eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:54.628472 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:54.628357 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 16:47:52 +0000 UTC" deadline="2028-05-01 06:29:26.207116798 +0000 UTC" Jul 16 16:52:54.628472 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:54.628421 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15709h36m31.578699434s" Jul 16 16:52:54.744884 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:54.744648 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:54.744884 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:54.744794 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:52:54.961790 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:54.961751 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" event={"ID":"320e521b0274a0e04ffabbd3c3db7b05","Type":"ContainerStarted","Data":"888e599275bc151f7efc1dcae2cb800aa4c952270950eaf1bf000ac93c477a91"} Jul 16 16:52:55.743406 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:55.742699 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:55.743406 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:55.742847 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:52:55.743406 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:55.743232 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:55.743406 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:55.743319 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:52:56.231660 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:56.231549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:56.231818 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.231730 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:56.231818 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.231795 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs podName:2397c0af-6512-4e92-955b-101a5a49a461 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:00.231778079 +0000 UTC m=+10.043924814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs") pod "network-metrics-daemon-bp45h" (UID: "2397c0af-6512-4e92-955b-101a5a49a461") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:52:56.332107 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:56.332066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:56.332301 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:56.332129 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:56.332301 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.332289 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:56.332406 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.332351 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret podName:27c86020-4e43-4edb-a525-cc87067db0af nodeName:}" failed. No retries permitted until 2026-07-16 16:53:00.332333979 +0000 UTC m=+10.144480711 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret") pod "global-pull-secret-syncer-vvrx9" (UID: "27c86020-4e43-4edb-a525-cc87067db0af") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:52:56.332790 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.332769 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:52:56.332866 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.332802 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:52:56.332866 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.332816 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgcxm for pod openshift-network-diagnostics/network-check-target-6n9c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:56.332966 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.332866 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm podName:3cfd8afe-9393-4e0d-8271-37acee2a7eb1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:00.332851784 +0000 UTC m=+10.144998513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgcxm" (UniqueName: "kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm") pod "network-check-target-6n9c5" (UID: "3cfd8afe-9393-4e0d-8271-37acee2a7eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:52:56.744563 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:56.742407 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:56.744563 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:56.742552 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:52:57.742193 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:57.742155 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:57.742400 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:57.742326 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:52:57.742477 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:57.742409 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:57.742477 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:57.742476 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:52:58.742437 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:58.742359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:52:58.742861 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:58.742492 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:52:59.742715 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:59.742680 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:52:59.743176 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:59.742826 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:52:59.743176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:52:59.742960 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:52:59.743176 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:52:59.743045 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:00.267878 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:00.267836 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:00.268444 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.268035 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:53:00.268444 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.268105 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs podName:2397c0af-6512-4e92-955b-101a5a49a461 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:08.268085383 +0000 UTC m=+18.080232135 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs") pod "network-metrics-daemon-bp45h" (UID: "2397c0af-6512-4e92-955b-101a5a49a461") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:53:00.368743 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:00.368699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:00.368915 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:00.368758 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:00.368915 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.368882 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:53:00.368915 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.368888 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:53:00.368915 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.368912 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:53:00.369135 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.368925 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgcxm for pod openshift-network-diagnostics/network-check-target-6n9c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:53:00.369135 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.368952 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret podName:27c86020-4e43-4edb-a525-cc87067db0af nodeName:}" failed. No retries permitted until 2026-07-16 16:53:08.368930759 +0000 UTC m=+18.181077488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret") pod "global-pull-secret-syncer-vvrx9" (UID: "27c86020-4e43-4edb-a525-cc87067db0af") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:53:00.369135 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.369015 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm podName:3cfd8afe-9393-4e0d-8271-37acee2a7eb1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:08.368960056 +0000 UTC m=+18.181106829 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgcxm" (UniqueName: "kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm") pod "network-check-target-6n9c5" (UID: "3cfd8afe-9393-4e0d-8271-37acee2a7eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:53:00.743788 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:00.743366 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:00.743788 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:00.743487 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:01.743417 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:01.742895 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:01.743417 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:01.743041 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:01.743417 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:01.743175 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:01.743417 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:01.743278 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:02.742497 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:02.742459 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:02.742912 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:02.742596 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:03.742146 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:03.742115 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:03.742314 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:03.742116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:03.742314 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:03.742248 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:03.742314 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:03.742299 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:04.742192 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:04.742159 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:04.742673 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:04.742311 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:05.742650 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:05.742610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:05.743102 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:05.742610 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:05.743102 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:05.742734 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:05.743102 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:05.742828 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:06.742746 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:06.742707 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:06.743203 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:06.742849 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:07.742410 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:07.742373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:07.742617 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:07.742373 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:07.742617 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:07.742513 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:07.742617 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:07.742563 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:08.327176 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:08.327133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:08.327638 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.327305 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:53:08.327638 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.327380 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs podName:2397c0af-6512-4e92-955b-101a5a49a461 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:24.327356332 +0000 UTC m=+34.139503062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs") pod "network-metrics-daemon-bp45h" (UID: "2397c0af-6512-4e92-955b-101a5a49a461") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:53:08.427603 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:08.427569 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:08.427778 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:08.427622 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:08.427778 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.427755 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:53:08.427778 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.427760 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:53:08.427941 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.427786 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:53:08.427941 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.427801 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgcxm for pod openshift-network-diagnostics/network-check-target-6n9c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:53:08.427941 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.427824 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret podName:27c86020-4e43-4edb-a525-cc87067db0af nodeName:}" failed. No retries permitted until 2026-07-16 16:53:24.427805971 +0000 UTC m=+34.239952700 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret") pod "global-pull-secret-syncer-vvrx9" (UID: "27c86020-4e43-4edb-a525-cc87067db0af") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:53:08.427941 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.427850 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm podName:3cfd8afe-9393-4e0d-8271-37acee2a7eb1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:24.427834121 +0000 UTC m=+34.239980870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgcxm" (UniqueName: "kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm") pod "network-check-target-6n9c5" (UID: "3cfd8afe-9393-4e0d-8271-37acee2a7eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:53:08.743040 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:08.742947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:08.743181 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:08.743096 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:09.742098 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:09.742063 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:09.742098 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:09.742094 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:09.742606 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:09.742187 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:09.742606 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:09.742349 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:10.742747 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:10.742714 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:10.743374 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:10.742804 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:11.743075 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:11.743032 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:11.743517 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:11.743159 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:11.743517 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:11.743210 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:11.743517 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:11.743333 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:12.745169 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:12.745096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:12.746330 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:12.745942 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:12.999139 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:12.999098 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sxph4" event={"ID":"6fd8a22e-e8ee-4b1a-972b-dd45feb99961","Type":"ContainerStarted","Data":"c96e34ef6041cf059437fa10850955ec919dae3685a156bd1dc602e243952478"} Jul 16 16:53:13.000771 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.000743 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" event={"ID":"088fb053-f6ca-4786-b9b2-fa2aecf8df41","Type":"ContainerStarted","Data":"4b0b8c443c604feeed5ac8560922d5e56c97eaba82ab66f76d90700ad109d8fa"} Jul 16 16:53:13.002372 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.002346 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fwl75" event={"ID":"d3da308f-8883-4d50-bce7-0a07d8b731c3","Type":"ContainerStarted","Data":"fa4dd69ffd234764676e7eeb49106f5365bd52ae03f6b4ddee6195c6760ebc22"} Jul 16 16:53:13.003897 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.003872 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" event={"ID":"b6f3facf9c1c8cc108a10ba497ba47ba","Type":"ContainerStarted","Data":"5db7c528708e9d4b0b6b4f619ddaff166bb0cc1107fe4ae4185b18f9b1e983df"} Jul 16 16:53:13.005559 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.005536 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 16:53:13.005899 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.005878 2580 generic.go:356] "Generic (PLEG): container finished" podID="9fd8ed59-c971-4072-8b19-08ec7c7d913e" containerID="65589ae1477291b42eb7bf16660cc03b0007942eac6a9ee409820d62855f9255" exitCode=1 Jul 16 16:53:13.005975 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.005948 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerDied","Data":"65589ae1477291b42eb7bf16660cc03b0007942eac6a9ee409820d62855f9255"} Jul 16 16:53:13.006060 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.006044 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"b4a2138d50d4c4e441a0c9bbc4b94527ecad0a39a6ace9c55b6e6a7ed89b1608"} Jul 16 16:53:13.007180 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.007157 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vfwdl" event={"ID":"ae9cca3b-0682-44d8-a759-70ebef4ed6a2","Type":"ContainerStarted","Data":"0826bbc4810f4afa1672af6b26e2fcdfd439fe08c24ab76efcc3dc6909b2ad7a"} Jul 16 16:53:13.008446 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.008427 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-klbb5" event={"ID":"20aa97c5-7150-489a-8fed-362759235062","Type":"ContainerStarted","Data":"3957409074f765cf822a75e51e7004be76769627b0fdbe6c9701cf9dd53fc3a0"} Jul 16 16:53:13.009942 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.009919 2580 generic.go:356] "Generic (PLEG): container finished" podID="e950fbbf-eec7-444e-8931-97364a85ccee" containerID="4ef120ad2d0a970ff24699213b1f860a40fdadc2e3935b020b7b52dcd2c9f22b" exitCode=0 Jul 16 16:53:13.010039 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.009981 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerDied","Data":"4ef120ad2d0a970ff24699213b1f860a40fdadc2e3935b020b7b52dcd2c9f22b"} Jul 16 16:53:13.011523 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.011482 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hrt25" event={"ID":"202c2db5-d772-469c-9053-8270b3348cdc","Type":"ContainerStarted","Data":"7a6e34847fe5820fa15659c4d1fc52d413c46ef8a8407d3e658ee86a1b7c58b3"} Jul 16 16:53:13.015936 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.015783 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-73.ec2.internal" podStartSLOduration=21.015765382 podStartE2EDuration="21.015765382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:52:54.984095354 +0000 UTC m=+4.796242310" watchObservedRunningTime="2026-07-16 16:53:13.015765382 +0000 UTC m=+22.827912134" Jul 16 16:53:13.016602 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.016558 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sxph4" podStartSLOduration=3.453554208 podStartE2EDuration="23.016544579s" totalImagesPullingTime="19.562990371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:13.015356797 +0000 UTC m=+22.827503548" watchObservedRunningTime="2026-07-16 16:53:13.016544579 +0000 UTC m=+22.828691333" Jul 16 16:53:13.030616 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.030567 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-73.ec2.internal" podStartSLOduration=21.030550908 podStartE2EDuration="21.030550908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:13.029933787 +0000 UTC m=+22.842080818" watchObservedRunningTime="2026-07-16 16:53:13.030550908 +0000 UTC m=+22.842697658" Jul 16 16:53:13.048664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.048620 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fwl75" podStartSLOduration=3.401595004 podStartE2EDuration="23.048604656s" totalImagesPullingTime="19.647009652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:13.04846414 +0000 UTC m=+22.860610890" watchObservedRunningTime="2026-07-16 16:53:13.048604656 +0000 UTC m=+22.860751407" Jul 16 16:53:13.064174 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.064121 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-klbb5" podStartSLOduration=3.495481872 podStartE2EDuration="23.064104472s" totalImagesPullingTime="19.5686226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:13.063971707 +0000 UTC m=+22.876118457" watchObservedRunningTime="2026-07-16 16:53:13.064104472 +0000 UTC m=+22.876251222" Jul 16 16:53:13.084002 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.083954 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hrt25" podStartSLOduration=3.504442852 podStartE2EDuration="23.083937771s" totalImagesPullingTime="19.579494919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:13.08302857 +0000 UTC m=+22.895175325" watchObservedRunningTime="2026-07-16 16:53:13.083937771 +0000 UTC m=+22.896084522" Jul 16 16:53:13.100457 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.100285 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vfwdl" podStartSLOduration=3.539728171 podStartE2EDuration="23.100268351s" totalImagesPullingTime="19.56054018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:13.100008902 +0000 UTC m=+22.912155652" watchObservedRunningTime="2026-07-16 16:53:13.100268351 +0000 UTC m=+22.912415101" Jul 16 16:53:13.742612 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.742576 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:13.742813 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:13.742576 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:13.742813 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:13.742685 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:13.742813 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:13.742769 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:14.014796 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.014756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rtzbr" event={"ID":"decc38bf-d7d6-4f4d-b7a3-bea0a92f0990","Type":"ContainerStarted","Data":"9117b64fb19c9f098f3106fce5878c9fb7947611b733ce3869075a845a6fc9f2"} Jul 16 16:53:14.017489 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.017464 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 16:53:14.017868 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.017845 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"5275ec613b899efd3541f1e712727811ecbe33bfff1bf2ea7e177d055066c339"} Jul 16 16:53:14.017948 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.017911 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"2a3bb919f8028b7f73e33129984869e5b740c19443b9adabb0222abdbaf5bf89"} Jul 16 16:53:14.017985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.017951 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"471c188e8ce64ef45b8bcf0156545d6015c8bc4e50b69c56db4e1b1edddc225f"} Jul 16 16:53:14.017985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.017979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"0552392bb7a85ec6818b455fdf0b9184b3a3b96f05cb6a509b1bce7ef3b4c7d9"} Jul 16 16:53:14.035396 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.033319 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rtzbr" podStartSLOduration=4.45917899 podStartE2EDuration="24.033300215s" totalImagesPullingTime="19.574121225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:14.033249069 +0000 UTC m=+23.845395812" watchObservedRunningTime="2026-07-16 16:53:14.033300215 +0000 UTC m=+23.845446967" Jul 16 16:53:14.742670 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.742631 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:14.742913 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:14.742766 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:14.935423 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:14.935208 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 16:53:15.022397 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:15.022304 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" event={"ID":"088fb053-f6ca-4786-b9b2-fa2aecf8df41","Type":"ContainerStarted","Data":"29218108434e0197246023e2511d4a4d3e7f569b5992328a895c892beb9ec24d"} Jul 16 16:53:15.674414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:15.674280 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T16:53:14.935415658Z","UUID":"5aceab2c-600e-4b02-9821-a4b62c24a512","Handler":null,"Name":"","Endpoint":""} Jul 16 16:53:15.675951 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:15.675925 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 16:53:15.676082 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:15.675971 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 16:53:15.742880 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:15.742709 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:15.742880 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:15.742757 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:15.742880 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:15.742846 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:15.743331 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:15.743293 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:16.028353 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:16.028279 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 16:53:16.028894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:16.028713 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"8a4d79dda399b87f33e103315e5d7d1f8d7564662579786cf6aaa750a4807c54"} Jul 16 16:53:16.638178 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:16.638151 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:53:16.638724 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:16.638704 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:53:16.742848 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:16.742815 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:16.743027 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:16.742952 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:17.034265 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:17.034170 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" event={"ID":"088fb053-f6ca-4786-b9b2-fa2aecf8df41","Type":"ContainerStarted","Data":"f9ea576af4d648f54e4e55c3a2690195288a7a9ace0f1a985b55b1d0dfb364ee"} Jul 16 16:53:17.034949 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:17.034392 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:53:17.034949 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:17.034841 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vfwdl" Jul 16 16:53:17.059620 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:17.059571 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qr5hp" podStartSLOduration=4.179656377 podStartE2EDuration="27.059557936s" totalImagesPullingTime="22.879901559s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:17.05940759 +0000 UTC m=+26.871554343" watchObservedRunningTime="2026-07-16 16:53:17.059557936 +0000 UTC m=+26.871704687" Jul 16 16:53:17.742977 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:17.742937 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:17.743165 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:17.742935 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:17.743165 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:17.743068 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:17.743165 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:17.743141 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:18.742421 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:18.742381 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:18.742978 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:18.742552 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:19.041316 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.041210 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 16:53:19.041650 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.041619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"406f87b9da35c7a96bc66175974f971b3674b52ef1ec7ad596811d9e48abf161"} Jul 16 16:53:19.041902 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.041883 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:53:19.041984 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.041950 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:53:19.042111 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.042092 2580 scope.go:117] "RemoveContainer" containerID="65589ae1477291b42eb7bf16660cc03b0007942eac6a9ee409820d62855f9255" Jul 16 16:53:19.044586 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.044372 2580 generic.go:356] "Generic (PLEG): container finished" podID="e950fbbf-eec7-444e-8931-97364a85ccee" containerID="2f16bcaa2393bd3104e34d61166551853e143cc3a1ee6f81976a928f300c5772" exitCode=0 Jul 16 16:53:19.044586 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.044533 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerDied","Data":"2f16bcaa2393bd3104e34d61166551853e143cc3a1ee6f81976a928f300c5772"} Jul 16 16:53:19.058726 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.058704 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:53:19.746240 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.742301 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:19.746240 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:19.742440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:19.746240 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:19.742812 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:19.746240 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:19.742892 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:20.051112 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.051043 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 16:53:20.051409 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.051385 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" event={"ID":"9fd8ed59-c971-4072-8b19-08ec7c7d913e","Type":"ContainerStarted","Data":"f374d16acd6476df4f6116a09917f15574226ff79274803a3cb1d88c4513f21c"} Jul 16 16:53:20.051666 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.051640 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:53:20.067052 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.067028 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:53:20.083985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.083930 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" podStartSLOduration=10.379307601 podStartE2EDuration="30.083916977s" totalImagesPullingTime="19.704609376s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:20.082797254 +0000 UTC m=+29.894944004" watchObservedRunningTime="2026-07-16 16:53:20.083916977 +0000 UTC m=+29.896063726" Jul 16 16:53:20.411152 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.410900 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vvrx9"] Jul 16 16:53:20.411385 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.411294 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:20.411441 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:20.411402 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:20.411520 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.411500 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6n9c5"] Jul 16 16:53:20.411601 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.411588 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:20.411690 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:20.411671 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:20.413132 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.413107 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bp45h"] Jul 16 16:53:20.413294 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:20.413196 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:20.413350 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:20.413312 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:21.055513 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:21.055473 2580 generic.go:356] "Generic (PLEG): container finished" podID="e950fbbf-eec7-444e-8931-97364a85ccee" containerID="5e5742bd78a0952125e687e95944382da249d01f8a3687c1dd636ae1c3585457" exitCode=0 Jul 16 16:53:21.056057 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:21.055521 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerDied","Data":"5e5742bd78a0952125e687e95944382da249d01f8a3687c1dd636ae1c3585457"} Jul 16 16:53:21.742646 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:21.742613 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:21.742821 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:21.742726 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:22.061122 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:22.061077 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerStarted","Data":"4bc9eb5e0ba7db60670338939ef865d98426818151b280b7f0258b5cd6ecf222"} Jul 16 16:53:22.742847 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:22.742810 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:22.743029 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:22.742808 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:22.743029 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:22.742921 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:22.743029 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:22.742977 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:23.065958 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:23.065920 2580 generic.go:356] "Generic (PLEG): container finished" podID="e950fbbf-eec7-444e-8931-97364a85ccee" containerID="4bc9eb5e0ba7db60670338939ef865d98426818151b280b7f0258b5cd6ecf222" exitCode=0 Jul 16 16:53:23.066341 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:23.065977 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerDied","Data":"4bc9eb5e0ba7db60670338939ef865d98426818151b280b7f0258b5cd6ecf222"} Jul 16 16:53:23.743128 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:23.742912 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:23.743303 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:23.743240 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6n9c5" podUID="3cfd8afe-9393-4e0d-8271-37acee2a7eb1" Jul 16 16:53:24.344329 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:24.344286 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:24.344791 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.344415 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:53:24.344791 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.344500 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs podName:2397c0af-6512-4e92-955b-101a5a49a461 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:56.344479538 +0000 UTC m=+66.156626281 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs") pod "network-metrics-daemon-bp45h" (UID: "2397c0af-6512-4e92-955b-101a5a49a461") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 16:53:24.444836 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:24.444801 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:24.444836 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:24.444843 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:24.445067 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.444952 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 16:53:24.445067 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.444984 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 16:53:24.445067 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.445006 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 16:53:24.445067 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.445016 2580 projected.go:196] Error preparing data for projected volume kube-api-access-fgcxm for pod openshift-network-diagnostics/network-check-target-6n9c5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:53:24.445238 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.445071 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm podName:3cfd8afe-9393-4e0d-8271-37acee2a7eb1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:56.445053262 +0000 UTC m=+66.257199996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fgcxm" (UniqueName: "kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm") pod "network-check-target-6n9c5" (UID: "3cfd8afe-9393-4e0d-8271-37acee2a7eb1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 16:53:24.445238 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.445088 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret podName:27c86020-4e43-4edb-a525-cc87067db0af nodeName:}" failed. No retries permitted until 2026-07-16 16:53:56.445080282 +0000 UTC m=+66.257227011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret") pod "global-pull-secret-syncer-vvrx9" (UID: "27c86020-4e43-4edb-a525-cc87067db0af") : object "kube-system"/"original-pull-secret" not registered Jul 16 16:53:24.743061 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:24.743029 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:24.743318 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:24.743028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:24.743318 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.743184 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bp45h" podUID="2397c0af-6512-4e92-955b-101a5a49a461" Jul 16 16:53:24.743318 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:24.743254 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vvrx9" podUID="27c86020-4e43-4edb-a525-cc87067db0af" Jul 16 16:53:25.129645 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.129614 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-klbb5_20aa97c5-7150-489a-8fed-362759235062/dns-node-resolver/0.log" Jul 16 16:53:25.468643 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.468565 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-73.ec2.internal" event="NodeReady" Jul 16 16:53:25.469147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.468698 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 16:53:25.519584 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.519547 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xp7r7"] Jul 16 16:53:25.521807 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.521787 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-szmk6"] Jul 16 16:53:25.522031 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.521922 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.523655 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.523636 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.524309 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.524289 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 16:53:25.524419 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.524399 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 16:53:25.524567 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.524547 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pnmxk\"" Jul 16 16:53:25.525659 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.525638 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-njzwt\"" Jul 16 16:53:25.525780 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.525763 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 16:53:25.526174 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.525857 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 16:53:25.526265 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.526175 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 16:53:25.526392 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.526376 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 16:53:25.535413 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.535390 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xp7r7"] Jul 16 16:53:25.535720 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.535700 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szmk6"] Jul 16 16:53:25.541145 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.541013 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9vk2h"] Jul 16 16:53:25.545439 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.545324 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vk2h" Jul 16 16:53:25.548334 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.548306 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 16:53:25.548334 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.548317 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8rxdn\"" Jul 16 16:53:25.548497 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.548366 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 16:53:25.548624 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.548605 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 16:53:25.553094 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.553072 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vk2h"] Jul 16 16:53:25.653820 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.653780 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.653820 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.653821 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.654059 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.653843 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef991e78-1b63-4be6-8085-e2ce75e34b1d-crio-socket\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.654059 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.653923 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef991e78-1b63-4be6-8085-e2ce75e34b1d-data-volume\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.654059 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.653974 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.654059 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.654004 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84968745-2495-402d-b079-4fc7cdcdb979-cert\") pod \"ingress-canary-9vk2h\" (UID: \"84968745-2495-402d-b079-4fc7cdcdb979\") " pod="openshift-ingress-canary/ingress-canary-9vk2h" Jul 16 16:53:25.654059 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.654034 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-tmp-dir\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.654330 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.654098 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hllj\" (UniqueName: \"kubernetes.io/projected/84968745-2495-402d-b079-4fc7cdcdb979-kube-api-access-4hllj\") pod \"ingress-canary-9vk2h\" (UID: \"84968745-2495-402d-b079-4fc7cdcdb979\") " pod="openshift-ingress-canary/ingress-canary-9vk2h" Jul 16 16:53:25.654330 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.654163 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkpvf\" (UniqueName: \"kubernetes.io/projected/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-api-access-qkpvf\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.654330 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.654193 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-config-volume\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.654330 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.654240 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2ksx\" (UniqueName: \"kubernetes.io/projected/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-kube-api-access-v2ksx\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.742745 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.742665 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:25.745427 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.745404 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 16:53:25.745780 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.745758 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6x4n8\"" Jul 16 16:53:25.745892 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.745763 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 16:53:25.755244 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.755359 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.755359 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:25.755295 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:53:25.755359 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755296 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef991e78-1b63-4be6-8085-e2ce75e34b1d-crio-socket\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.755505 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:25.755368 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:26.255347573 +0000 UTC m=+36.067494337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : configmap "kube-rbac-proxy" not found Jul 16 16:53:25.755505 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:25.755432 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:25.755505 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:25.755471 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls podName:69ec21d6-42fd-4fac-aa04-dee1a3cf73d1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:26.255460537 +0000 UTC m=+36.067607276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls") pod "dns-default-xp7r7" (UID: "69ec21d6-42fd-4fac-aa04-dee1a3cf73d1") : secret "dns-default-metrics-tls" not found Jul 16 16:53:25.755505 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755472 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ef991e78-1b63-4be6-8085-e2ce75e34b1d-crio-socket\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.755505 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755432 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef991e78-1b63-4be6-8085-e2ce75e34b1d-data-volume\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.755760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755538 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.755760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84968745-2495-402d-b079-4fc7cdcdb979-cert\") pod \"ingress-canary-9vk2h\" (UID: \"84968745-2495-402d-b079-4fc7cdcdb979\") " pod="openshift-ingress-canary/ingress-canary-9vk2h" Jul 16 16:53:25.755760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755593 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-tmp-dir\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.755760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755620 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hllj\" (UniqueName: \"kubernetes.io/projected/84968745-2495-402d-b079-4fc7cdcdb979-kube-api-access-4hllj\") pod \"ingress-canary-9vk2h\" (UID: \"84968745-2495-402d-b079-4fc7cdcdb979\") " pod="openshift-ingress-canary/ingress-canary-9vk2h" Jul 16 16:53:25.755760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkpvf\" (UniqueName: \"kubernetes.io/projected/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-api-access-qkpvf\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.755760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755697 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ef991e78-1b63-4be6-8085-e2ce75e34b1d-data-volume\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.755760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755684 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-config-volume\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.756089 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755759 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2ksx\" (UniqueName: \"kubernetes.io/projected/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-kube-api-access-v2ksx\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.756089 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:25.755833 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:25.756089 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:25.755899 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:26.255883054 +0000 UTC m=+36.068029784 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:25.756089 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.755960 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-tmp-dir\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.756421 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.756404 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-config-volume\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.760573 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.760554 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84968745-2495-402d-b079-4fc7cdcdb979-cert\") pod \"ingress-canary-9vk2h\" (UID: \"84968745-2495-402d-b079-4fc7cdcdb979\") " pod="openshift-ingress-canary/ingress-canary-9vk2h" Jul 16 16:53:25.766778 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.766745 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkpvf\" (UniqueName: \"kubernetes.io/projected/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-api-access-qkpvf\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:25.767060 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.766992 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hllj\" (UniqueName: \"kubernetes.io/projected/84968745-2495-402d-b079-4fc7cdcdb979-kube-api-access-4hllj\") pod \"ingress-canary-9vk2h\" (UID: \"84968745-2495-402d-b079-4fc7cdcdb979\") " pod="openshift-ingress-canary/ingress-canary-9vk2h" Jul 16 16:53:25.767794 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.767769 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2ksx\" (UniqueName: \"kubernetes.io/projected/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-kube-api-access-v2ksx\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:25.856281 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:25.856237 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vk2h" Jul 16 16:53:26.259559 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.259525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:26.259751 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.259568 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:26.259751 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:26.259664 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:53:26.259751 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:26.259752 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:27.259730501 +0000 UTC m=+37.071877239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : configmap "kube-rbac-proxy" not found Jul 16 16:53:26.259910 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:26.259767 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:26.259910 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:26.259817 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls podName:69ec21d6-42fd-4fac-aa04-dee1a3cf73d1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:27.259801998 +0000 UTC m=+37.071948727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls") pod "dns-default-xp7r7" (UID: "69ec21d6-42fd-4fac-aa04-dee1a3cf73d1") : secret "dns-default-metrics-tls" not found Jul 16 16:53:26.259910 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.259892 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:26.260046 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:26.260010 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:26.260090 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:26.260059 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:27.260044391 +0000 UTC m=+37.072191133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:26.310997 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.310963 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sxph4_6fd8a22e-e8ee-4b1a-972b-dd45feb99961/node-ca/0.log" Jul 16 16:53:26.529152 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.529070 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc"] Jul 16 16:53:26.531051 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.531026 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc" Jul 16 16:53:26.533594 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.533574 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 16:53:26.533694 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.533577 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:53:26.534417 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.534400 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-srdb8\"" Jul 16 16:53:26.540175 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.540150 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc"] Jul 16 16:53:26.631762 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.631734 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm"] Jul 16 16:53:26.633578 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.633556 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.636304 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.636283 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 16:53:26.636423 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.636306 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 16:53:26.636423 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.636325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9vhft\"" Jul 16 16:53:26.636730 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.636591 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:53:26.636730 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.636591 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 16:53:26.643904 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.643886 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm"] Jul 16 16:53:26.663310 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.663285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvqp\" (UniqueName: \"kubernetes.io/projected/a7537baa-1da8-4157-9555-7b20d63227b2-kube-api-access-xjvqp\") pod \"volume-data-source-validator-78495597f6-c4hvc\" (UID: \"a7537baa-1da8-4157-9555-7b20d63227b2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc" Jul 16 16:53:26.732547 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.732502 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl"] Jul 16 16:53:26.734722 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.734699 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.738240 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.737296 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 16 16:53:26.738240 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.737525 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 16 16:53:26.738240 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.737896 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:53:26.738240 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.738070 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 16 16:53:26.738240 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.738113 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-wx9kz\"" Jul 16 16:53:26.742301 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.742279 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:26.742301 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.742293 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:26.744783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.744720 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 16:53:26.745025 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.744937 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-swshv\"" Jul 16 16:53:26.745656 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.745574 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 16:53:26.750895 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.747538 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl"] Jul 16 16:53:26.751661 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.751635 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-lwlph"] Jul 16 16:53:26.754548 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.754530 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv"] Jul 16 16:53:26.754687 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.754668 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.756565 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.756544 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:26.757610 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.757332 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 16 16:53:26.757610 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.757469 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 16 16:53:26.757610 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.757544 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:53:26.757610 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.757587 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-9k9f5\"" Jul 16 16:53:26.757610 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.757593 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 16 16:53:26.759507 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.759488 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 16 16:53:26.759837 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.759816 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 16 16:53:26.760233 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.759913 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 16 16:53:26.760318 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.760304 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kd5w4\"" Jul 16 16:53:26.764038 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.764020 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv"] Jul 16 16:53:26.764325 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.764306 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.764658 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.764639 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-config\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.764926 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.764907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvqp\" (UniqueName: \"kubernetes.io/projected/a7537baa-1da8-4157-9555-7b20d63227b2-kube-api-access-xjvqp\") pod \"volume-data-source-validator-78495597f6-c4hvc\" (UID: \"a7537baa-1da8-4157-9555-7b20d63227b2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc" Jul 16 16:53:26.765386 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.765113 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf69b\" (UniqueName: \"kubernetes.io/projected/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-kube-api-access-tf69b\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.765567 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.765121 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-lwlph"] Jul 16 16:53:26.768100 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.768083 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 16 16:53:26.774372 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.774347 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvqp\" (UniqueName: \"kubernetes.io/projected/a7537baa-1da8-4157-9555-7b20d63227b2-kube-api-access-xjvqp\") pod \"volume-data-source-validator-78495597f6-c4hvc\" (UID: \"a7537baa-1da8-4157-9555-7b20d63227b2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc" Jul 16 16:53:26.841944 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.841911 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc" Jul 16 16:53:26.866187 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866157 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf69b\" (UniqueName: \"kubernetes.io/projected/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-kube-api-access-tf69b\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.866357 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlh8j\" (UniqueName: \"kubernetes.io/projected/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-kube-api-access-nlh8j\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.866357 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:26.866357 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866275 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24ac069c-552e-45af-ad95-5c6068956067-serving-cert\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.866490 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866383 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.866490 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866422 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24ac069c-552e-45af-ad95-5c6068956067-config\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.866490 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866475 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr6jx\" (UniqueName: \"kubernetes.io/projected/0241409e-b894-4a9c-a976-e9f560f91cb6-kube-api-access-dr6jx\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:26.866605 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866590 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.866650 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866627 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.866704 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866688 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-config\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.866760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866716 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24ac069c-552e-45af-ad95-5c6068956067-trusted-ca\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.866760 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.866742 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5kwx\" (UniqueName: \"kubernetes.io/projected/24ac069c-552e-45af-ad95-5c6068956067-kube-api-access-g5kwx\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.867260 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.867236 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-config\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.869080 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.869050 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-serving-cert\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.875378 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.875354 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf69b\" (UniqueName: \"kubernetes.io/projected/35a3e8f0-1a93-4af1-8f04-eb75e003d55f-kube-api-access-tf69b\") pod \"service-ca-operator-7695fc6c8c-hdjsm\" (UID: \"35a3e8f0-1a93-4af1-8f04-eb75e003d55f\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.943416 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.943379 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" Jul 16 16:53:26.967827 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.967798 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24ac069c-552e-45af-ad95-5c6068956067-trusted-ca\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.967943 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.967838 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5kwx\" (UniqueName: \"kubernetes.io/projected/24ac069c-552e-45af-ad95-5c6068956067-kube-api-access-g5kwx\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.967943 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.967929 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlh8j\" (UniqueName: \"kubernetes.io/projected/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-kube-api-access-nlh8j\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.968061 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.967960 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:26.968061 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.967994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24ac069c-552e-45af-ad95-5c6068956067-serving-cert\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.968061 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.968033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.968061 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.968055 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24ac069c-552e-45af-ad95-5c6068956067-config\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.968269 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:26.968073 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:53:26.968269 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.968085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr6jx\" (UniqueName: \"kubernetes.io/projected/0241409e-b894-4a9c-a976-e9f560f91cb6-kube-api-access-dr6jx\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:26.968269 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.968127 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.968269 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:26.968143 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls podName:0241409e-b894-4a9c-a976-e9f560f91cb6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:27.468122171 +0000 UTC m=+37.280268901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls") pod "cluster-samples-operator-65db858894-lnntv" (UID: "0241409e-b894-4a9c-a976-e9f560f91cb6") : secret "samples-operator-tls" not found Jul 16 16:53:26.968804 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.968757 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.968804 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.968783 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/24ac069c-552e-45af-ad95-5c6068956067-config\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.968955 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.968824 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/24ac069c-552e-45af-ad95-5c6068956067-trusted-ca\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.970623 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.970603 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/24ac069c-552e-45af-ad95-5c6068956067-serving-cert\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:26.970732 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.970711 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.979016 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.978988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlh8j\" (UniqueName: \"kubernetes.io/projected/bfc65de4-7e1b-480a-a8db-7aa45c42fbba-kube-api-access-nlh8j\") pod \"kube-storage-version-migrator-operator-799cb7f958-dzqkl\" (UID: \"bfc65de4-7e1b-480a-a8db-7aa45c42fbba\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:26.979106 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.979023 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr6jx\" (UniqueName: \"kubernetes.io/projected/0241409e-b894-4a9c-a976-e9f560f91cb6-kube-api-access-dr6jx\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:26.979106 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:26.979062 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5kwx\" (UniqueName: \"kubernetes.io/projected/24ac069c-552e-45af-ad95-5c6068956067-kube-api-access-g5kwx\") pod \"console-operator-7866497494-lwlph\" (UID: \"24ac069c-552e-45af-ad95-5c6068956067\") " pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:27.048444 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.048354 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" Jul 16 16:53:27.084150 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.084125 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.271342 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.271410 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.271499 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:27.271677 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:27.271761 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:29.271741211 +0000 UTC m=+39.083887942 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:27.272060 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:27.272118 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls podName:69ec21d6-42fd-4fac-aa04-dee1a3cf73d1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:29.272100085 +0000 UTC m=+39.084246835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls") pod "dns-default-xp7r7" (UID: "69ec21d6-42fd-4fac-aa04-dee1a3cf73d1") : secret "dns-default-metrics-tls" not found Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:27.272165 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:53:27.272250 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:27.272196 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:29.272186617 +0000 UTC m=+39.084333350 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : configmap "kube-rbac-proxy" not found Jul 16 16:53:27.301252 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.300957 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm"] Jul 16 16:53:27.303271 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.303248 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl"] Jul 16 16:53:27.305110 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:27.305084 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a3e8f0_1a93_4af1_8f04_eb75e003d55f.slice/crio-642b4983bd07458124ddad53eec3544b22505bf310a03f4f84eb2dd3aa6974db WatchSource:0}: Error finding container 642b4983bd07458124ddad53eec3544b22505bf310a03f4f84eb2dd3aa6974db: Status 404 returned error can't find the container with id 642b4983bd07458124ddad53eec3544b22505bf310a03f4f84eb2dd3aa6974db Jul 16 16:53:27.307665 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:27.307643 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc65de4_7e1b_480a_a8db_7aa45c42fbba.slice/crio-a511cb5b40602cfa5b4b883d00c7c9da83038688010f0d9448afc0fed4a72b05 WatchSource:0}: Error finding container a511cb5b40602cfa5b4b883d00c7c9da83038688010f0d9448afc0fed4a72b05: Status 404 returned error can't find the container with id a511cb5b40602cfa5b4b883d00c7c9da83038688010f0d9448afc0fed4a72b05 Jul 16 16:53:27.307771 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.307740 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc"] Jul 16 16:53:27.311181 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:27.311123 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7537baa_1da8_4157_9555_7b20d63227b2.slice/crio-8aa2b69628cf84b1ee1e4144e245fb3a9bc4891cae91c1fabb1c5761712d64ff WatchSource:0}: Error finding container 8aa2b69628cf84b1ee1e4144e245fb3a9bc4891cae91c1fabb1c5761712d64ff: Status 404 returned error can't find the container with id 8aa2b69628cf84b1ee1e4144e245fb3a9bc4891cae91c1fabb1c5761712d64ff Jul 16 16:53:27.313683 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.313569 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vk2h"] Jul 16 16:53:27.321006 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.320986 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-lwlph"] Jul 16 16:53:27.326637 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:27.326470 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84968745_2495_402d_b079_4fc7cdcdb979.slice/crio-c888568fda2871aa35f300501893a5397775cc69ecb78945fb0278ce31f7f2dd WatchSource:0}: Error finding container c888568fda2871aa35f300501893a5397775cc69ecb78945fb0278ce31f7f2dd: Status 404 returned error can't find the container with id c888568fda2871aa35f300501893a5397775cc69ecb78945fb0278ce31f7f2dd Jul 16 16:53:27.473115 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:27.473092 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:27.473312 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:27.473291 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:53:27.473391 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:27.473378 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls podName:0241409e-b894-4a9c-a976-e9f560f91cb6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:28.473355229 +0000 UTC m=+38.285501981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls") pod "cluster-samples-operator-65db858894-lnntv" (UID: "0241409e-b894-4a9c-a976-e9f560f91cb6") : secret "samples-operator-tls" not found Jul 16 16:53:28.080945 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:28.080908 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vk2h" event={"ID":"84968745-2495-402d-b079-4fc7cdcdb979","Type":"ContainerStarted","Data":"c888568fda2871aa35f300501893a5397775cc69ecb78945fb0278ce31f7f2dd"} Jul 16 16:53:28.084931 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:28.084893 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lwlph" event={"ID":"24ac069c-552e-45af-ad95-5c6068956067","Type":"ContainerStarted","Data":"b9333aac4fcb57c53ef411f5f8a1a8e8abe03903273c46a1fbba9afe235ef542"} Jul 16 16:53:28.088675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:28.087451 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc" event={"ID":"a7537baa-1da8-4157-9555-7b20d63227b2","Type":"ContainerStarted","Data":"8aa2b69628cf84b1ee1e4144e245fb3a9bc4891cae91c1fabb1c5761712d64ff"} Jul 16 16:53:28.092625 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:28.092371 2580 generic.go:356] "Generic (PLEG): container finished" podID="e950fbbf-eec7-444e-8931-97364a85ccee" containerID="e4dbf4157a3476b48fd3b29d416b7d4c659484944747578684ca6a40268041b5" exitCode=0 Jul 16 16:53:28.092625 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:28.092448 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerDied","Data":"e4dbf4157a3476b48fd3b29d416b7d4c659484944747578684ca6a40268041b5"} Jul 16 16:53:28.095334 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:28.095300 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" event={"ID":"bfc65de4-7e1b-480a-a8db-7aa45c42fbba","Type":"ContainerStarted","Data":"a511cb5b40602cfa5b4b883d00c7c9da83038688010f0d9448afc0fed4a72b05"} Jul 16 16:53:28.097201 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:28.096915 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" event={"ID":"35a3e8f0-1a93-4af1-8f04-eb75e003d55f","Type":"ContainerStarted","Data":"642b4983bd07458124ddad53eec3544b22505bf310a03f4f84eb2dd3aa6974db"} Jul 16 16:53:28.483171 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:28.482564 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:28.483171 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:28.482716 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:53:28.483171 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:28.482790 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls podName:0241409e-b894-4a9c-a976-e9f560f91cb6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:30.482761134 +0000 UTC m=+40.294907869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls") pod "cluster-samples-operator-65db858894-lnntv" (UID: "0241409e-b894-4a9c-a976-e9f560f91cb6") : secret "samples-operator-tls" not found Jul 16 16:53:29.104749 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:29.104711 2580 generic.go:356] "Generic (PLEG): container finished" podID="e950fbbf-eec7-444e-8931-97364a85ccee" containerID="c78e366b76be9595350572d336e52b705795cec3610255b96646a559a2b89254" exitCode=0 Jul 16 16:53:29.105435 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:29.104788 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerDied","Data":"c78e366b76be9595350572d336e52b705795cec3610255b96646a559a2b89254"} Jul 16 16:53:29.291713 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:29.291672 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:29.291885 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:29.291742 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:29.291885 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:29.291784 2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 16:53:29.291885 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:29.291842 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:29.291885 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:29.291880 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls podName:69ec21d6-42fd-4fac-aa04-dee1a3cf73d1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:33.29186375 +0000 UTC m=+43.104010505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls") pod "dns-default-xp7r7" (UID: "69ec21d6-42fd-4fac-aa04-dee1a3cf73d1") : secret "dns-default-metrics-tls" not found Jul 16 16:53:29.292076 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:29.291945 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:29.292076 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:29.291966 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:33.291951188 +0000 UTC m=+43.104097920 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : configmap "kube-rbac-proxy" not found Jul 16 16:53:29.292076 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:29.292008 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:29.292076 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:29.292040 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:33.292028341 +0000 UTC m=+43.104175093 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:30.500405 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:30.500374 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:30.500853 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:30.500499 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:53:30.500853 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:30.500555 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls podName:0241409e-b894-4a9c-a976-e9f560f91cb6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:34.500540773 +0000 UTC m=+44.312687502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls") pod "cluster-samples-operator-65db858894-lnntv" (UID: "0241409e-b894-4a9c-a976-e9f560f91cb6") : secret "samples-operator-tls" not found Jul 16 16:53:33.118008 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.117975 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/0.log" Jul 16 16:53:33.118493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.118015 2580 generic.go:356] "Generic (PLEG): container finished" podID="24ac069c-552e-45af-ad95-5c6068956067" containerID="e3308add1d3d59a2c5678b1de1d92a167a1f5e8ee1af93daf7ce3f1eb1dc07ee" exitCode=255 Jul 16 16:53:33.118493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.118088 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lwlph" event={"ID":"24ac069c-552e-45af-ad95-5c6068956067","Type":"ContainerDied","Data":"e3308add1d3d59a2c5678b1de1d92a167a1f5e8ee1af93daf7ce3f1eb1dc07ee"} Jul 16 16:53:33.118493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.118364 2580 scope.go:117] "RemoveContainer" containerID="e3308add1d3d59a2c5678b1de1d92a167a1f5e8ee1af93daf7ce3f1eb1dc07ee" Jul 16 16:53:33.119824 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.119799 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc" event={"ID":"a7537baa-1da8-4157-9555-7b20d63227b2","Type":"ContainerStarted","Data":"b792ec87436eae9f2e0ed1dbacc1a11d5010ae3e4b60dc3e26939151565c5700"} Jul 16 16:53:33.123916 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.123888 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qstln" event={"ID":"e950fbbf-eec7-444e-8931-97364a85ccee","Type":"ContainerStarted","Data":"eb82e6ddb570055011a333487a0776a19dcc13c10a964b0e101d19025b95b44f"} Jul 16 16:53:33.125797 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.125776 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" event={"ID":"bfc65de4-7e1b-480a-a8db-7aa45c42fbba","Type":"ContainerStarted","Data":"eeeeb4324ea9306af518b52da80d92114220d93a247220aa3c9f40047cb8af32"} Jul 16 16:53:33.127241 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.127200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" event={"ID":"35a3e8f0-1a93-4af1-8f04-eb75e003d55f","Type":"ContainerStarted","Data":"79768e79a984a7bd88752c001f040397acd9e8bf70aef7ef51d643bab6a9a00d"} Jul 16 16:53:33.128675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.128653 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vk2h" event={"ID":"84968745-2495-402d-b079-4fc7cdcdb979","Type":"ContainerStarted","Data":"b9cc9e26a31dd72654bbd59bf5a1687b3ef7a889769a10e25cd5855f4cf1f735"} Jul 16 16:53:33.161673 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.161563 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qstln" podStartSLOduration=11.932264313 podStartE2EDuration="43.161542341s" totalImagesPullingTime="31.229278028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:33.159897445 +0000 UTC m=+42.972044198" watchObservedRunningTime="2026-07-16 16:53:33.161542341 +0000 UTC m=+42.973689094" Jul 16 16:53:33.186173 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.183488 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9vk2h" podStartSLOduration=3.043864414 podStartE2EDuration="8.183466574s" totalImagesPullingTime="5.13960216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:33.181290661 +0000 UTC m=+42.993437411" watchObservedRunningTime="2026-07-16 16:53:33.183466574 +0000 UTC m=+42.995613326" Jul 16 16:53:33.201817 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.201768 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" podStartSLOduration=2.037973241 podStartE2EDuration="7.201751848s" totalImagesPullingTime="5.163778607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:33.200897049 +0000 UTC m=+43.013043801" watchObservedRunningTime="2026-07-16 16:53:33.201751848 +0000 UTC m=+43.013898599" Jul 16 16:53:33.242324 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.242256 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" podStartSLOduration=2.08279357 podStartE2EDuration="7.242235247s" totalImagesPullingTime="5.159441677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:33.2413718 +0000 UTC m=+43.053518543" watchObservedRunningTime="2026-07-16 16:53:33.242235247 +0000 UTC m=+43.054382003" Jul 16 16:53:33.242517 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.242485 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-c4hvc" podStartSLOduration=1.741866968 podStartE2EDuration="7.242475843s" totalImagesPullingTime="5.500608875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:33.219593779 +0000 UTC m=+43.031740532" watchObservedRunningTime="2026-07-16 16:53:33.242475843 +0000 UTC m=+43.054622594" Jul 16 16:53:33.324019 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.323982 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:33.324189 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.324101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:33.324189 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.324125 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:33.324189 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:33.324161 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:33.324371 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:33.324244 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:33.324371 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:33.324281 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:41.324257559 +0000 UTC m=+51.136404291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:33.324371 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:33.324307 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls podName:69ec21d6-42fd-4fac-aa04-dee1a3cf73d1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:41.324295925 +0000 UTC m=+51.136442661 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls") pod "dns-default-xp7r7" (UID: "69ec21d6-42fd-4fac-aa04-dee1a3cf73d1") : secret "dns-default-metrics-tls" not found Jul 16 16:53:33.324609 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:33.324589 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ef991e78-1b63-4be6-8085-e2ce75e34b1d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:34.070200 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.070164 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm"] Jul 16 16:53:34.087135 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.087104 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm"] Jul 16 16:53:34.087312 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.087260 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" Jul 16 16:53:34.090136 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.090115 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zfghp\"" Jul 16 16:53:34.090293 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.090139 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 16:53:34.090293 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.090240 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 16:53:34.132570 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.132548 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 16:53:34.132981 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.132957 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/0.log" Jul 16 16:53:34.133024 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.132999 2580 generic.go:356] "Generic (PLEG): container finished" podID="24ac069c-552e-45af-ad95-5c6068956067" containerID="ac050e6ec7826e119ffe9a6015ff538cbffec1ead97fa67c0a2b45dfa03c2b41" exitCode=255 Jul 16 16:53:34.133126 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.133098 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lwlph" event={"ID":"24ac069c-552e-45af-ad95-5c6068956067","Type":"ContainerDied","Data":"ac050e6ec7826e119ffe9a6015ff538cbffec1ead97fa67c0a2b45dfa03c2b41"} Jul 16 16:53:34.133199 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.133160 2580 scope.go:117] "RemoveContainer" containerID="e3308add1d3d59a2c5678b1de1d92a167a1f5e8ee1af93daf7ce3f1eb1dc07ee" Jul 16 16:53:34.133315 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.133297 2580 scope.go:117] "RemoveContainer" containerID="ac050e6ec7826e119ffe9a6015ff538cbffec1ead97fa67c0a2b45dfa03c2b41" Jul 16 16:53:34.133517 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:34.133485 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lwlph_openshift-console-operator(24ac069c-552e-45af-ad95-5c6068956067)\"" pod="openshift-console-operator/console-operator-7866497494-lwlph" podUID="24ac069c-552e-45af-ad95-5c6068956067" Jul 16 16:53:34.232438 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.232401 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgrj\" (UniqueName: \"kubernetes.io/projected/ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee-kube-api-access-2sgrj\") pod \"migrator-7f59b54f6c-ls8hm\" (UID: \"ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" Jul 16 16:53:34.334481 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.334386 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgrj\" (UniqueName: \"kubernetes.io/projected/ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee-kube-api-access-2sgrj\") pod \"migrator-7f59b54f6c-ls8hm\" (UID: \"ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" Jul 16 16:53:34.354574 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.354541 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgrj\" (UniqueName: \"kubernetes.io/projected/ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee-kube-api-access-2sgrj\") pod \"migrator-7f59b54f6c-ls8hm\" (UID: \"ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" Jul 16 16:53:34.396431 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.396377 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" Jul 16 16:53:34.535863 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.535833 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:34.536004 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:34.535975 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:53:34.536041 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:34.536035 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls podName:0241409e-b894-4a9c-a976-e9f560f91cb6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:42.536020396 +0000 UTC m=+52.348167126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls") pod "cluster-samples-operator-65db858894-lnntv" (UID: "0241409e-b894-4a9c-a976-e9f560f91cb6") : secret "samples-operator-tls" not found Jul 16 16:53:34.557558 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:34.557525 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm"] Jul 16 16:53:34.560321 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:34.560295 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce182170_f5f0_4bc2_89ff_65dd1f2bd6ee.slice/crio-2520449dec8a886cd3d266c6a5224d17b6727212324838aa52cf9d34c418ed01 WatchSource:0}: Error finding container 2520449dec8a886cd3d266c6a5224d17b6727212324838aa52cf9d34c418ed01: Status 404 returned error can't find the container with id 2520449dec8a886cd3d266c6a5224d17b6727212324838aa52cf9d34c418ed01 Jul 16 16:53:35.138690 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:35.138654 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" event={"ID":"ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee","Type":"ContainerStarted","Data":"2520449dec8a886cd3d266c6a5224d17b6727212324838aa52cf9d34c418ed01"} Jul 16 16:53:35.140441 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:35.140415 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 16:53:35.140757 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:35.140742 2580 scope.go:117] "RemoveContainer" containerID="ac050e6ec7826e119ffe9a6015ff538cbffec1ead97fa67c0a2b45dfa03c2b41" Jul 16 16:53:35.140913 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:35.140888 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lwlph_openshift-console-operator(24ac069c-552e-45af-ad95-5c6068956067)\"" pod="openshift-console-operator/console-operator-7866497494-lwlph" podUID="24ac069c-552e-45af-ad95-5c6068956067" Jul 16 16:53:37.084953 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:37.084917 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:37.085354 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:37.084974 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:37.085354 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:37.085320 2580 scope.go:117] "RemoveContainer" containerID="ac050e6ec7826e119ffe9a6015ff538cbffec1ead97fa67c0a2b45dfa03c2b41" Jul 16 16:53:37.085479 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:37.085460 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-lwlph_openshift-console-operator(24ac069c-552e-45af-ad95-5c6068956067)\"" pod="openshift-console-operator/console-operator-7866497494-lwlph" podUID="24ac069c-552e-45af-ad95-5c6068956067" Jul 16 16:53:37.149689 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:37.149656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" event={"ID":"ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee","Type":"ContainerStarted","Data":"3f2ff909d28a2af6f3643df75bb3c9bd2ef190fd76806a44177d6dd9f556eea4"} Jul 16 16:53:37.149851 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:37.149707 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" event={"ID":"ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee","Type":"ContainerStarted","Data":"9ba49e15fe0812df0b3e9968b94b226051b93cc63c0c243f816ea914748f29f5"} Jul 16 16:53:37.167741 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:37.167691 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-ls8hm" podStartSLOduration=1.595047323 podStartE2EDuration="3.167679122s" totalImagesPullingTime="1.572631799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:37.166749766 +0000 UTC m=+46.978896517" watchObservedRunningTime="2026-07-16 16:53:37.167679122 +0000 UTC m=+46.979825873" Jul 16 16:53:41.378979 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:41.378938 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:41.379382 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:41.379020 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:41.379382 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:41.379089 2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 16:53:41.379382 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:41.379125 2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 16:53:41.379382 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:41.379155 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls podName:69ec21d6-42fd-4fac-aa04-dee1a3cf73d1 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:57.379138942 +0000 UTC m=+67.191285671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls") pod "dns-default-xp7r7" (UID: "69ec21d6-42fd-4fac-aa04-dee1a3cf73d1") : secret "dns-default-metrics-tls" not found Jul 16 16:53:41.379382 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:41.379170 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls podName:ef991e78-1b63-4be6-8085-e2ce75e34b1d nodeName:}" failed. No retries permitted until 2026-07-16 16:53:57.379163436 +0000 UTC m=+67.191310165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-szmk6" (UID: "ef991e78-1b63-4be6-8085-e2ce75e34b1d") : secret "insights-runtime-extractor-tls" not found Jul 16 16:53:42.588147 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:42.588113 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:42.588559 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:42.588254 2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 16 16:53:42.588559 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:42.588313 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls podName:0241409e-b894-4a9c-a976-e9f560f91cb6 nodeName:}" failed. No retries permitted until 2026-07-16 16:53:58.588298028 +0000 UTC m=+68.400444757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls") pod "cluster-samples-operator-65db858894-lnntv" (UID: "0241409e-b894-4a9c-a976-e9f560f91cb6") : secret "samples-operator-tls" not found Jul 16 16:53:49.742658 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:49.742617 2580 scope.go:117] "RemoveContainer" containerID="ac050e6ec7826e119ffe9a6015ff538cbffec1ead97fa67c0a2b45dfa03c2b41" Jul 16 16:53:50.192294 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:50.192267 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 16:53:50.192449 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:50.192372 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-lwlph" event={"ID":"24ac069c-552e-45af-ad95-5c6068956067","Type":"ContainerStarted","Data":"916fa903e27b9fb55431f0748b2ac05de7954de3385a3c277ce5c004bc32da41"} Jul 16 16:53:50.192661 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:50.192636 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:50.197494 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:50.197469 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-lwlph" Jul 16 16:53:50.234470 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:50.234417 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-lwlph" podStartSLOduration=19.09513434 podStartE2EDuration="24.234401571s" totalImagesPullingTime="5.139267231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:50.215850614 +0000 UTC m=+60.027997366" watchObservedRunningTime="2026-07-16 16:53:50.234401571 +0000 UTC m=+60.046548325" Jul 16 16:53:52.075932 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:52.075901 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-k5jjk" Jul 16 16:53:56.233930 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.233900 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-847bbdfb76-l9dv4"] Jul 16 16:53:56.236813 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.236781 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.238236 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.238193 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg"] Jul 16 16:53:56.239929 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.239903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" Jul 16 16:53:56.240695 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.240677 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-m8s9z\"" Jul 16 16:53:56.240818 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.240758 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 16:53:56.240887 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.240827 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 16:53:56.241377 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.241361 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 16:53:56.242522 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.242499 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 16 16:53:56.242642 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.242624 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ll6qv\"" Jul 16 16:53:56.243039 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.242933 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 16 16:53:56.243039 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.243027 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 16 16:53:56.243255 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.243212 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 16 16:53:56.247124 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.247106 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 16:53:56.254444 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.254423 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-847bbdfb76-l9dv4"] Jul 16 16:53:56.275959 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.275928 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg"] Jul 16 16:53:56.298429 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-image-registry-private-configuration\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.298625 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-trusted-ca\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.298625 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298601 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nck64\" (UniqueName: \"kubernetes.io/projected/4ee5af12-4391-44c3-b5b4-911d34454785-kube-api-access-nck64\") pod \"managed-serviceaccount-addon-agent-5b76f749fb-mt7sg\" (UID: \"4ee5af12-4391-44c3-b5b4-911d34454785\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" Jul 16 16:53:56.298743 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298641 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-bound-sa-token\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.298743 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ee5af12-4391-44c3-b5b4-911d34454785-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b76f749fb-mt7sg\" (UID: \"4ee5af12-4391-44c3-b5b4-911d34454785\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" Jul 16 16:53:56.298743 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298695 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-ca-trust-extracted\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.298743 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298726 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-installation-pull-secrets\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.298929 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-certificates\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.298929 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-tls\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.298929 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.298857 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rs9j\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-kube-api-access-4rs9j\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.358699 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.358671 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-847bbdfb76-l9dv4"] Jul 16 16:53:56.358917 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:53:56.358896 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-4rs9j registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" podUID="5d430453-e3c1-4cbe-b807-ac2c71df9ed5" Jul 16 16:53:56.378590 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.378560 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-689cd77488-8bgjp"] Jul 16 16:53:56.380638 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.380620 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.396400 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.396373 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689cd77488-8bgjp"] Jul 16 16:53:56.400142 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400111 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-trusted-ca\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.400266 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400170 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nck64\" (UniqueName: \"kubernetes.io/projected/4ee5af12-4391-44c3-b5b4-911d34454785-kube-api-access-nck64\") pod \"managed-serviceaccount-addon-agent-5b76f749fb-mt7sg\" (UID: \"4ee5af12-4391-44c3-b5b4-911d34454785\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" Jul 16 16:53:56.400266 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400204 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-bound-sa-token\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.400344 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400272 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ee5af12-4391-44c3-b5b4-911d34454785-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b76f749fb-mt7sg\" (UID: \"4ee5af12-4391-44c3-b5b4-911d34454785\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" Jul 16 16:53:56.400344 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-ca-trust-extracted\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.400344 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400329 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-installation-pull-secrets\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.400631 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400604 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-certificates\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.400799 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400780 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:56.400950 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-tls\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.401150 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.401130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rs9j\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-kube-api-access-4rs9j\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.401316 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.401299 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-image-registry-private-configuration\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.401488 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.400784 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-ca-trust-extracted\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.401561 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.401515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-trusted-ca\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.401618 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.401587 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-certificates\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.403072 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.403048 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-installation-pull-secrets\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.403164 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.403133 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 16:53:56.403309 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.403288 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4ee5af12-4391-44c3-b5b4-911d34454785-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b76f749fb-mt7sg\" (UID: \"4ee5af12-4391-44c3-b5b4-911d34454785\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" Jul 16 16:53:56.403582 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.403561 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-image-registry-private-configuration\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.403699 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.403685 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-tls\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.413387 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.413360 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2397c0af-6512-4e92-955b-101a5a49a461-metrics-certs\") pod \"network-metrics-daemon-bp45h\" (UID: \"2397c0af-6512-4e92-955b-101a5a49a461\") " pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:56.422041 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.422012 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rs9j\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-kube-api-access-4rs9j\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.422139 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.422121 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nck64\" (UniqueName: \"kubernetes.io/projected/4ee5af12-4391-44c3-b5b4-911d34454785-kube-api-access-nck64\") pod \"managed-serviceaccount-addon-agent-5b76f749fb-mt7sg\" (UID: \"4ee5af12-4391-44c3-b5b4-911d34454785\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" Jul 16 16:53:56.423422 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.423406 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-bound-sa-token\") pod \"image-registry-847bbdfb76-l9dv4\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:56.462565 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.462540 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-swshv\"" Jul 16 16:53:56.471605 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.471583 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bp45h" Jul 16 16:53:56.502173 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:56.502173 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502139 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-registry-tls\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.502173 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:56.502442 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502295 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/208c6c75-4bdd-4022-9c80-8c869242ebe1-ca-trust-extracted\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.502442 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502322 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/208c6c75-4bdd-4022-9c80-8c869242ebe1-installation-pull-secrets\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.502442 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/208c6c75-4bdd-4022-9c80-8c869242ebe1-trusted-ca\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.502442 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502419 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/208c6c75-4bdd-4022-9c80-8c869242ebe1-registry-certificates\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.502610 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502463 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/208c6c75-4bdd-4022-9c80-8c869242ebe1-image-registry-private-configuration\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.502610 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfz2h\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-kube-api-access-lfz2h\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.502610 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.502522 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-bound-sa-token\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.504594 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.504573 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 16:53:56.504716 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.504629 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 16:53:56.514704 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.514677 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27c86020-4e43-4edb-a525-cc87067db0af-original-pull-secret\") pod \"global-pull-secret-syncer-vvrx9\" (UID: \"27c86020-4e43-4edb-a525-cc87067db0af\") " pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:56.515654 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.515633 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 16:53:56.525860 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.525831 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgcxm\" (UniqueName: \"kubernetes.io/projected/3cfd8afe-9393-4e0d-8271-37acee2a7eb1-kube-api-access-fgcxm\") pod \"network-check-target-6n9c5\" (UID: \"3cfd8afe-9393-4e0d-8271-37acee2a7eb1\") " pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:56.561741 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.561716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" Jul 16 16:53:56.595145 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.595116 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bp45h"] Jul 16 16:53:56.598255 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:56.598206 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2397c0af_6512_4e92_955b_101a5a49a461.slice/crio-dc99f0e49d1bc88943f1827fc0ffada78ee3318a9d3350f913a89a94ab84e0b5 WatchSource:0}: Error finding container dc99f0e49d1bc88943f1827fc0ffada78ee3318a9d3350f913a89a94ab84e0b5: Status 404 returned error can't find the container with id dc99f0e49d1bc88943f1827fc0ffada78ee3318a9d3350f913a89a94ab84e0b5 Jul 16 16:53:56.602853 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.602829 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/208c6c75-4bdd-4022-9c80-8c869242ebe1-trusted-ca\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.602955 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.602879 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/208c6c75-4bdd-4022-9c80-8c869242ebe1-registry-certificates\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.602955 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.602947 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/208c6c75-4bdd-4022-9c80-8c869242ebe1-image-registry-private-configuration\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.603068 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.602976 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfz2h\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-kube-api-access-lfz2h\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.603068 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.603011 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-bound-sa-token\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.603166 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.603085 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-registry-tls\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.603166 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.603123 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/208c6c75-4bdd-4022-9c80-8c869242ebe1-ca-trust-extracted\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.603166 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.603148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/208c6c75-4bdd-4022-9c80-8c869242ebe1-installation-pull-secrets\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.603879 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.603853 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/208c6c75-4bdd-4022-9c80-8c869242ebe1-registry-certificates\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.603979 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.603900 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/208c6c75-4bdd-4022-9c80-8c869242ebe1-ca-trust-extracted\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.604040 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.603988 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/208c6c75-4bdd-4022-9c80-8c869242ebe1-trusted-ca\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.605884 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.605860 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/208c6c75-4bdd-4022-9c80-8c869242ebe1-image-registry-private-configuration\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.605988 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.605895 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/208c6c75-4bdd-4022-9c80-8c869242ebe1-installation-pull-secrets\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.605988 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.605900 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-registry-tls\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.611366 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.611314 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-bound-sa-token\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.611366 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.611527 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfz2h\" (UniqueName: \"kubernetes.io/projected/208c6c75-4bdd-4022-9c80-8c869242ebe1-kube-api-access-lfz2h\") pod \"image-registry-689cd77488-8bgjp\" (UID: \"208c6c75-4bdd-4022-9c80-8c869242ebe1\") " pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.655310 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.655281 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6x4n8\"" Jul 16 16:53:56.663820 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.663794 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:53:56.688975 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.688948 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:56.691419 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.691297 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg"] Jul 16 16:53:56.693764 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:56.693737 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ee5af12_4391_44c3_b5b4_911d34454785.slice/crio-5cb2dbb0266263d719c811cfaee2b7a6ec8f6348217144d2c3e25de594a6dd29 WatchSource:0}: Error finding container 5cb2dbb0266263d719c811cfaee2b7a6ec8f6348217144d2c3e25de594a6dd29: Status 404 returned error can't find the container with id 5cb2dbb0266263d719c811cfaee2b7a6ec8f6348217144d2c3e25de594a6dd29 Jul 16 16:53:56.769599 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.769507 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vvrx9" Jul 16 16:53:56.801703 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.801669 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6n9c5"] Jul 16 16:53:56.805386 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:56.805362 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfd8afe_9393_4e0d_8271_37acee2a7eb1.slice/crio-46d590050998412b4434eb47fd2913cb6a0705a3c27db7f0ea21cad3dbbfe380 WatchSource:0}: Error finding container 46d590050998412b4434eb47fd2913cb6a0705a3c27db7f0ea21cad3dbbfe380: Status 404 returned error can't find the container with id 46d590050998412b4434eb47fd2913cb6a0705a3c27db7f0ea21cad3dbbfe380 Jul 16 16:53:56.830517 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.830449 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-689cd77488-8bgjp"] Jul 16 16:53:56.836323 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:56.836277 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208c6c75_4bdd_4022_9c80_8c869242ebe1.slice/crio-20c6a3734a90bd90124ce0c0117e8ae2f235f8d0ba755c7e35ab96b970332b30 WatchSource:0}: Error finding container 20c6a3734a90bd90124ce0c0117e8ae2f235f8d0ba755c7e35ab96b970332b30: Status 404 returned error can't find the container with id 20c6a3734a90bd90124ce0c0117e8ae2f235f8d0ba755c7e35ab96b970332b30 Jul 16 16:53:56.910784 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:56.910750 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vvrx9"] Jul 16 16:53:56.913774 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:56.913746 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27c86020_4e43_4edb_a525_cc87067db0af.slice/crio-b03927e21b6431d35650dfa636f7f5f491c9fd409b0a981a9e86e20c201ba5be WatchSource:0}: Error finding container b03927e21b6431d35650dfa636f7f5f491c9fd409b0a981a9e86e20c201ba5be: Status 404 returned error can't find the container with id b03927e21b6431d35650dfa636f7f5f491c9fd409b0a981a9e86e20c201ba5be Jul 16 16:53:57.217014 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.216938 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6n9c5" event={"ID":"3cfd8afe-9393-4e0d-8271-37acee2a7eb1","Type":"ContainerStarted","Data":"46d590050998412b4434eb47fd2913cb6a0705a3c27db7f0ea21cad3dbbfe380"} Jul 16 16:53:57.219373 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.219315 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vvrx9" event={"ID":"27c86020-4e43-4edb-a525-cc87067db0af","Type":"ContainerStarted","Data":"b03927e21b6431d35650dfa636f7f5f491c9fd409b0a981a9e86e20c201ba5be"} Jul 16 16:53:57.221024 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.220965 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" event={"ID":"4ee5af12-4391-44c3-b5b4-911d34454785","Type":"ContainerStarted","Data":"5cb2dbb0266263d719c811cfaee2b7a6ec8f6348217144d2c3e25de594a6dd29"} Jul 16 16:53:57.223649 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.223536 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689cd77488-8bgjp" event={"ID":"208c6c75-4bdd-4022-9c80-8c869242ebe1","Type":"ContainerStarted","Data":"c404bae13be56cf336aea101ba12a68d0a889179c014a6330b32d0b741a7e890"} Jul 16 16:53:57.223649 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.223581 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-689cd77488-8bgjp" event={"ID":"208c6c75-4bdd-4022-9c80-8c869242ebe1","Type":"ContainerStarted","Data":"20c6a3734a90bd90124ce0c0117e8ae2f235f8d0ba755c7e35ab96b970332b30"} Jul 16 16:53:57.223649 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.223619 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:53:57.226364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.226342 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:57.226830 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.226615 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bp45h" event={"ID":"2397c0af-6512-4e92-955b-101a5a49a461","Type":"ContainerStarted","Data":"dc99f0e49d1bc88943f1827fc0ffada78ee3318a9d3350f913a89a94ab84e0b5"} Jul 16 16:53:57.234246 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.234177 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:57.248763 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.248631 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-689cd77488-8bgjp" podStartSLOduration=1.248609697 podStartE2EDuration="1.248609697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:53:57.247244062 +0000 UTC m=+67.059390814" watchObservedRunningTime="2026-07-16 16:53:57.248609697 +0000 UTC m=+67.060756449" Jul 16 16:53:57.309084 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.309052 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-trusted-ca\") pod \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " Jul 16 16:53:57.309291 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.309105 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-certificates\") pod \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " Jul 16 16:53:57.309291 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.309152 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-image-registry-private-configuration\") pod \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " Jul 16 16:53:57.309291 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.309180 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rs9j\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-kube-api-access-4rs9j\") pod \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " Jul 16 16:53:57.309291 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.309204 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-tls\") pod \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " Jul 16 16:53:57.309291 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.309268 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-bound-sa-token\") pod \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " Jul 16 16:53:57.309529 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.309296 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-ca-trust-extracted\") pod \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " Jul 16 16:53:57.309529 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.309321 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-installation-pull-secrets\") pod \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\" (UID: \"5d430453-e3c1-4cbe-b807-ac2c71df9ed5\") " Jul 16 16:53:57.311686 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.310761 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5d430453-e3c1-4cbe-b807-ac2c71df9ed5" (UID: "5d430453-e3c1-4cbe-b807-ac2c71df9ed5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:53:57.313179 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.312696 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5d430453-e3c1-4cbe-b807-ac2c71df9ed5" (UID: "5d430453-e3c1-4cbe-b807-ac2c71df9ed5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:53:57.313179 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.313143 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5d430453-e3c1-4cbe-b807-ac2c71df9ed5" (UID: "5d430453-e3c1-4cbe-b807-ac2c71df9ed5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:53:57.319062 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.319013 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5d430453-e3c1-4cbe-b807-ac2c71df9ed5" (UID: "5d430453-e3c1-4cbe-b807-ac2c71df9ed5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:53:57.319334 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.319283 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5d430453-e3c1-4cbe-b807-ac2c71df9ed5" (UID: "5d430453-e3c1-4cbe-b807-ac2c71df9ed5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:53:57.319440 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.319369 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5d430453-e3c1-4cbe-b807-ac2c71df9ed5" (UID: "5d430453-e3c1-4cbe-b807-ac2c71df9ed5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:53:57.319562 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.319538 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-kube-api-access-4rs9j" (OuterVolumeSpecName: "kube-api-access-4rs9j") pod "5d430453-e3c1-4cbe-b807-ac2c71df9ed5" (UID: "5d430453-e3c1-4cbe-b807-ac2c71df9ed5"). InnerVolumeSpecName "kube-api-access-4rs9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:53:57.319704 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.319690 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5d430453-e3c1-4cbe-b807-ac2c71df9ed5" (UID: "5d430453-e3c1-4cbe-b807-ac2c71df9ed5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411177 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411298 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411362 2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-image-registry-private-configuration\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411378 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rs9j\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-kube-api-access-4rs9j\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411393 2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-tls\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411406 2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-bound-sa-token\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411420 2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-ca-trust-extracted\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411434 2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-installation-pull-secrets\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411447 2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-trusted-ca\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:53:57.412258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.411460 2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5d430453-e3c1-4cbe-b807-ac2c71df9ed5-registry-certificates\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:53:57.414248 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.414179 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ef991e78-1b63-4be6-8085-e2ce75e34b1d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szmk6\" (UID: \"ef991e78-1b63-4be6-8085-e2ce75e34b1d\") " pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:57.415907 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.415863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69ec21d6-42fd-4fac-aa04-dee1a3cf73d1-metrics-tls\") pod \"dns-default-xp7r7\" (UID: \"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1\") " pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:57.638052 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.637831 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pnmxk\"" Jul 16 16:53:57.645539 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.645500 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xp7r7" Jul 16 16:53:57.648673 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.648653 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-njzwt\"" Jul 16 16:53:57.656160 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:57.656133 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szmk6" Jul 16 16:53:58.102489 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.102454 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xp7r7"] Jul 16 16:53:58.120876 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.120797 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szmk6"] Jul 16 16:53:58.231043 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.230968 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-847bbdfb76-l9dv4" Jul 16 16:53:58.269611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.269579 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-847bbdfb76-l9dv4"] Jul 16 16:53:58.275772 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.275744 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-847bbdfb76-l9dv4"] Jul 16 16:53:58.626507 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.626466 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:58.629752 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.629693 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/0241409e-b894-4a9c-a976-e9f560f91cb6-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-lnntv\" (UID: \"0241409e-b894-4a9c-a976-e9f560f91cb6\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:58.747788 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.747724 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d430453-e3c1-4cbe-b807-ac2c71df9ed5" path="/var/lib/kubelet/pods/5d430453-e3c1-4cbe-b807-ac2c71df9ed5/volumes" Jul 16 16:53:58.890824 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.890744 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-kd5w4\"" Jul 16 16:53:58.899136 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:58.899106 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" Jul 16 16:53:58.931672 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:58.931637 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69ec21d6_42fd_4fac_aa04_dee1a3cf73d1.slice/crio-3020dd5bbe5cd81fa4e4d2eb2b84dde3cf6e846028a3656fc81f0ee0c29918a4 WatchSource:0}: Error finding container 3020dd5bbe5cd81fa4e4d2eb2b84dde3cf6e846028a3656fc81f0ee0c29918a4: Status 404 returned error can't find the container with id 3020dd5bbe5cd81fa4e4d2eb2b84dde3cf6e846028a3656fc81f0ee0c29918a4 Jul 16 16:53:59.236770 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:59.236684 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xp7r7" event={"ID":"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1","Type":"ContainerStarted","Data":"3020dd5bbe5cd81fa4e4d2eb2b84dde3cf6e846028a3656fc81f0ee0c29918a4"} Jul 16 16:53:59.387572 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:53:59.387538 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef991e78_1b63_4be6_8085_e2ce75e34b1d.slice/crio-3a03899b2276a1af956cae5932954ef4491b299cd2d5bc5fd9db7a92bc117e30 WatchSource:0}: Error finding container 3a03899b2276a1af956cae5932954ef4491b299cd2d5bc5fd9db7a92bc117e30: Status 404 returned error can't find the container with id 3a03899b2276a1af956cae5932954ef4491b299cd2d5bc5fd9db7a92bc117e30 Jul 16 16:53:59.551304 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:53:59.551279 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv"] Jul 16 16:54:00.243534 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:00.243491 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bp45h" event={"ID":"2397c0af-6512-4e92-955b-101a5a49a461","Type":"ContainerStarted","Data":"754edffc3cd04b975ae513ff3939c81b5de72cf0dc96fdb443d60e4e19b0f3a6"} Jul 16 16:54:00.245360 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:00.245332 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szmk6" event={"ID":"ef991e78-1b63-4be6-8085-e2ce75e34b1d","Type":"ContainerStarted","Data":"3a03899b2276a1af956cae5932954ef4491b299cd2d5bc5fd9db7a92bc117e30"} Jul 16 16:54:00.246894 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:00.246864 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" event={"ID":"0241409e-b894-4a9c-a976-e9f560f91cb6","Type":"ContainerStarted","Data":"165be1339823fca2a10fe13529e26a14566c386d31346181555421273607a417"} Jul 16 16:54:02.258151 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:02.257408 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" event={"ID":"4ee5af12-4391-44c3-b5b4-911d34454785","Type":"ContainerStarted","Data":"a19a15f9e89b243d7574237febf9eec36e521323981c702dfc699f5ab9b3909c"} Jul 16 16:54:02.262094 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:02.261589 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bp45h" event={"ID":"2397c0af-6512-4e92-955b-101a5a49a461","Type":"ContainerStarted","Data":"b649632868aa2d372db3a473c7ce457e6222a797ad7116f6847928be13ab35b0"} Jul 16 16:54:02.297541 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:02.297242 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b76f749fb-mt7sg" podStartSLOduration=1.541061872 podStartE2EDuration="6.297206596s" totalImagesPullingTime="4.756144724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:02.276040071 +0000 UTC m=+72.088186823" watchObservedRunningTime="2026-07-16 16:54:02.297206596 +0000 UTC m=+72.109353348" Jul 16 16:54:03.267967 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:03.267876 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xp7r7" event={"ID":"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1","Type":"ContainerStarted","Data":"831dfae4c0394ee2e855f147953a14d73f4acd75175b3fac5801ac23ecb04702"} Jul 16 16:54:03.269803 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:03.269733 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vvrx9" event={"ID":"27c86020-4e43-4edb-a525-cc87067db0af","Type":"ContainerStarted","Data":"4bac69569d482cc591e25f62f39452235107f5a2c7c547c8d9b59f2df201043b"} Jul 16 16:54:03.287568 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:03.287500 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bp45h" podStartSLOduration=70.497166998 podStartE2EDuration="1m13.287481122s" totalImagesPullingTime="2.790314124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:02.29837236 +0000 UTC m=+72.110519091" watchObservedRunningTime="2026-07-16 16:54:03.287481122 +0000 UTC m=+73.099627875" Jul 16 16:54:03.288485 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:03.288447 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vvrx9" podStartSLOduration=67.560826281 podStartE2EDuration="1m13.288431768s" totalImagesPullingTime="5.727605487s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:03.288124523 +0000 UTC m=+73.100271274" watchObservedRunningTime="2026-07-16 16:54:03.288431768 +0000 UTC m=+73.100578497" Jul 16 16:54:08.288993 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.288950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xp7r7" event={"ID":"69ec21d6-42fd-4fac-aa04-dee1a3cf73d1","Type":"ContainerStarted","Data":"d584b0694e520e885bfb20629c591e66ec35bc535f1ac0a3f0fd603c180acf35"} Jul 16 16:54:08.290122 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.289798 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xp7r7" Jul 16 16:54:08.291891 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.291861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szmk6" event={"ID":"ef991e78-1b63-4be6-8085-e2ce75e34b1d","Type":"ContainerStarted","Data":"aaa7884dc2f8a841d17a39c59074dc93273a671898994c7aaa2cae7a50a283eb"} Jul 16 16:54:08.293828 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.293781 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6n9c5" event={"ID":"3cfd8afe-9393-4e0d-8271-37acee2a7eb1","Type":"ContainerStarted","Data":"13b8b19b47c9ecc946a3825c2dde5660ccad6e2c768da45f2d8635d65230c8d9"} Jul 16 16:54:08.293922 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.293896 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:54:08.296291 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.296200 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" event={"ID":"0241409e-b894-4a9c-a976-e9f560f91cb6","Type":"ContainerStarted","Data":"1e37f46d7276acad00bc4d6ec9f343b80b92dac7250bf824b41fe401504c9b3b"} Jul 16 16:54:08.296291 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.296258 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" event={"ID":"0241409e-b894-4a9c-a976-e9f560f91cb6","Type":"ContainerStarted","Data":"fdad47b5f693b97cd1429185f6fbb5f580ad596100a2c323abc4e4ac8f71f982"} Jul 16 16:54:08.309483 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.309433 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xp7r7" podStartSLOduration=39.269766403 podStartE2EDuration="43.309419983s" totalImagesPullingTime="4.03965358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:08.309336212 +0000 UTC m=+78.121482964" watchObservedRunningTime="2026-07-16 16:54:08.309419983 +0000 UTC m=+78.121566735" Jul 16 16:54:08.337463 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.337396 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-lnntv" podStartSLOduration=34.768335048 podStartE2EDuration="42.337375907s" totalImagesPullingTime="7.569040859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:53:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:08.335849721 +0000 UTC m=+78.147996473" watchObservedRunningTime="2026-07-16 16:54:08.337375907 +0000 UTC m=+78.149522660" Jul 16 16:54:08.420425 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.420368 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6n9c5" podStartSLOduration=67.839151364 podStartE2EDuration="1m18.420349495s" totalImagesPullingTime="10.581198131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:52:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:08.356920151 +0000 UTC m=+78.169066903" watchObservedRunningTime="2026-07-16 16:54:08.420349495 +0000 UTC m=+78.232496274" Jul 16 16:54:08.420880 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.420859 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tbvww"] Jul 16 16:54:08.423537 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.423513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.425979 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.425951 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 16:54:08.426125 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.426087 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 16:54:08.426125 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.426105 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2s587\"" Jul 16 16:54:08.426267 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.426170 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 16:54:08.426332 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.426289 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 16:54:08.426332 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.426304 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 16:54:08.426560 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.426541 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 16:54:08.508705 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508666 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdqtn\" (UniqueName: \"kubernetes.io/projected/a8efa51e-168d-4d46-9def-0d930b5fdf21-kube-api-access-bdqtn\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.508856 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508731 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-tls\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.508856 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508768 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-accelerators-collector-config\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.508856 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508813 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-root\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.508856 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508838 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-textfile\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.509005 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.509005 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508915 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-wtmp\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.509005 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508936 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8efa51e-168d-4d46-9def-0d930b5fdf21-metrics-client-ca\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.509125 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.508998 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-sys\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610185 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610144 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-tls\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610381 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610202 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-accelerators-collector-config\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610381 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610267 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-root\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610381 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610292 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-textfile\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610381 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610316 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610381 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:08.610342 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 16 16:54:08.610644 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:08.610411 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-tls podName:a8efa51e-168d-4d46-9def-0d930b5fdf21 nodeName:}" failed. No retries permitted until 2026-07-16 16:54:09.110390721 +0000 UTC m=+78.922537463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-tls") pod "node-exporter-tbvww" (UID: "a8efa51e-168d-4d46-9def-0d930b5fdf21") : secret "node-exporter-tls" not found Jul 16 16:54:08.610644 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610479 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-wtmp\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610644 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-wtmp\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610644 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610494 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-root\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610644 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8efa51e-168d-4d46-9def-0d930b5fdf21-metrics-client-ca\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610644 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610567 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-sys\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610644 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610605 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdqtn\" (UniqueName: \"kubernetes.io/projected/a8efa51e-168d-4d46-9def-0d930b5fdf21-kube-api-access-bdqtn\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610965 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610684 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8efa51e-168d-4d46-9def-0d930b5fdf21-sys\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610965 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610805 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-textfile\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.610965 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.610882 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-accelerators-collector-config\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.611111 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.611020 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8efa51e-168d-4d46-9def-0d930b5fdf21-metrics-client-ca\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.613017 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.612993 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:08.637079 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:08.637036 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdqtn\" (UniqueName: \"kubernetes.io/projected/a8efa51e-168d-4d46-9def-0d930b5fdf21-kube-api-access-bdqtn\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:09.114291 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.114256 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-tls\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:09.116775 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.116747 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a8efa51e-168d-4d46-9def-0d930b5fdf21-node-exporter-tls\") pod \"node-exporter-tbvww\" (UID: \"a8efa51e-168d-4d46-9def-0d930b5fdf21\") " pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:09.337455 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.337425 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tbvww" Jul 16 16:54:09.455994 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.455915 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:54:09.460148 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.460115 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.463893 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.463866 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 16:54:09.464212 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.464183 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 16:54:09.464326 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.464300 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 16:54:09.464414 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.464306 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 16:54:09.464712 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.464693 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 16:54:09.464862 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.464740 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 16:54:09.464862 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.464747 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 16:54:09.465027 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.464997 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 16:54:09.465027 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.464997 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-647sz\"" Jul 16 16:54:09.472019 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.471998 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 16:54:09.498401 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.498374 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:54:09.517480 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517449 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517613 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517483 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517613 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517509 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517613 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517560 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-web-config\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517774 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517631 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517774 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517682 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517774 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517713 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-config-volume\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517774 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-config-out\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517893 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517831 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517893 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517873 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517955 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517913 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.517987 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517951 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbkjn\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-kube-api-access-xbkjn\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.518019 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.517986 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.618811 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.618774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.618811 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.618817 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619051 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.618839 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619051 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.618861 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-web-config\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619051 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.618889 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619051 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.618919 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619051 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.618943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-config-volume\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619051 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.618966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-config-out\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619051 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:09.619003 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle podName:02605109-8a13-4479-a2b6-0390a2f06bf2 nodeName:}" failed. No retries permitted until 2026-07-16 16:54:10.118974823 +0000 UTC m=+79.931121560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2") : configmap references non-existent config key: ca-bundle.crt Jul 16 16:54:09.619430 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.619071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619430 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.619104 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619430 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.619141 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619430 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.619184 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbkjn\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-kube-api-access-xbkjn\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.619430 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.619243 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.620202 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:09.619758 2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 16 16:54:09.620202 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:09.619841 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls podName:02605109-8a13-4479-a2b6-0390a2f06bf2 nodeName:}" failed. No retries permitted until 2026-07-16 16:54:10.1198198 +0000 UTC m=+79.931966549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2") : secret "alertmanager-main-tls" not found Jul 16 16:54:09.621200 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.620727 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.621637 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.621562 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.622042 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.621787 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-config-out\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.622432 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.622391 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.623047 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.623005 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.624075 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.624031 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.624168 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.624097 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.624539 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.624515 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.624783 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.624763 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-web-config\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.626085 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.626064 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-config-volume\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:09.628323 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:09.628297 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbkjn\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-kube-api-access-xbkjn\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:10.123969 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.123932 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:10.124156 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.124023 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:10.124156 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:10.124096 2580 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 16 16:54:10.124318 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:10.124164 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls podName:02605109-8a13-4479-a2b6-0390a2f06bf2 nodeName:}" failed. No retries permitted until 2026-07-16 16:54:11.124148188 +0000 UTC m=+80.936294917 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2") : secret "alertmanager-main-tls" not found Jul 16 16:54:10.124764 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.124739 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:10.379757 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.379684 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-d79f8877c-gh8kx"] Jul 16 16:54:10.387025 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.386999 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.390140 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.390116 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 16:54:10.390439 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.390416 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-mgtrz\"" Jul 16 16:54:10.390649 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.390628 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2vjf94b4kv61k\"" Jul 16 16:54:10.390771 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.390636 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 16:54:10.391300 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.391258 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 16:54:10.391404 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.391281 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 16:54:10.391460 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.391444 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 16:54:10.398891 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.398867 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d79f8877c-gh8kx"] Jul 16 16:54:10.527606 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.527569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crdbg\" (UniqueName: \"kubernetes.io/projected/1d12c1d6-f490-46d4-a002-76be774b1e4e-kube-api-access-crdbg\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.527757 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.527627 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.527757 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.527690 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d12c1d6-f490-46d4-a002-76be774b1e4e-metrics-client-ca\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.527757 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.527717 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.527757 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.527740 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-grpc-tls\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.527917 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.527767 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.527917 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.527837 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-tls\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.527917 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.527871 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.629008 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.628968 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crdbg\" (UniqueName: \"kubernetes.io/projected/1d12c1d6-f490-46d4-a002-76be774b1e4e-kube-api-access-crdbg\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.629177 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.629019 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.629177 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.629066 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d12c1d6-f490-46d4-a002-76be774b1e4e-metrics-client-ca\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.629177 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.629109 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.629177 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.629143 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-grpc-tls\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.629177 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.629173 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.629443 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.629212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-tls\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.629443 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.629260 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.630285 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.629863 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d12c1d6-f490-46d4-a002-76be774b1e4e-metrics-client-ca\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.632620 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.632595 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.632732 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.632698 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-grpc-tls\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.633184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.633159 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-tls\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.633285 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.633199 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.633353 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.633312 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.633885 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.633862 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1d12c1d6-f490-46d4-a002-76be774b1e4e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.642350 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.642284 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crdbg\" (UniqueName: \"kubernetes.io/projected/1d12c1d6-f490-46d4-a002-76be774b1e4e-kube-api-access-crdbg\") pod \"thanos-querier-d79f8877c-gh8kx\" (UID: \"1d12c1d6-f490-46d4-a002-76be774b1e4e\") " pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.698629 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.698590 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:10.786655 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:54:10.786532 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8efa51e_168d_4d46_9def_0d930b5fdf21.slice/crio-16bfb42cf5e2c4911c89b98cf91c6dda4c1450f05859ace59f81ee32ae37ded6 WatchSource:0}: Error finding container 16bfb42cf5e2c4911c89b98cf91c6dda4c1450f05859ace59f81ee32ae37ded6: Status 404 returned error can't find the container with id 16bfb42cf5e2c4911c89b98cf91c6dda4c1450f05859ace59f81ee32ae37ded6 Jul 16 16:54:10.924450 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:10.924426 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-d79f8877c-gh8kx"] Jul 16 16:54:10.926654 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:54:10.926632 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d12c1d6_f490_46d4_a002_76be774b1e4e.slice/crio-e1c48ad39970e6d0e07b80e2e31887d1669e21e203d8018ef2def97b13e6cda8 WatchSource:0}: Error finding container e1c48ad39970e6d0e07b80e2e31887d1669e21e203d8018ef2def97b13e6cda8: Status 404 returned error can't find the container with id e1c48ad39970e6d0e07b80e2e31887d1669e21e203d8018ef2def97b13e6cda8 Jul 16 16:54:11.133589 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:11.133554 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:11.136016 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:11.135954 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:11.273266 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:11.273229 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:54:11.313041 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:11.312483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tbvww" event={"ID":"a8efa51e-168d-4d46-9def-0d930b5fdf21","Type":"ContainerStarted","Data":"16bfb42cf5e2c4911c89b98cf91c6dda4c1450f05859ace59f81ee32ae37ded6"} Jul 16 16:54:11.315145 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:11.315082 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szmk6" event={"ID":"ef991e78-1b63-4be6-8085-e2ce75e34b1d","Type":"ContainerStarted","Data":"5109e8c42de28fe7703ca15450a6361874a9192961f0a6af9058c41015c2f9ec"} Jul 16 16:54:11.316860 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:11.316830 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" event={"ID":"1d12c1d6-f490-46d4-a002-76be774b1e4e","Type":"ContainerStarted","Data":"e1c48ad39970e6d0e07b80e2e31887d1669e21e203d8018ef2def97b13e6cda8"} Jul 16 16:54:11.446267 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:11.446240 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:54:11.448640 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:54:11.448602 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02605109_8a13_4479_a2b6_0390a2f06bf2.slice/crio-304f8a80c67e90164c8244817bb8f5e7a7538df7aded47dd9afe9f6727d2e667 WatchSource:0}: Error finding container 304f8a80c67e90164c8244817bb8f5e7a7538df7aded47dd9afe9f6727d2e667: Status 404 returned error can't find the container with id 304f8a80c67e90164c8244817bb8f5e7a7538df7aded47dd9afe9f6727d2e667 Jul 16 16:54:12.323209 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:12.322932 2580 generic.go:356] "Generic (PLEG): container finished" podID="a8efa51e-168d-4d46-9def-0d930b5fdf21" containerID="7a33b06fe0a23859aa1749116d4201d2e6d6c0c3494388cab606ea8e89fab461" exitCode=0 Jul 16 16:54:12.323209 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:12.323024 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tbvww" event={"ID":"a8efa51e-168d-4d46-9def-0d930b5fdf21","Type":"ContainerDied","Data":"7a33b06fe0a23859aa1749116d4201d2e6d6c0c3494388cab606ea8e89fab461"} Jul 16 16:54:12.324985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:12.324905 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerStarted","Data":"304f8a80c67e90164c8244817bb8f5e7a7538df7aded47dd9afe9f6727d2e667"} Jul 16 16:54:13.178062 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.178028 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-svk85"] Jul 16 16:54:13.182380 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.182352 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:13.184750 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.184729 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 16:54:13.185001 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.184985 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sx5vv\"" Jul 16 16:54:13.192266 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.192197 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-svk85"] Jul 16 16:54:13.251060 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.251029 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-svk85\" (UID: \"ea9931d2-f3c9-412d-a10f-e31bca02dbc0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:13.251297 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.251116 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v82fp\" (UniqueName: \"kubernetes.io/projected/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-kube-api-access-v82fp\") pod \"monitoring-plugin-5f68df7f58-svk85\" (UID: \"ea9931d2-f3c9-412d-a10f-e31bca02dbc0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:13.309761 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.309724 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xp7r7" Jul 16 16:54:13.331439 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.331408 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tbvww" event={"ID":"a8efa51e-168d-4d46-9def-0d930b5fdf21","Type":"ContainerStarted","Data":"cd9ded00631a2f2f1567ec900e2173eac9011efbcf6bde49e37f830848df43f9"} Jul 16 16:54:13.331604 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.331464 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tbvww" event={"ID":"a8efa51e-168d-4d46-9def-0d930b5fdf21","Type":"ContainerStarted","Data":"11a73df6474af8c85c6f6d2487bc9ef6672edc10ef00d5fca89983ac7d70ef50"} Jul 16 16:54:13.333137 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.333093 2580 generic.go:356] "Generic (PLEG): container finished" podID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerID="7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99" exitCode=0 Jul 16 16:54:13.333298 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.333183 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerDied","Data":"7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99"} Jul 16 16:54:13.351994 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.351962 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-svk85\" (UID: \"ea9931d2-f3c9-412d-a10f-e31bca02dbc0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:13.352122 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.352076 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v82fp\" (UniqueName: \"kubernetes.io/projected/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-kube-api-access-v82fp\") pod \"monitoring-plugin-5f68df7f58-svk85\" (UID: \"ea9931d2-f3c9-412d-a10f-e31bca02dbc0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:13.352371 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:13.352342 2580 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 16 16:54:13.352446 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:54:13.352422 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-monitoring-plugin-cert podName:ea9931d2-f3c9-412d-a10f-e31bca02dbc0 nodeName:}" failed. No retries permitted until 2026-07-16 16:54:13.852400495 +0000 UTC m=+83.664547238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-svk85" (UID: "ea9931d2-f3c9-412d-a10f-e31bca02dbc0") : secret "monitoring-plugin-cert" not found Jul 16 16:54:13.358726 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.358523 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tbvww" podStartSLOduration=4.329965808 podStartE2EDuration="5.358502077s" totalImagesPullingTime="941.054542ms" totalInitContainerRuntime="87.481727ms" isStatefulPod=true podCreationTimestamp="2026-07-16 16:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:13.357476106 +0000 UTC m=+83.169622873" watchObservedRunningTime="2026-07-16 16:54:13.358502077 +0000 UTC m=+83.170648829" Jul 16 16:54:13.364327 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.364295 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v82fp\" (UniqueName: \"kubernetes.io/projected/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-kube-api-access-v82fp\") pod \"monitoring-plugin-5f68df7f58-svk85\" (UID: \"ea9931d2-f3c9-412d-a10f-e31bca02dbc0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:13.856450 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.856387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-svk85\" (UID: \"ea9931d2-f3c9-412d-a10f-e31bca02dbc0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:13.859404 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:13.859347 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ea9931d2-f3c9-412d-a10f-e31bca02dbc0-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-svk85\" (UID: \"ea9931d2-f3c9-412d-a10f-e31bca02dbc0\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:14.094200 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:14.094156 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:15.694561 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:15.694134 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-svk85"] Jul 16 16:54:16.349722 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.349687 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szmk6" event={"ID":"ef991e78-1b63-4be6-8085-e2ce75e34b1d","Type":"ContainerStarted","Data":"c6b94cdacd0d2f1cc1cf91b2bd7119e67ac9333c9484c9addcca6bd04079c7c8"} Jul 16 16:54:16.352625 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.352574 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" event={"ID":"1d12c1d6-f490-46d4-a002-76be774b1e4e","Type":"ContainerStarted","Data":"24d147d35100b7dcf9801c66d408c8fb4ddf83301994a9c87b3158061b674ddd"} Jul 16 16:54:16.352772 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.352668 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" event={"ID":"1d12c1d6-f490-46d4-a002-76be774b1e4e","Type":"ContainerStarted","Data":"127c73c8c4da76efc4b759103e7edf9511ed46650cd213fc2816d0a6d274e0ce"} Jul 16 16:54:16.352772 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.352711 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" event={"ID":"1d12c1d6-f490-46d4-a002-76be774b1e4e","Type":"ContainerStarted","Data":"e68dc9523bdccd5e6c68ef001c77f15ee68bb81670fe9574db11a94f1bc8ecad"} Jul 16 16:54:16.355136 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.355112 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" event={"ID":"ea9931d2-f3c9-412d-a10f-e31bca02dbc0","Type":"ContainerStarted","Data":"04367c7694ffae634d4e72de0bb75ee6eaf434224a5997d1efd1dde06f396574"} Jul 16 16:54:16.358805 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.358784 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerStarted","Data":"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8"} Jul 16 16:54:16.358901 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.358839 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerStarted","Data":"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4"} Jul 16 16:54:16.358901 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.358865 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerStarted","Data":"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d"} Jul 16 16:54:16.358901 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.358896 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerStarted","Data":"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b"} Jul 16 16:54:16.359053 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.358921 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerStarted","Data":"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3"} Jul 16 16:54:16.370969 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:16.370669 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-szmk6" podStartSLOduration=35.350752518 podStartE2EDuration="51.370633219s" totalImagesPullingTime="16.019880701s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 16:53:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:16.369310174 +0000 UTC m=+86.181456923" watchObservedRunningTime="2026-07-16 16:54:16.370633219 +0000 UTC m=+86.182779971" Jul 16 16:54:17.368234 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:17.368185 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerStarted","Data":"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b"} Jul 16 16:54:17.371929 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:17.371885 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" event={"ID":"1d12c1d6-f490-46d4-a002-76be774b1e4e","Type":"ContainerStarted","Data":"c779f564d83b3f5dc889a1942e3774a95bdbc9f47524c3c1cb77191fd942dab9"} Jul 16 16:54:17.372072 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:17.371973 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" event={"ID":"1d12c1d6-f490-46d4-a002-76be774b1e4e","Type":"ContainerStarted","Data":"b0856c8d12cf8230bd6b5c3dbf210c3829fbe48362097426bbc7df365d1af7b8"} Jul 16 16:54:17.372072 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:17.372014 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" event={"ID":"1d12c1d6-f490-46d4-a002-76be774b1e4e","Type":"ContainerStarted","Data":"988a299788bea810360833ea48a99bb76ce5e0bc0d310d812b3f22039e1cadae"} Jul 16 16:54:17.411018 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:17.410254 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.42222964 podStartE2EDuration="8.410231741s" totalImagesPullingTime="3.962575764s" totalInitContainerRuntime="25.426337ms" isStatefulPod=false podCreationTimestamp="2026-07-16 16:54:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:17.408894006 +0000 UTC m=+87.221040788" watchObservedRunningTime="2026-07-16 16:54:17.410231741 +0000 UTC m=+87.222378491" Jul 16 16:54:17.437132 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:17.437059 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" podStartSLOduration=1.970945548 podStartE2EDuration="7.437040369s" totalImagesPullingTime="5.466094821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:54:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:17.433692934 +0000 UTC m=+87.245839710" watchObservedRunningTime="2026-07-16 16:54:17.437040369 +0000 UTC m=+87.249187121" Jul 16 16:54:18.236030 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:18.235999 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-689cd77488-8bgjp" Jul 16 16:54:18.377436 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:18.377394 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" event={"ID":"ea9931d2-f3c9-412d-a10f-e31bca02dbc0","Type":"ContainerStarted","Data":"6ff1a00fdcb43091e5ed15df4f91be08cc6ecc5cef966044f486c81d8f35ef87"} Jul 16 16:54:18.377906 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:18.377885 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:18.378192 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:18.378168 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:18.382859 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:18.382838 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" Jul 16 16:54:18.401045 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:18.401003 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-svk85" podStartSLOduration=3.514530343 podStartE2EDuration="5.400988885s" totalImagesPullingTime="1.886458542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:54:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:54:18.399607946 +0000 UTC m=+88.211754705" watchObservedRunningTime="2026-07-16 16:54:18.400988885 +0000 UTC m=+88.213135677" Jul 16 16:54:24.387188 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:24.387161 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-d79f8877c-gh8kx" Jul 16 16:54:30.033005 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:30.032976 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vk2h_84968745-2495-402d-b079-4fc7cdcdb979/serve-healthcheck-canary/0.log" Jul 16 16:54:39.303557 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:39.303526 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6n9c5" Jul 16 16:54:53.530834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:53.530746 2580 generic.go:356] "Generic (PLEG): container finished" podID="bfc65de4-7e1b-480a-a8db-7aa45c42fbba" containerID="eeeeb4324ea9306af518b52da80d92114220d93a247220aa3c9f40047cb8af32" exitCode=0 Jul 16 16:54:53.530834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:53.530805 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" event={"ID":"bfc65de4-7e1b-480a-a8db-7aa45c42fbba","Type":"ContainerDied","Data":"eeeeb4324ea9306af518b52da80d92114220d93a247220aa3c9f40047cb8af32"} Jul 16 16:54:53.531243 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:53.531154 2580 scope.go:117] "RemoveContainer" containerID="eeeeb4324ea9306af518b52da80d92114220d93a247220aa3c9f40047cb8af32" Jul 16 16:54:54.535944 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:54.535910 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-dzqkl" event={"ID":"bfc65de4-7e1b-480a-a8db-7aa45c42fbba","Type":"ContainerStarted","Data":"a42f24b9ff6aeae8811c150b886ad1738090716ade24188fe5136016322c3c40"} Jul 16 16:54:58.552805 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:58.552770 2580 generic.go:356] "Generic (PLEG): container finished" podID="35a3e8f0-1a93-4af1-8f04-eb75e003d55f" containerID="79768e79a984a7bd88752c001f040397acd9e8bf70aef7ef51d643bab6a9a00d" exitCode=0 Jul 16 16:54:58.553367 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:58.552841 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" event={"ID":"35a3e8f0-1a93-4af1-8f04-eb75e003d55f","Type":"ContainerDied","Data":"79768e79a984a7bd88752c001f040397acd9e8bf70aef7ef51d643bab6a9a00d"} Jul 16 16:54:58.553367 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:58.553132 2580 scope.go:117] "RemoveContainer" containerID="79768e79a984a7bd88752c001f040397acd9e8bf70aef7ef51d643bab6a9a00d" Jul 16 16:54:59.558464 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:54:59.558416 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-hdjsm" event={"ID":"35a3e8f0-1a93-4af1-8f04-eb75e003d55f","Type":"ContainerStarted","Data":"0eb290d2b40c690f0352c6e542ab588e5ea43e9b2ae5de4a99c6a87b39a3967d"} Jul 16 16:55:28.793496 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:28.793461 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:55:28.793921 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:28.793749 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="alertmanager" containerID="cri-o://ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3" gracePeriod=120 Jul 16 16:55:28.793921 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:28.793827 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy-metric" containerID="cri-o://233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8" gracePeriod=120 Jul 16 16:55:28.793921 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:28.793882 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="prom-label-proxy" containerID="cri-o://ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b" gracePeriod=120 Jul 16 16:55:28.793921 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:28.793882 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="config-reloader" containerID="cri-o://064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b" gracePeriod=120 Jul 16 16:55:28.794109 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:28.793839 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy-web" containerID="cri-o://f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d" gracePeriod=120 Jul 16 16:55:28.794109 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:28.794020 2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy" containerID="cri-o://e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4" gracePeriod=120 Jul 16 16:55:29.675173 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:29.675136 2580 generic.go:356] "Generic (PLEG): container finished" podID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerID="ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b" exitCode=0 Jul 16 16:55:29.675173 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:29.675164 2580 generic.go:356] "Generic (PLEG): container finished" podID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerID="e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4" exitCode=0 Jul 16 16:55:29.675173 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:29.675172 2580 generic.go:356] "Generic (PLEG): container finished" podID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerID="064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b" exitCode=0 Jul 16 16:55:29.675173 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:29.675179 2580 generic.go:356] "Generic (PLEG): container finished" podID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerID="ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3" exitCode=0 Jul 16 16:55:29.675573 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:29.675209 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerDied","Data":"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b"} Jul 16 16:55:29.675573 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:29.675328 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerDied","Data":"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4"} Jul 16 16:55:29.675573 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:29.675373 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerDied","Data":"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b"} Jul 16 16:55:29.675573 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:29.675414 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerDied","Data":"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3"} Jul 16 16:55:30.035071 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.035042 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.171366 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171328 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbkjn\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-kube-api-access-xbkjn\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171539 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171380 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171539 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171398 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-web\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171539 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171423 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-main-db\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171679 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171538 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-tls-assets\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171679 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171591 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-web-config\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171679 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171651 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171828 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171678 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171828 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171721 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-cluster-tls-config\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171828 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171740 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:55:30.171828 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171748 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-config-out\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171828 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171768 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:55:30.171828 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171782 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.171828 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171814 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-config-volume\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.172156 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.171843 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-metrics-client-ca\") pod \"02605109-8a13-4479-a2b6-0390a2f06bf2\" (UID: \"02605109-8a13-4479-a2b6-0390a2f06bf2\") " Jul 16 16:55:30.172156 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.172094 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.172156 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.172111 2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-alertmanager-main-db\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.172749 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.172489 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 16:55:30.174146 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.174113 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:30.174987 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.174706 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:55:30.174987 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.174804 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-kube-api-access-xbkjn" (OuterVolumeSpecName: "kube-api-access-xbkjn") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "kube-api-access-xbkjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:55:30.174987 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.174821 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:30.175310 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.175284 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-config-out" (OuterVolumeSpecName: "config-out") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:55:30.175512 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.175482 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:30.176469 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.176445 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-config-volume" (OuterVolumeSpecName: "config-volume") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:30.176682 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.176666 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:30.178793 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.178780 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:30.184564 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.184540 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-web-config" (OuterVolumeSpecName: "web-config") pod "02605109-8a13-4479-a2b6-0390a2f06bf2" (UID: "02605109-8a13-4479-a2b6-0390a2f06bf2"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273461 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273493 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-main-tls\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273504 2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-cluster-tls-config\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273516 2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02605109-8a13-4479-a2b6-0390a2f06bf2-config-out\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273524 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273533 2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-config-volume\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273541 2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02605109-8a13-4479-a2b6-0390a2f06bf2-metrics-client-ca\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273549 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbkjn\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-kube-api-access-xbkjn\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273550 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273557 2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273928 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273565 2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02605109-8a13-4479-a2b6-0390a2f06bf2-tls-assets\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.273928 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.273573 2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02605109-8a13-4479-a2b6-0390a2f06bf2-web-config\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:55:30.682092 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.682054 2580 generic.go:356] "Generic (PLEG): container finished" podID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerID="233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8" exitCode=0 Jul 16 16:55:30.682092 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.682080 2580 generic.go:356] "Generic (PLEG): container finished" podID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerID="f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d" exitCode=0 Jul 16 16:55:30.682351 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.682130 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.682351 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.682139 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerDied","Data":"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8"} Jul 16 16:55:30.682351 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.682208 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerDied","Data":"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d"} Jul 16 16:55:30.682351 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.682245 2580 scope.go:117] "RemoveContainer" containerID="ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b" Jul 16 16:55:30.682351 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.682261 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02605109-8a13-4479-a2b6-0390a2f06bf2","Type":"ContainerDied","Data":"304f8a80c67e90164c8244817bb8f5e7a7538df7aded47dd9afe9f6727d2e667"} Jul 16 16:55:30.690520 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.690501 2580 scope.go:117] "RemoveContainer" containerID="233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8" Jul 16 16:55:30.697094 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.697076 2580 scope.go:117] "RemoveContainer" containerID="e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4" Jul 16 16:55:30.704121 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.704090 2580 scope.go:117] "RemoveContainer" containerID="f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d" Jul 16 16:55:30.706456 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.706435 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:55:30.711990 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.711958 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:55:30.712492 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.712476 2580 scope.go:117] "RemoveContainer" containerID="064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b" Jul 16 16:55:30.719507 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.719493 2580 scope.go:117] "RemoveContainer" containerID="ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3" Jul 16 16:55:30.726084 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.726069 2580 scope.go:117] "RemoveContainer" containerID="7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99" Jul 16 16:55:30.732718 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.732702 2580 scope.go:117] "RemoveContainer" containerID="ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b" Jul 16 16:55:30.732964 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:55:30.732945 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b\": container with ID starting with ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b not found: ID does not exist" containerID="ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b" Jul 16 16:55:30.733013 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.732972 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b"} err="failed to get container status \"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b\": rpc error: code = NotFound desc = could not find container \"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b\": container with ID starting with ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b not found: ID does not exist" Jul 16 16:55:30.733013 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733003 2580 scope.go:117] "RemoveContainer" containerID="233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8" Jul 16 16:55:30.733252 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:55:30.733202 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8\": container with ID starting with 233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8 not found: ID does not exist" containerID="233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8" Jul 16 16:55:30.733289 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733255 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8"} err="failed to get container status \"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8\": rpc error: code = NotFound desc = could not find container \"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8\": container with ID starting with 233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8 not found: ID does not exist" Jul 16 16:55:30.733289 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733268 2580 scope.go:117] "RemoveContainer" containerID="e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4" Jul 16 16:55:30.733495 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:55:30.733478 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4\": container with ID starting with e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4 not found: ID does not exist" containerID="e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4" Jul 16 16:55:30.733546 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733502 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4"} err="failed to get container status \"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4\": rpc error: code = NotFound desc = could not find container \"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4\": container with ID starting with e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4 not found: ID does not exist" Jul 16 16:55:30.733546 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733520 2580 scope.go:117] "RemoveContainer" containerID="f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d" Jul 16 16:55:30.733731 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:55:30.733716 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d\": container with ID starting with f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d not found: ID does not exist" containerID="f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d" Jul 16 16:55:30.733768 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733734 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d"} err="failed to get container status \"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d\": rpc error: code = NotFound desc = could not find container \"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d\": container with ID starting with f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d not found: ID does not exist" Jul 16 16:55:30.733768 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733755 2580 scope.go:117] "RemoveContainer" containerID="064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b" Jul 16 16:55:30.733934 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:55:30.733916 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b\": container with ID starting with 064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b not found: ID does not exist" containerID="064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b" Jul 16 16:55:30.733971 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733940 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b"} err="failed to get container status \"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b\": rpc error: code = NotFound desc = could not find container \"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b\": container with ID starting with 064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b not found: ID does not exist" Jul 16 16:55:30.733971 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.733954 2580 scope.go:117] "RemoveContainer" containerID="ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3" Jul 16 16:55:30.734131 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:55:30.734117 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3\": container with ID starting with ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3 not found: ID does not exist" containerID="ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3" Jul 16 16:55:30.734170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.734133 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3"} err="failed to get container status \"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3\": rpc error: code = NotFound desc = could not find container \"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3\": container with ID starting with ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3 not found: ID does not exist" Jul 16 16:55:30.734170 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.734145 2580 scope.go:117] "RemoveContainer" containerID="7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99" Jul 16 16:55:30.734363 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:55:30.734348 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99\": container with ID starting with 7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99 not found: ID does not exist" containerID="7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99" Jul 16 16:55:30.734401 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.734367 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99"} err="failed to get container status \"7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99\": rpc error: code = NotFound desc = could not find container \"7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99\": container with ID starting with 7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99 not found: ID does not exist" Jul 16 16:55:30.734401 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.734380 2580 scope.go:117] "RemoveContainer" containerID="ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b" Jul 16 16:55:30.734635 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.734617 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b"} err="failed to get container status \"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b\": rpc error: code = NotFound desc = could not find container \"ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b\": container with ID starting with ec3dbf19d989ed362a2504312e75b2d784d2e72bdad790c169136af7e047ea2b not found: ID does not exist" Jul 16 16:55:30.734635 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.734635 2580 scope.go:117] "RemoveContainer" containerID="233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8" Jul 16 16:55:30.734834 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.734820 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8"} err="failed to get container status \"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8\": rpc error: code = NotFound desc = could not find container \"233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8\": container with ID starting with 233a45a709d50c8c7502ea6d0923fa323b4347e792868b1f141ebb1a644fe1a8 not found: ID does not exist" Jul 16 16:55:30.734876 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.734834 2580 scope.go:117] "RemoveContainer" containerID="e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4" Jul 16 16:55:30.735019 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735003 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4"} err="failed to get container status \"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4\": rpc error: code = NotFound desc = could not find container \"e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4\": container with ID starting with e7d9783b98e77cac2a7ff94f0503793412a9224192da635e6e49d98a8f3eebb4 not found: ID does not exist" Jul 16 16:55:30.735064 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735021 2580 scope.go:117] "RemoveContainer" containerID="f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d" Jul 16 16:55:30.735335 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735314 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d"} err="failed to get container status \"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d\": rpc error: code = NotFound desc = could not find container \"f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d\": container with ID starting with f72a3f628fc82b8a1f271f6786304c7b88c9987d3a6a755000a88caae91e4a7d not found: ID does not exist" Jul 16 16:55:30.735335 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735334 2580 scope.go:117] "RemoveContainer" containerID="064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b" Jul 16 16:55:30.735564 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735548 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b"} err="failed to get container status \"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b\": rpc error: code = NotFound desc = could not find container \"064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b\": container with ID starting with 064d27cc4cf0a6880f8630d4b301bbeeee7bc2931b79ba42dc656170490ac41b not found: ID does not exist" Jul 16 16:55:30.735611 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735565 2580 scope.go:117] "RemoveContainer" containerID="ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3" Jul 16 16:55:30.735755 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735739 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3"} err="failed to get container status \"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3\": rpc error: code = NotFound desc = could not find container \"ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3\": container with ID starting with ef3c1c255a8691bad330f2d33bef7badff51b6741e71f8b1d8e6196b5b9412d3 not found: ID does not exist" Jul 16 16:55:30.735800 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735754 2580 scope.go:117] "RemoveContainer" containerID="7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99" Jul 16 16:55:30.735926 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.735911 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99"} err="failed to get container status \"7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99\": rpc error: code = NotFound desc = could not find container \"7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99\": container with ID starting with 7365a973abafc26f2869bdc1e199c4f53d43747f50c83793921465fbdae27b99 not found: ID does not exist" Jul 16 16:55:30.752324 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.752304 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" path="/var/lib/kubelet/pods/02605109-8a13-4479-a2b6-0390a2f06bf2/volumes" Jul 16 16:55:30.752813 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.752791 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:55:30.753258 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753246 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="init-config-reloader" Jul 16 16:55:30.753297 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753259 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="init-config-reloader" Jul 16 16:55:30.753297 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753267 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy" Jul 16 16:55:30.753297 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753273 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy" Jul 16 16:55:30.753297 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753278 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="alertmanager" Jul 16 16:55:30.753297 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753283 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="alertmanager" Jul 16 16:55:30.753297 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753290 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy-metric" Jul 16 16:55:30.753297 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753295 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy-metric" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753304 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="config-reloader" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753309 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="config-reloader" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753316 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy-web" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753322 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy-web" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753329 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="prom-label-proxy" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753334 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="prom-label-proxy" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753379 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753387 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="config-reloader" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753392 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy-web" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753397 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="prom-label-proxy" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753403 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="alertmanager" Jul 16 16:55:30.753493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.753409 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="02605109-8a13-4479-a2b6-0390a2f06bf2" containerName="kube-rbac-proxy-metric" Jul 16 16:55:30.758527 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.758513 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.761581 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.761552 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 16 16:55:30.761872 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.761857 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 16 16:55:30.761976 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.761958 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 16 16:55:30.762016 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.761972 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 16 16:55:30.762057 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.762045 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 16 16:55:30.762330 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.762301 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 16 16:55:30.762488 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.762306 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 16 16:55:30.762558 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.762546 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 16 16:55:30.763398 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.763383 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-647sz\"" Jul 16 16:55:30.766663 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.766641 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:55:30.768970 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.768948 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 16 16:55:30.879124 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879095 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879270 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879270 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879270 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879250 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879487 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879291 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sb8g\" (UniqueName: \"kubernetes.io/projected/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-kube-api-access-9sb8g\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879487 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879380 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879487 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879476 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879601 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879507 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-config-out\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879601 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879569 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879680 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879680 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879644 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879680 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879673 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-web-config\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.879781 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.879699 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.980710 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.980710 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980680 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.980710 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-config-out\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.980915 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980727 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.980915 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980748 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.980915 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980763 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.980915 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980784 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-web-config\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.981095 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980924 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.981095 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980949 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.981095 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.980969 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.981095 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.981001 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.981095 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.981041 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.981095 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.981064 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sb8g\" (UniqueName: \"kubernetes.io/projected/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-kube-api-access-9sb8g\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.981475 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.981443 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.982064 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.981705 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.982185 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.982163 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.984126 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.984096 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.984246 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.984145 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.984320 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.984306 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-config-out\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.984379 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.984328 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.984524 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.984505 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.984577 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.984529 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-config-volume\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.984670 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.984649 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.985193 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.985159 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.985449 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.985433 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-web-config\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:30.989784 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:30.989765 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sb8g\" (UniqueName: \"kubernetes.io/projected/cdc191bf-9359-4c25-8d15-f9e4c7eaa37b-kube-api-access-9sb8g\") pod \"alertmanager-main-0\" (UID: \"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b\") " pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:31.067767 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:31.067738 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 16 16:55:31.210838 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:31.210812 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 16 16:55:31.212907 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:55:31.212874 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc191bf_9359_4c25_8d15_f9e4c7eaa37b.slice/crio-f1762b0798c2813abb8b636b3b77b761627ef31fa3df10d0e2873e7372a2eed2 WatchSource:0}: Error finding container f1762b0798c2813abb8b636b3b77b761627ef31fa3df10d0e2873e7372a2eed2: Status 404 returned error can't find the container with id f1762b0798c2813abb8b636b3b77b761627ef31fa3df10d0e2873e7372a2eed2 Jul 16 16:55:31.688356 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:31.688320 2580 generic.go:356] "Generic (PLEG): container finished" podID="cdc191bf-9359-4c25-8d15-f9e4c7eaa37b" containerID="05bd1d297f0c6f35df5dc1c15e0f3b452e70b079436c192d76765e103a317cbe" exitCode=0 Jul 16 16:55:31.688524 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:31.688413 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b","Type":"ContainerDied","Data":"05bd1d297f0c6f35df5dc1c15e0f3b452e70b079436c192d76765e103a317cbe"} Jul 16 16:55:31.688524 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:31.688483 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b","Type":"ContainerStarted","Data":"f1762b0798c2813abb8b636b3b77b761627ef31fa3df10d0e2873e7372a2eed2"} Jul 16 16:55:32.695797 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:32.695757 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b","Type":"ContainerStarted","Data":"994ba900a9c255e37fc5e573d0d20ec508646890ad3e58e23f4db3dda5452faa"} Jul 16 16:55:32.696273 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:32.695862 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b","Type":"ContainerStarted","Data":"97280d24f27c34a43a4783592341ba0f497adfcd2208a3f77c9da5ca504ad4aa"} Jul 16 16:55:32.696273 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:32.695890 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b","Type":"ContainerStarted","Data":"a12f78a0c17c4311f748c12df9e754b0534c3829a57abfc9c1c3c61a0d345ecc"} Jul 16 16:55:32.696273 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:32.695923 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b","Type":"ContainerStarted","Data":"93c272be942630e90c2ec14f759c4ff31a2e99a402b2e17f1fa6667599654f3f"} Jul 16 16:55:32.696273 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:32.695950 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b","Type":"ContainerStarted","Data":"5f67999ecc70b7edd8e5cd6ef24ac9e7fd257d37d2d817ed2df66f4e9ca900e9"} Jul 16 16:55:32.696273 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:32.695976 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cdc191bf-9359-4c25-8d15-f9e4c7eaa37b","Type":"ContainerStarted","Data":"9ba22b0f1bad44992d3527ca039559e2d293bdabb66822eccf7637db873152bc"} Jul 16 16:55:32.728110 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:55:32.728050 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.713894738 podStartE2EDuration="2.728033209s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.138471ms" isStatefulPod=false podCreationTimestamp="2026-07-16 16:55:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:55:32.726570477 +0000 UTC m=+162.538717229" watchObservedRunningTime="2026-07-16 16:55:32.728033209 +0000 UTC m=+162.540179957" Jul 16 16:57:30.299276 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.299175 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv"] Jul 16 16:57:30.302797 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.302777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.305405 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.305386 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-vz8vp\"" Jul 16 16:57:30.305527 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.305387 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 16:57:30.305527 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.305419 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 16:57:30.311649 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.311614 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv"] Jul 16 16:57:30.449511 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.449471 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.449687 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.449529 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b85wr\" (UniqueName: \"kubernetes.io/projected/ba631806-cc21-4566-81dd-931cb569d435-kube-api-access-b85wr\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.449687 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.449618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.550250 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.550130 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.550250 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.550188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.550250 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.550241 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b85wr\" (UniqueName: \"kubernetes.io/projected/ba631806-cc21-4566-81dd-931cb569d435-kube-api-access-b85wr\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.550629 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.550604 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.550691 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.550611 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.559107 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.559083 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b85wr\" (UniqueName: \"kubernetes.io/projected/ba631806-cc21-4566-81dd-931cb569d435-kube-api-access-b85wr\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.613001 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.612959 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:30.747206 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:57:30.747167 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba631806_cc21_4566_81dd_931cb569d435.slice/crio-79c69c71d99a6549c56cd2e8a3ae53eee603c730ff2e102cd63f6f86da14c9be WatchSource:0}: Error finding container 79c69c71d99a6549c56cd2e8a3ae53eee603c730ff2e102cd63f6f86da14c9be: Status 404 returned error can't find the container with id 79c69c71d99a6549c56cd2e8a3ae53eee603c730ff2e102cd63f6f86da14c9be Jul 16 16:57:30.748737 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:30.748714 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv"] Jul 16 16:57:31.141326 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:31.141289 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" event={"ID":"ba631806-cc21-4566-81dd-931cb569d435","Type":"ContainerStarted","Data":"79c69c71d99a6549c56cd2e8a3ae53eee603c730ff2e102cd63f6f86da14c9be"} Jul 16 16:57:37.167877 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:37.167837 2580 generic.go:356] "Generic (PLEG): container finished" podID="ba631806-cc21-4566-81dd-931cb569d435" containerID="b824e1c6dfe91f0e9193aa0087830fb148d9fd8fe02a4731901691cadeb5b618" exitCode=0 Jul 16 16:57:37.168396 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:37.167927 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" event={"ID":"ba631806-cc21-4566-81dd-931cb569d435","Type":"ContainerDied","Data":"b824e1c6dfe91f0e9193aa0087830fb148d9fd8fe02a4731901691cadeb5b618"} Jul 16 16:57:39.178570 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:39.178484 2580 generic.go:356] "Generic (PLEG): container finished" podID="ba631806-cc21-4566-81dd-931cb569d435" containerID="fcbc3912d94e4dae6373def183fb1f4076d812b055ed528c35bc427e4e1ac170" exitCode=0 Jul 16 16:57:39.178914 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:39.178567 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" event={"ID":"ba631806-cc21-4566-81dd-931cb569d435","Type":"ContainerDied","Data":"fcbc3912d94e4dae6373def183fb1f4076d812b055ed528c35bc427e4e1ac170"} Jul 16 16:57:46.211973 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:46.211936 2580 generic.go:356] "Generic (PLEG): container finished" podID="ba631806-cc21-4566-81dd-931cb569d435" containerID="e5679016c8aa0c252f7e6ba14c3e1c08f638afb873699e4cfd3fbc3fb20c5368" exitCode=0 Jul 16 16:57:46.212372 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:46.212014 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" event={"ID":"ba631806-cc21-4566-81dd-931cb569d435","Type":"ContainerDied","Data":"e5679016c8aa0c252f7e6ba14c3e1c08f638afb873699e4cfd3fbc3fb20c5368"} Jul 16 16:57:47.334979 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.334952 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:47.500958 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.500864 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-bundle\") pod \"ba631806-cc21-4566-81dd-931cb569d435\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " Jul 16 16:57:47.501110 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.500969 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-util\") pod \"ba631806-cc21-4566-81dd-931cb569d435\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " Jul 16 16:57:47.501110 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.500989 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b85wr\" (UniqueName: \"kubernetes.io/projected/ba631806-cc21-4566-81dd-931cb569d435-kube-api-access-b85wr\") pod \"ba631806-cc21-4566-81dd-931cb569d435\" (UID: \"ba631806-cc21-4566-81dd-931cb569d435\") " Jul 16 16:57:47.501764 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.501734 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-bundle" (OuterVolumeSpecName: "bundle") pod "ba631806-cc21-4566-81dd-931cb569d435" (UID: "ba631806-cc21-4566-81dd-931cb569d435"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:57:47.503166 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.503141 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba631806-cc21-4566-81dd-931cb569d435-kube-api-access-b85wr" (OuterVolumeSpecName: "kube-api-access-b85wr") pod "ba631806-cc21-4566-81dd-931cb569d435" (UID: "ba631806-cc21-4566-81dd-931cb569d435"). InnerVolumeSpecName "kube-api-access-b85wr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 16:57:47.506387 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.506355 2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-util" (OuterVolumeSpecName: "util") pod "ba631806-cc21-4566-81dd-931cb569d435" (UID: "ba631806-cc21-4566-81dd-931cb569d435"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 16:57:47.606498 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.602136 2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-util\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:57:47.606498 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.602178 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b85wr\" (UniqueName: \"kubernetes.io/projected/ba631806-cc21-4566-81dd-931cb569d435-kube-api-access-b85wr\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:57:47.606498 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:47.602192 2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ba631806-cc21-4566-81dd-931cb569d435-bundle\") on node \"ip-10-0-136-73.ec2.internal\" DevicePath \"\"" Jul 16 16:57:48.222042 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:48.222007 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" event={"ID":"ba631806-cc21-4566-81dd-931cb569d435","Type":"ContainerDied","Data":"79c69c71d99a6549c56cd2e8a3ae53eee603c730ff2e102cd63f6f86da14c9be"} Jul 16 16:57:48.222042 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:48.222023 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5bztzv" Jul 16 16:57:48.222265 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:48.222052 2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79c69c71d99a6549c56cd2e8a3ae53eee603c730ff2e102cd63f6f86da14c9be" Jul 16 16:57:50.602360 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:50.602334 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 16:57:50.602801 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:50.602682 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 16:57:50.608737 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:50.608716 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 16:57:50.609164 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:50.609131 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 16:57:50.614624 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:50.614600 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 16:57:52.425154 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.425116 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b"] Jul 16 16:57:52.426400 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.425449 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba631806-cc21-4566-81dd-931cb569d435" containerName="util" Jul 16 16:57:52.426400 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.425462 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba631806-cc21-4566-81dd-931cb569d435" containerName="util" Jul 16 16:57:52.426400 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.425471 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba631806-cc21-4566-81dd-931cb569d435" containerName="pull" Jul 16 16:57:52.426400 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.425477 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba631806-cc21-4566-81dd-931cb569d435" containerName="pull" Jul 16 16:57:52.426400 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.425483 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba631806-cc21-4566-81dd-931cb569d435" containerName="extract" Jul 16 16:57:52.426400 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.425489 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba631806-cc21-4566-81dd-931cb569d435" containerName="extract" Jul 16 16:57:52.426400 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.425545 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba631806-cc21-4566-81dd-931cb569d435" containerName="extract" Jul 16 16:57:52.427124 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.427108 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:52.429675 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.429650 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 16 16:57:52.429804 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.429741 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 16 16:57:52.429804 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.429742 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 16 16:57:52.430563 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.430545 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-mgfpl\"" Jul 16 16:57:52.440191 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.440168 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b"] Jul 16 16:57:52.536645 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.536610 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/65937923-6b97-48e8-bf22-60e63b8f2978-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b\" (UID: \"65937923-6b97-48e8-bf22-60e63b8f2978\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:52.536809 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.536651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4btvp\" (UniqueName: \"kubernetes.io/projected/65937923-6b97-48e8-bf22-60e63b8f2978-kube-api-access-4btvp\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b\" (UID: \"65937923-6b97-48e8-bf22-60e63b8f2978\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:52.637891 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.637852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/65937923-6b97-48e8-bf22-60e63b8f2978-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b\" (UID: \"65937923-6b97-48e8-bf22-60e63b8f2978\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:52.637891 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.637893 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4btvp\" (UniqueName: \"kubernetes.io/projected/65937923-6b97-48e8-bf22-60e63b8f2978-kube-api-access-4btvp\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b\" (UID: \"65937923-6b97-48e8-bf22-60e63b8f2978\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:52.640187 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.640155 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/65937923-6b97-48e8-bf22-60e63b8f2978-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b\" (UID: \"65937923-6b97-48e8-bf22-60e63b8f2978\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:52.646864 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.646841 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4btvp\" (UniqueName: \"kubernetes.io/projected/65937923-6b97-48e8-bf22-60e63b8f2978-kube-api-access-4btvp\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b\" (UID: \"65937923-6b97-48e8-bf22-60e63b8f2978\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:52.737882 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.737776 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:52.867758 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.867726 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b"] Jul 16 16:57:52.871025 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:57:52.870993 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65937923_6b97_48e8_bf22_60e63b8f2978.slice/crio-343d52a1bcd49a625f753d0ab850c3b5c5c9a552e254e9ab5f89e7904378f121 WatchSource:0}: Error finding container 343d52a1bcd49a625f753d0ab850c3b5c5c9a552e254e9ab5f89e7904378f121: Status 404 returned error can't find the container with id 343d52a1bcd49a625f753d0ab850c3b5c5c9a552e254e9ab5f89e7904378f121 Jul 16 16:57:52.872782 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:52.872764 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 16:57:53.243994 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:53.243963 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" event={"ID":"65937923-6b97-48e8-bf22-60e63b8f2978","Type":"ContainerStarted","Data":"343d52a1bcd49a625f753d0ab850c3b5c5c9a552e254e9ab5f89e7904378f121"} Jul 16 16:57:56.262656 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.262619 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" event={"ID":"65937923-6b97-48e8-bf22-60e63b8f2978","Type":"ContainerStarted","Data":"c47f0717db46d8febeef67f99ae59a3a99dc73e4a49a8d7431190e5c4d08279b"} Jul 16 16:57:56.263137 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.262767 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:57:56.286244 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.286178 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" podStartSLOduration=1.798954757 podStartE2EDuration="4.286159624s" totalImagesPullingTime="2.487204867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:57:56.284464029 +0000 UTC m=+306.096610791" watchObservedRunningTime="2026-07-16 16:57:56.286159624 +0000 UTC m=+306.098306375" Jul 16 16:57:56.729364 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.729326 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-f29fz"] Jul 16 16:57:56.731471 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.731448 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:56.733849 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.733822 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 16 16:57:56.733986 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.733907 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-8sjl8\"" Jul 16 16:57:56.733986 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.733951 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 16 16:57:56.749446 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.749414 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-f29fz"] Jul 16 16:57:56.772590 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.772552 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cp8q\" (UniqueName: \"kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-kube-api-access-5cp8q\") pod \"keda-admission-56f9798bb4-f29fz\" (UID: \"b8c1c8ee-f5f2-441c-9942-5e02834384ce\") " pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:56.772759 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.772602 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-certificates\") pod \"keda-admission-56f9798bb4-f29fz\" (UID: \"b8c1c8ee-f5f2-441c-9942-5e02834384ce\") " pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:56.873592 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.873552 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-certificates\") pod \"keda-admission-56f9798bb4-f29fz\" (UID: \"b8c1c8ee-f5f2-441c-9942-5e02834384ce\") " pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:56.873778 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.873677 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cp8q\" (UniqueName: \"kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-kube-api-access-5cp8q\") pod \"keda-admission-56f9798bb4-f29fz\" (UID: \"b8c1c8ee-f5f2-441c-9942-5e02834384ce\") " pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:56.873778 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:57:56.873707 2580 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found Jul 16 16:57:56.873778 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:57:56.873731 2580 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-f29fz: secret "keda-admission-webhooks-certs" not found Jul 16 16:57:56.873938 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:57:56.873784 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-certificates podName:b8c1c8ee-f5f2-441c-9942-5e02834384ce nodeName:}" failed. No retries permitted until 2026-07-16 16:57:57.373767621 +0000 UTC m=+307.185914353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-certificates") pod "keda-admission-56f9798bb4-f29fz" (UID: "b8c1c8ee-f5f2-441c-9942-5e02834384ce") : secret "keda-admission-webhooks-certs" not found Jul 16 16:57:56.884152 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:56.884114 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cp8q\" (UniqueName: \"kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-kube-api-access-5cp8q\") pod \"keda-admission-56f9798bb4-f29fz\" (UID: \"b8c1c8ee-f5f2-441c-9942-5e02834384ce\") " pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:57.377150 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:57.377118 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-certificates\") pod \"keda-admission-56f9798bb4-f29fz\" (UID: \"b8c1c8ee-f5f2-441c-9942-5e02834384ce\") " pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:57.379563 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:57.379535 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/b8c1c8ee-f5f2-441c-9942-5e02834384ce-certificates\") pod \"keda-admission-56f9798bb4-f29fz\" (UID: \"b8c1c8ee-f5f2-441c-9942-5e02834384ce\") " pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:57.642070 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:57.641988 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:57:57.774127 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:57.774099 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-f29fz"] Jul 16 16:57:57.776357 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:57:57.776325 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c1c8ee_f5f2_441c_9942_5e02834384ce.slice/crio-06fdfa4e1bb921e590031af542c7db67f75be66dfbf90a70c4551a818f7af36a WatchSource:0}: Error finding container 06fdfa4e1bb921e590031af542c7db67f75be66dfbf90a70c4551a818f7af36a: Status 404 returned error can't find the container with id 06fdfa4e1bb921e590031af542c7db67f75be66dfbf90a70c4551a818f7af36a Jul 16 16:57:58.272334 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:57:58.272301 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-f29fz" event={"ID":"b8c1c8ee-f5f2-441c-9942-5e02834384ce","Type":"ContainerStarted","Data":"06fdfa4e1bb921e590031af542c7db67f75be66dfbf90a70c4551a818f7af36a"} Jul 16 16:58:04.298438 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:58:04.298400 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-f29fz" event={"ID":"b8c1c8ee-f5f2-441c-9942-5e02834384ce","Type":"ContainerStarted","Data":"f4861238fbfc28eec3d4c493ca142362a7bab63bf2b473d050f0d262930efee6"} Jul 16 16:58:04.298861 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:58:04.298537 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:58:04.315532 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:58:04.315483 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-f29fz" podStartSLOduration=2.50504838 podStartE2EDuration="8.315456819s" totalImagesPullingTime="5.810408439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:57:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:58:04.313529683 +0000 UTC m=+314.125676435" watchObservedRunningTime="2026-07-16 16:58:04.315456819 +0000 UTC m=+314.127603570" Jul 16 16:58:17.269609 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:58:17.269574 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-hqg2b" Jul 16 16:58:25.305538 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:58:25.305505 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-f29fz" Jul 16 16:59:04.076844 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.076767 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4vrfh"] Jul 16 16:59:04.080098 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.080083 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:04.083636 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.083610 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-dk685\"" Jul 16 16:59:04.083636 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.083634 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 16 16:59:04.083811 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.083731 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 16 16:59:04.083864 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.083849 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 16 16:59:04.090340 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.090320 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4vrfh"] Jul 16 16:59:04.093136 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.093115 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm"] Jul 16 16:59:04.096197 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.096180 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:04.098456 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.098432 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-82lrl\"" Jul 16 16:59:04.098552 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.098534 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 16 16:59:04.107781 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.107760 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm"] Jul 16 16:59:04.131068 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.131040 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wml8f\" (UniqueName: \"kubernetes.io/projected/005c0f5c-5f17-4629-bf8d-6b0d87654e98-kube-api-access-wml8f\") pod \"kserve-controller-manager-d55957fc4-4vrfh\" (UID: \"005c0f5c-5f17-4629-bf8d-6b0d87654e98\") " pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:04.131172 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.131094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9e3cba8-e12a-4f5a-b3c3-030c5dedce75-cert\") pod \"llmisvc-controller-manager-7fcc57dcd5-56xbm\" (UID: \"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75\") " pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:04.131238 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.131178 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mqww\" (UniqueName: \"kubernetes.io/projected/a9e3cba8-e12a-4f5a-b3c3-030c5dedce75-kube-api-access-2mqww\") pod \"llmisvc-controller-manager-7fcc57dcd5-56xbm\" (UID: \"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75\") " pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:04.131287 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.131248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/005c0f5c-5f17-4629-bf8d-6b0d87654e98-cert\") pod \"kserve-controller-manager-d55957fc4-4vrfh\" (UID: \"005c0f5c-5f17-4629-bf8d-6b0d87654e98\") " pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:04.231823 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.231789 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/005c0f5c-5f17-4629-bf8d-6b0d87654e98-cert\") pod \"kserve-controller-manager-d55957fc4-4vrfh\" (UID: \"005c0f5c-5f17-4629-bf8d-6b0d87654e98\") " pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:04.231823 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.231827 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wml8f\" (UniqueName: \"kubernetes.io/projected/005c0f5c-5f17-4629-bf8d-6b0d87654e98-kube-api-access-wml8f\") pod \"kserve-controller-manager-d55957fc4-4vrfh\" (UID: \"005c0f5c-5f17-4629-bf8d-6b0d87654e98\") " pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:04.232066 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.231855 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9e3cba8-e12a-4f5a-b3c3-030c5dedce75-cert\") pod \"llmisvc-controller-manager-7fcc57dcd5-56xbm\" (UID: \"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75\") " pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:04.232066 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.232042 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mqww\" (UniqueName: \"kubernetes.io/projected/a9e3cba8-e12a-4f5a-b3c3-030c5dedce75-kube-api-access-2mqww\") pod \"llmisvc-controller-manager-7fcc57dcd5-56xbm\" (UID: \"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75\") " pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:04.234363 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.234335 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a9e3cba8-e12a-4f5a-b3c3-030c5dedce75-cert\") pod \"llmisvc-controller-manager-7fcc57dcd5-56xbm\" (UID: \"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75\") " pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:04.234457 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.234392 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/005c0f5c-5f17-4629-bf8d-6b0d87654e98-cert\") pod \"kserve-controller-manager-d55957fc4-4vrfh\" (UID: \"005c0f5c-5f17-4629-bf8d-6b0d87654e98\") " pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:04.249312 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.249282 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mqww\" (UniqueName: \"kubernetes.io/projected/a9e3cba8-e12a-4f5a-b3c3-030c5dedce75-kube-api-access-2mqww\") pod \"llmisvc-controller-manager-7fcc57dcd5-56xbm\" (UID: \"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75\") " pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:04.249412 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.249349 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wml8f\" (UniqueName: \"kubernetes.io/projected/005c0f5c-5f17-4629-bf8d-6b0d87654e98-kube-api-access-wml8f\") pod \"kserve-controller-manager-d55957fc4-4vrfh\" (UID: \"005c0f5c-5f17-4629-bf8d-6b0d87654e98\") " pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:04.391141 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.391111 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:04.406136 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.406113 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:04.528799 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.528770 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-d55957fc4-4vrfh"] Jul 16 16:59:04.530676 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:59:04.530650 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod005c0f5c_5f17_4629_bf8d_6b0d87654e98.slice/crio-e7c1a8573e92f2142014cced1324dabefd551f7c41be1bcb35f0be2b28497839 WatchSource:0}: Error finding container e7c1a8573e92f2142014cced1324dabefd551f7c41be1bcb35f0be2b28497839: Status 404 returned error can't find the container with id e7c1a8573e92f2142014cced1324dabefd551f7c41be1bcb35f0be2b28497839 Jul 16 16:59:04.547420 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.547395 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm"] Jul 16 16:59:04.549947 ip-10-0-136-73 kubenswrapper[2580]: W0716 16:59:04.549922 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda9e3cba8_e12a_4f5a_b3c3_030c5dedce75.slice/crio-5889e75bdc61161a0e186540ad515b479f846ec088bc0eff935fa47cfb80750b WatchSource:0}: Error finding container 5889e75bdc61161a0e186540ad515b479f846ec088bc0eff935fa47cfb80750b: Status 404 returned error can't find the container with id 5889e75bdc61161a0e186540ad515b479f846ec088bc0eff935fa47cfb80750b Jul 16 16:59:04.556762 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.556736 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerStarted","Data":"e7c1a8573e92f2142014cced1324dabefd551f7c41be1bcb35f0be2b28497839"} Jul 16 16:59:04.557775 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:04.557755 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerStarted","Data":"5889e75bdc61161a0e186540ad515b479f846ec088bc0eff935fa47cfb80750b"} Jul 16 16:59:08.580294 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:08.580180 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerStarted","Data":"ed63176d59ccdb7c6d2d1d68a532044c69dbe5a21f9d7ac6f4f160cd607e270d"} Jul 16 16:59:08.580294 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:08.580278 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:08.581890 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:08.581871 2580 generic.go:356] "Generic (PLEG): container finished" podID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" containerID="fec4c8ebce449828564b9ef9772c03c55b4057537559c511efa4cef2f4e22017" exitCode=1 Jul 16 16:59:08.581967 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:08.581897 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerDied","Data":"fec4c8ebce449828564b9ef9772c03c55b4057537559c511efa4cef2f4e22017"} Jul 16 16:59:08.582092 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:08.582079 2580 scope.go:117] "RemoveContainer" containerID="fec4c8ebce449828564b9ef9772c03c55b4057537559c511efa4cef2f4e22017" Jul 16 16:59:08.599903 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:08.599863 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podStartSLOduration=0.905252247 podStartE2EDuration="4.599849639s" totalImagesPullingTime="3.694597392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 16:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 16:59:08.596946863 +0000 UTC m=+378.409093613" watchObservedRunningTime="2026-07-16 16:59:08.599849639 +0000 UTC m=+378.411996390" Jul 16 16:59:09.391983 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:09.391954 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:09.588751 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:09.588711 2580 generic.go:356] "Generic (PLEG): container finished" podID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" containerID="8ad114d2ce101d9b42430a42ad758ecfd2dd9ce37388ba6c786bec7beccff6cb" exitCode=1 Jul 16 16:59:09.589171 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:09.588759 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerDied","Data":"8ad114d2ce101d9b42430a42ad758ecfd2dd9ce37388ba6c786bec7beccff6cb"} Jul 16 16:59:09.589171 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:09.588818 2580 scope.go:117] "RemoveContainer" containerID="fec4c8ebce449828564b9ef9772c03c55b4057537559c511efa4cef2f4e22017" Jul 16 16:59:09.589171 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:09.589021 2580 scope.go:117] "RemoveContainer" containerID="8ad114d2ce101d9b42430a42ad758ecfd2dd9ce37388ba6c786bec7beccff6cb" Jul 16 16:59:09.589364 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:09.589262 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 16:59:09.590299 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:09.590282 2580 generic.go:356] "Generic (PLEG): container finished" podID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" containerID="ed63176d59ccdb7c6d2d1d68a532044c69dbe5a21f9d7ac6f4f160cd607e270d" exitCode=1 Jul 16 16:59:09.590380 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:09.590337 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerDied","Data":"ed63176d59ccdb7c6d2d1d68a532044c69dbe5a21f9d7ac6f4f160cd607e270d"} Jul 16 16:59:09.590616 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:09.590598 2580 scope.go:117] "RemoveContainer" containerID="ed63176d59ccdb7c6d2d1d68a532044c69dbe5a21f9d7ac6f4f160cd607e270d" Jul 16 16:59:10.596070 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:10.596045 2580 scope.go:117] "RemoveContainer" containerID="8ad114d2ce101d9b42430a42ad758ecfd2dd9ce37388ba6c786bec7beccff6cb" Jul 16 16:59:10.596530 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:10.596257 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 16:59:10.597664 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:10.597635 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerStarted","Data":"112d133124df339695424843a56b129748f9b90afa8bf3358a9833faa457fee9"} Jul 16 16:59:10.597788 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:10.597773 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:11.605251 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:11.605200 2580 generic.go:356] "Generic (PLEG): container finished" podID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" containerID="112d133124df339695424843a56b129748f9b90afa8bf3358a9833faa457fee9" exitCode=1 Jul 16 16:59:11.605663 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:11.605292 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerDied","Data":"112d133124df339695424843a56b129748f9b90afa8bf3358a9833faa457fee9"} Jul 16 16:59:11.605663 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:11.605358 2580 scope.go:117] "RemoveContainer" containerID="ed63176d59ccdb7c6d2d1d68a532044c69dbe5a21f9d7ac6f4f160cd607e270d" Jul 16 16:59:11.605663 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:11.605651 2580 scope.go:117] "RemoveContainer" containerID="112d133124df339695424843a56b129748f9b90afa8bf3358a9833faa457fee9" Jul 16 16:59:11.605845 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:11.605824 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 16:59:12.610733 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:12.610708 2580 scope.go:117] "RemoveContainer" containerID="112d133124df339695424843a56b129748f9b90afa8bf3358a9833faa457fee9" Jul 16 16:59:12.611116 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:12.610875 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 16:59:14.391696 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:14.391666 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:14.392054 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:14.391717 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:14.392054 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:14.392038 2580 scope.go:117] "RemoveContainer" containerID="8ad114d2ce101d9b42430a42ad758ecfd2dd9ce37388ba6c786bec7beccff6cb" Jul 16 16:59:14.392233 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:14.392201 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 16:59:14.406694 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:14.406667 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:14.406985 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:14.406972 2580 scope.go:117] "RemoveContainer" containerID="112d133124df339695424843a56b129748f9b90afa8bf3358a9833faa457fee9" Jul 16 16:59:14.407147 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:14.407130 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 16:59:25.742890 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:25.742859 2580 scope.go:117] "RemoveContainer" containerID="8ad114d2ce101d9b42430a42ad758ecfd2dd9ce37388ba6c786bec7beccff6cb" Jul 16 16:59:26.674511 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:26.674474 2580 generic.go:356] "Generic (PLEG): container finished" podID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" containerID="7703daa4fe4417551bd391a5eeaa68b1a02895c90e4e4fb31c11dc1b8b1efee6" exitCode=1 Jul 16 16:59:26.674672 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:26.674544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerDied","Data":"7703daa4fe4417551bd391a5eeaa68b1a02895c90e4e4fb31c11dc1b8b1efee6"} Jul 16 16:59:26.674672 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:26.674630 2580 scope.go:117] "RemoveContainer" containerID="8ad114d2ce101d9b42430a42ad758ecfd2dd9ce37388ba6c786bec7beccff6cb" Jul 16 16:59:26.674885 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:26.674872 2580 scope.go:117] "RemoveContainer" containerID="7703daa4fe4417551bd391a5eeaa68b1a02895c90e4e4fb31c11dc1b8b1efee6" Jul 16 16:59:26.675098 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:26.675081 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 16:59:27.743124 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:27.743093 2580 scope.go:117] "RemoveContainer" containerID="112d133124df339695424843a56b129748f9b90afa8bf3358a9833faa457fee9" Jul 16 16:59:29.391793 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:29.391763 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:29.392184 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:29.392138 2580 scope.go:117] "RemoveContainer" containerID="7703daa4fe4417551bd391a5eeaa68b1a02895c90e4e4fb31c11dc1b8b1efee6" Jul 16 16:59:29.392365 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:29.392344 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 16:59:30.698989 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:30.698956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerStarted","Data":"99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797"} Jul 16 16:59:30.699388 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:30.699158 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:31.705624 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:31.705585 2580 generic.go:356] "Generic (PLEG): container finished" podID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" containerID="99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797" exitCode=1 Jul 16 16:59:31.706049 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:31.705664 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerDied","Data":"99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797"} Jul 16 16:59:31.706049 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:31.705762 2580 scope.go:117] "RemoveContainer" containerID="112d133124df339695424843a56b129748f9b90afa8bf3358a9833faa457fee9" Jul 16 16:59:31.706049 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:31.706015 2580 scope.go:117] "RemoveContainer" containerID="99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797" Jul 16 16:59:31.706275 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:31.706247 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 16:59:32.715305 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:32.715277 2580 scope.go:117] "RemoveContainer" containerID="99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797" Jul 16 16:59:32.715667 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:32.715451 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 16:59:34.391827 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:34.391791 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:34.392201 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:34.392137 2580 scope.go:117] "RemoveContainer" containerID="7703daa4fe4417551bd391a5eeaa68b1a02895c90e4e4fb31c11dc1b8b1efee6" Jul 16 16:59:34.392362 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:34.392343 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 16:59:34.406505 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:34.406485 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 16:59:34.406744 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:34.406733 2580 scope.go:117] "RemoveContainer" containerID="99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797" Jul 16 16:59:34.406883 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:34.406868 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 16:59:44.743352 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:44.743322 2580 scope.go:117] "RemoveContainer" containerID="99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797" Jul 16 16:59:44.743798 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:44.743484 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 16:59:48.742671 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:48.742636 2580 scope.go:117] "RemoveContainer" containerID="7703daa4fe4417551bd391a5eeaa68b1a02895c90e4e4fb31c11dc1b8b1efee6" Jul 16 16:59:49.789079 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:49.789047 2580 generic.go:356] "Generic (PLEG): container finished" podID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" containerID="cb3fb462157fd7919c1ac5d3cddbb80f21ef7ca2286e0508eb11e4ba0b351fba" exitCode=1 Jul 16 16:59:49.789493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:49.789120 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerDied","Data":"cb3fb462157fd7919c1ac5d3cddbb80f21ef7ca2286e0508eb11e4ba0b351fba"} Jul 16 16:59:49.789493 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:49.789180 2580 scope.go:117] "RemoveContainer" containerID="7703daa4fe4417551bd391a5eeaa68b1a02895c90e4e4fb31c11dc1b8b1efee6" Jul 16 16:59:49.789599 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:49.789499 2580 scope.go:117] "RemoveContainer" containerID="cb3fb462157fd7919c1ac5d3cddbb80f21ef7ca2286e0508eb11e4ba0b351fba" Jul 16 16:59:49.789699 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:49.789682 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 16:59:54.391879 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:54.391849 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:54.392263 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:54.391903 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 16:59:54.392263 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:54.392243 2580 scope.go:117] "RemoveContainer" containerID="cb3fb462157fd7919c1ac5d3cddbb80f21ef7ca2286e0508eb11e4ba0b351fba" Jul 16 16:59:54.392424 ip-10-0-136-73 kubenswrapper[2580]: E0716 16:59:54.392405 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 16:59:58.743088 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:58.743050 2580 scope.go:117] "RemoveContainer" containerID="99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797" Jul 16 16:59:59.838963 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:59.838929 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerStarted","Data":"d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d"} Jul 16 16:59:59.839396 ip-10-0-136-73 kubenswrapper[2580]: I0716 16:59:59.839176 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 17:00:00.844623 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:00.844586 2580 generic.go:356] "Generic (PLEG): container finished" podID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" exitCode=1 Jul 16 17:00:00.845096 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:00.844633 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerDied","Data":"d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d"} Jul 16 17:00:00.845096 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:00.844687 2580 scope.go:117] "RemoveContainer" containerID="99b7c1ae3ebf5ea8440be2eac055ca941e6e7b5a6bc03299c8425f9223dab797" Jul 16 17:00:00.845096 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:00.844823 2580 scope.go:117] "RemoveContainer" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" Jul 16 17:00:00.845096 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:00.845038 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:00:01.850340 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:01.850315 2580 scope.go:117] "RemoveContainer" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" Jul 16 17:00:01.850740 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:01.850478 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:00:04.407314 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:04.407268 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 17:00:04.407834 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:04.407719 2580 scope.go:117] "RemoveContainer" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" Jul 16 17:00:04.407967 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:04.407943 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:00:06.742954 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:06.742914 2580 scope.go:117] "RemoveContainer" containerID="cb3fb462157fd7919c1ac5d3cddbb80f21ef7ca2286e0508eb11e4ba0b351fba" Jul 16 17:00:06.743353 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:06.743086 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:00:14.743254 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:14.743137 2580 scope.go:117] "RemoveContainer" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" Jul 16 17:00:14.743713 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:14.743337 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:00:18.742951 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:18.742915 2580 scope.go:117] "RemoveContainer" containerID="cb3fb462157fd7919c1ac5d3cddbb80f21ef7ca2286e0508eb11e4ba0b351fba" Jul 16 17:00:18.743447 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:18.743087 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:00:27.742880 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:27.742818 2580 scope.go:117] "RemoveContainer" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" Jul 16 17:00:27.743297 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:27.743004 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:00:31.743045 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:31.743018 2580 scope.go:117] "RemoveContainer" containerID="cb3fb462157fd7919c1ac5d3cddbb80f21ef7ca2286e0508eb11e4ba0b351fba" Jul 16 17:00:32.995194 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:32.995157 2580 generic.go:356] "Generic (PLEG): container finished" podID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" exitCode=1 Jul 16 17:00:32.995634 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:32.995202 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerDied","Data":"8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846"} Jul 16 17:00:32.995634 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:32.995281 2580 scope.go:117] "RemoveContainer" containerID="cb3fb462157fd7919c1ac5d3cddbb80f21ef7ca2286e0508eb11e4ba0b351fba" Jul 16 17:00:32.995634 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:32.995587 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:00:32.995781 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:32.995762 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:00:34.391957 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:34.391926 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 17:00:34.392476 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:34.391991 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 17:00:34.392476 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:34.392385 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:00:34.392632 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:34.392610 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:00:38.743380 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:38.743346 2580 scope.go:117] "RemoveContainer" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" Jul 16 17:00:38.743906 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:38.743526 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:00:48.742616 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:48.742581 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:00:48.743000 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:48.742765 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:00:49.742839 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:49.742807 2580 scope.go:117] "RemoveContainer" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" Jul 16 17:00:51.085167 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:51.085132 2580 generic.go:356] "Generic (PLEG): container finished" podID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" exitCode=1 Jul 16 17:00:51.085637 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:51.085179 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerDied","Data":"4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de"} Jul 16 17:00:51.085637 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:51.085257 2580 scope.go:117] "RemoveContainer" containerID="d4c4f7487e0ab54c2bbba0256ab3e3ea65078ec63090c0093066927ad3bb3b7d" Jul 16 17:00:51.085637 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:51.085548 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:00:51.085754 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:51.085735 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:00:54.407111 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:54.407069 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 17:00:54.407551 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:54.407472 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:00:54.407659 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:54.407641 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:00:54.839707 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:54.839610 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 17:00:55.105770 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:00:55.105748 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:00:55.105932 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:00:55.105914 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:01:00.745243 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:00.745197 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:01:00.745628 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:00.745405 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:01:09.742590 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:09.742558 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:01:09.742997 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:09.742745 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:01:14.743242 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:14.743191 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:01:14.743634 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:14.743397 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:01:23.742519 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:23.742485 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:01:23.742981 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:23.742657 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:01:27.742994 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:27.742961 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:01:27.743406 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:27.743164 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:01:38.742903 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:38.742869 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:01:38.743428 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:38.743068 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:01:40.744376 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:40.744346 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:01:40.744764 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:40.744545 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:01:53.742952 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:53.742876 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:01:53.743338 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:53.743055 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:01:54.742963 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:54.742929 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:01:58.386449 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:58.386418 2580 generic.go:356] "Generic (PLEG): container finished" podID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" exitCode=1 Jul 16 17:01:58.386903 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:58.386468 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerDied","Data":"f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba"} Jul 16 17:01:58.386903 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:58.386517 2580 scope.go:117] "RemoveContainer" containerID="8c16b1dd1da4342b93048b1441585a0b0df66c076ae307babfc42ada005ac846" Jul 16 17:01:58.386903 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:58.386786 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:01:58.387017 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:58.386983 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:01:59.391174 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:59.391144 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 17:01:59.391868 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:01:59.391852 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:01:59.392034 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:01:59.392017 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:02:04.391327 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:04.391290 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 17:02:04.391714 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:04.391630 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:02:04.391844 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:04.391824 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:02:05.742850 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:05.742816 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:02:05.743261 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:05.742994 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:02:16.748002 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:16.747972 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:02:16.748453 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:16.748126 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:02:16.748453 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:16.748294 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:02:18.473093 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:18.473060 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerStarted","Data":"36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb"} Jul 16 17:02:18.473481 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:18.473268 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 17:02:19.479622 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:19.479584 2580 generic.go:356] "Generic (PLEG): container finished" podID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" exitCode=1 Jul 16 17:02:19.480050 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:19.479633 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerDied","Data":"36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb"} Jul 16 17:02:19.480050 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:19.479679 2580 scope.go:117] "RemoveContainer" containerID="4b030d59fda5416b5c985899ffb18bb14b917ce283a3e8fc5f47894a41e0e3de" Jul 16 17:02:19.480050 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:19.479900 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:02:19.480155 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:19.480087 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:02:20.486341 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:20.486315 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:02:20.486737 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:20.486495 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:02:24.407007 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:24.406964 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 17:02:24.407429 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:24.407381 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:02:24.407576 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:24.407557 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:02:29.743373 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:29.743340 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:02:29.743815 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:29.743499 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:02:36.743042 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:36.743009 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:02:36.743460 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:36.743238 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:02:44.743347 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:44.743312 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:02:44.743727 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:44.743474 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:02:50.636541 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:50.636515 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 17:02:50.636965 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:50.636586 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 17:02:50.642892 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:50.642873 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 17:02:50.643014 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:50.642878 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 17:02:51.742834 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:51.742799 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:02:51.743197 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:51.742976 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:02:56.743395 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:02:56.743365 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:02:56.745849 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:02:56.743520 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:03:06.743354 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:03:06.743315 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:03:06.743887 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:03:06.743574 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:03:11.742662 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:03:11.742628 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:03:11.743038 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:03:11.742811 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:03:19.742802 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:03:19.742730 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:03:19.743261 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:03:19.742918 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:03:22.742609 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:03:22.742580 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:03:22.743076 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:03:22.742814 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:03:32.742722 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:03:32.742692 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:03:32.743173 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:03:32.742872 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:03:36.742650 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:03:36.742610 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:03:36.743084 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:03:36.742812 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:03:45.743168 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:03:45.743134 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:03:45.743662 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:03:45.743343 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:03:49.742972 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:03:49.742937 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:03:49.743395 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:03:49.743118 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:04:00.744669 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:00.744634 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:04:00.745268 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:00.744683 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:04:00.745268 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:00.744830 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:04:00.745268 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:00.744867 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:04:14.742392 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:14.742354 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:04:14.742981 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:14.742523 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:04:15.742308 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:15.742270 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:04:15.742518 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:15.742497 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:04:25.742265 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:25.742204 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:04:25.742696 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:25.742481 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:04:27.742431 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:27.742400 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:04:27.742792 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:27.742611 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:04:36.743354 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:36.743319 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:04:36.743823 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:36.743561 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:04:39.743172 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:39.743136 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:04:39.743569 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:39.743340 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:04:48.742605 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:48.742527 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:04:48.743055 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:48.742842 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:04:50.125100 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:50.125063 2580 generic.go:356] "Generic (PLEG): container finished" podID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" exitCode=1 Jul 16 17:04:50.125549 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:50.125103 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerDied","Data":"8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7"} Jul 16 17:04:50.125549 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:50.125160 2580 scope.go:117] "RemoveContainer" containerID="f2f8bf471f74473a1b93fe9933ed487f884232125a72a27581f0eae8a611f7ba" Jul 16 17:04:50.125549 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:50.125506 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:04:50.125717 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:50.125697 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:04:54.391868 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:54.391830 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 17:04:54.392304 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:54.391887 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 17:04:54.392304 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:54.392171 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:04:54.392402 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:54.392383 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:04:54.742652 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:04:54.742572 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:04:54.742804 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:04:54.742759 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:05:07.742994 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:07.742961 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:05:07.743425 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:07.743143 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:05:08.743131 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:08.743090 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:05:10.215467 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:10.215436 2580 generic.go:356] "Generic (PLEG): container finished" podID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" exitCode=1 Jul 16 17:05:10.215849 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:10.215511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" event={"ID":"a9e3cba8-e12a-4f5a-b3c3-030c5dedce75","Type":"ContainerDied","Data":"adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1"} Jul 16 17:05:10.215849 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:10.215567 2580 scope.go:117] "RemoveContainer" containerID="36b8c6ff115dfa7089ee625ff968fa47c7c0d4f12b039fdec91b987cce41b3eb" Jul 16 17:05:10.215979 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:10.215883 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:05:10.216120 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:10.216094 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:05:13.473345 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:13.473309 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 17:05:13.473824 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:13.473727 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:05:13.473970 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:13.473946 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:05:14.407339 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:14.407310 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" Jul 16 17:05:14.407645 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:14.407632 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:05:14.407814 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:14.407797 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:05:20.744829 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:20.744797 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:05:20.745410 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:20.745024 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:05:27.743161 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:27.743124 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:05:27.743541 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:27.743339 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:05:33.743132 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:33.743097 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:05:33.743618 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:33.743301 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:05:39.743338 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:39.743300 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:05:39.743813 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:39.743485 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:05:47.742755 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:47.742722 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:05:47.743158 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:47.742904 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:05:51.743233 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:51.743198 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:05:51.743612 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:51.743416 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:05:59.742584 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:05:59.742551 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:05:59.742955 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:05:59.742745 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:06:03.743316 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:03.743277 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:06:03.743702 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:03.743481 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:06:10.744791 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:10.744762 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:06:10.745309 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:10.744909 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:06:14.742480 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:14.742400 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:06:14.742839 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:14.742602 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:06:23.743101 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:23.743069 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:06:23.743497 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:23.743259 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:06:27.743269 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:27.743237 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:06:27.743629 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:27.743407 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:06:37.743243 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:37.743179 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:06:37.743693 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:37.743430 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:06:39.742927 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:39.742896 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:06:39.743336 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:39.743056 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:06:48.743146 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:48.743115 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:06:48.743648 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:48.743321 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:06:51.742911 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:06:51.742870 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:06:51.743326 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:06:51.743030 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:07:00.744620 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:00.744590 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:07:00.745085 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:00.744818 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:07:04.743159 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:04.743129 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:07:04.743573 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:04.743344 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:07:11.742479 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:11.742443 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:07:11.742846 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:11.742682 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:07:18.742379 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:18.742347 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:07:18.742747 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:18.742542 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:07:23.742447 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:23.742414 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:07:23.743010 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:23.742588 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:07:30.744655 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:30.744625 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:07:30.745038 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:30.744796 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:07:38.743316 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:38.743279 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:07:38.743719 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:38.743447 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:07:42.742865 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:42.742790 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:07:42.743278 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:42.742997 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:07:50.669323 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:50.669297 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 17:07:50.670486 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:50.670465 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 17:07:50.675315 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:50.675297 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 17:07:50.676442 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:50.676422 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 17:07:52.742385 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:52.742358 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:07:52.742757 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:52.742541 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:07:56.742378 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:07:56.742344 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:07:56.742935 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:07:56.742588 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:08:05.742371 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:05.742341 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:08:05.744849 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:05.742511 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:08:07.743085 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:07.743050 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:08:07.743540 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:07.743247 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:08:16.743291 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:16.743256 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:08:16.743656 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:16.743440 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:08:21.742865 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:21.742825 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:08:21.743351 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:21.743036 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:08:27.742427 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:27.742394 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:08:27.742883 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:27.742555 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:08:33.742421 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:33.742390 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:08:33.742808 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:33.742590 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:08:38.743384 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:38.743343 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:08:38.743838 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:38.743565 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:08:45.742799 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:45.742755 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:08:45.743295 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:45.743007 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:08:53.742422 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:08:53.742389 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:08:53.742814 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:08:53.742554 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:09:00.745865 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:00.745831 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:09:00.746391 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:00.746007 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:09:05.742637 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:05.742602 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:09:05.743027 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:05.742773 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:09:10.724657 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:10.724631 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-7fcc57dcd5-56xbm_a9e3cba8-e12a-4f5a-b3c3-030c5dedce75/manager/6.log" Jul 16 17:09:15.742478 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:15.742444 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:09:15.742857 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:15.742626 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:09:19.742866 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:19.742834 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:09:19.743286 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:19.743008 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:09:26.742625 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:26.742589 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:09:26.743005 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:26.742829 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:09:30.746378 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:30.746342 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:09:30.746799 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:30.746514 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:09:37.742475 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:37.742433 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:09:37.743006 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:37.742672 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:09:39.895014 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:39.894981 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vvrx9_27c86020-4e43-4edb-a525-cc87067db0af/global-pull-secret-syncer/0.log" Jul 16 17:09:40.115962 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:40.115923 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vfwdl_ae9cca3b-0682-44d8-a759-70ebef4ed6a2/konnectivity-agent/0.log" Jul 16 17:09:40.254904 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:40.254811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-73.ec2.internal_b6f3facf9c1c8cc108a10ba497ba47ba/haproxy/0.log" Jul 16 17:09:44.106484 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.106441 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc191bf-9359-4c25-8d15-f9e4c7eaa37b/alertmanager/0.log" Jul 16 17:09:44.132720 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.132687 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc191bf-9359-4c25-8d15-f9e4c7eaa37b/config-reloader/0.log" Jul 16 17:09:44.159465 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.159433 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc191bf-9359-4c25-8d15-f9e4c7eaa37b/kube-rbac-proxy-web/0.log" Jul 16 17:09:44.185367 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.185339 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc191bf-9359-4c25-8d15-f9e4c7eaa37b/kube-rbac-proxy/0.log" Jul 16 17:09:44.213482 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.213451 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc191bf-9359-4c25-8d15-f9e4c7eaa37b/kube-rbac-proxy-metric/0.log" Jul 16 17:09:44.241357 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.241329 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc191bf-9359-4c25-8d15-f9e4c7eaa37b/prom-label-proxy/0.log" Jul 16 17:09:44.286112 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.286077 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cdc191bf-9359-4c25-8d15-f9e4c7eaa37b/init-config-reloader/0.log" Jul 16 17:09:44.495766 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.495675 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-svk85_ea9931d2-f3c9-412d-a10f-e31bca02dbc0/monitoring-plugin/0.log" Jul 16 17:09:44.701789 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.701757 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tbvww_a8efa51e-168d-4d46-9def-0d930b5fdf21/node-exporter/0.log" Jul 16 17:09:44.729811 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.729773 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tbvww_a8efa51e-168d-4d46-9def-0d930b5fdf21/kube-rbac-proxy/0.log" Jul 16 17:09:44.742603 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.742569 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:09:44.742763 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:44.742737 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:09:44.757707 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:44.757630 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tbvww_a8efa51e-168d-4d46-9def-0d930b5fdf21/init-textfile/0.log" Jul 16 17:09:45.313358 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:45.313329 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d79f8877c-gh8kx_1d12c1d6-f490-46d4-a002-76be774b1e4e/thanos-query/0.log" Jul 16 17:09:45.351674 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:45.351644 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d79f8877c-gh8kx_1d12c1d6-f490-46d4-a002-76be774b1e4e/kube-rbac-proxy-web/0.log" Jul 16 17:09:45.383096 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:45.383058 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d79f8877c-gh8kx_1d12c1d6-f490-46d4-a002-76be774b1e4e/kube-rbac-proxy/0.log" Jul 16 17:09:45.416960 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:45.416934 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d79f8877c-gh8kx_1d12c1d6-f490-46d4-a002-76be774b1e4e/prom-label-proxy/0.log" Jul 16 17:09:45.450864 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:45.450809 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d79f8877c-gh8kx_1d12c1d6-f490-46d4-a002-76be774b1e4e/kube-rbac-proxy-rules/0.log" Jul 16 17:09:45.483529 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:45.483500 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-d79f8877c-gh8kx_1d12c1d6-f490-46d4-a002-76be774b1e4e/kube-rbac-proxy-metrics/0.log" Jul 16 17:09:47.158616 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.158588 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/1.log" Jul 16 17:09:47.166071 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.166042 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-lwlph_24ac069c-552e-45af-ad95-5c6068956067/console-operator/2.log" Jul 16 17:09:47.867936 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.867901 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv"] Jul 16 17:09:47.871117 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.871101 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:47.873705 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.873679 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wt4r\"/\"kube-root-ca.crt\"" Jul 16 17:09:47.873815 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.873723 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9wt4r\"/\"default-dockercfg-nhttb\"" Jul 16 17:09:47.874547 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.874531 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9wt4r\"/\"openshift-service-ca.crt\"" Jul 16 17:09:47.883549 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.883523 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv"] Jul 16 17:09:47.971834 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.971794 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-lib-modules\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:47.971834 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.971842 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-proc\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:47.972067 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.971880 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll4p8\" (UniqueName: \"kubernetes.io/projected/45390ec0-93aa-4490-b2d9-19f169341002-kube-api-access-ll4p8\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:47.972067 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.971910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-podres\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:47.972067 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:47.971941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-sys\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072390 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072347 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-proc\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072548 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072407 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll4p8\" (UniqueName: \"kubernetes.io/projected/45390ec0-93aa-4490-b2d9-19f169341002-kube-api-access-ll4p8\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072548 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072436 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-podres\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072548 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072474 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-sys\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072548 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072503 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-proc\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072548 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-lib-modules\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072731 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072570 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-sys\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072731 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072605 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-podres\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.072731 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.072608 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45390ec0-93aa-4490-b2d9-19f169341002-lib-modules\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.082058 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.082029 2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll4p8\" (UniqueName: \"kubernetes.io/projected/45390ec0-93aa-4490-b2d9-19f169341002-kube-api-access-ll4p8\") pod \"perf-node-gather-daemonset-kxmnv\" (UID: \"45390ec0-93aa-4490-b2d9-19f169341002\") " pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.150609 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.150530 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-c4hvc_a7537baa-1da8-4157-9555-7b20d63227b2/volume-data-source-validator/0.log" Jul 16 17:09:48.181569 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.181524 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.314254 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.314207 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv"] Jul 16 17:09:48.316375 ip-10-0-136-73 kubenswrapper[2580]: W0716 17:09:48.316349 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod45390ec0_93aa_4490_b2d9_19f169341002.slice/crio-7bb07feb2d4ae2552a26819cf18bc06be4d8f01ec12b70cdc9f1985bd7489d21 WatchSource:0}: Error finding container 7bb07feb2d4ae2552a26819cf18bc06be4d8f01ec12b70cdc9f1985bd7489d21: Status 404 returned error can't find the container with id 7bb07feb2d4ae2552a26819cf18bc06be4d8f01ec12b70cdc9f1985bd7489d21 Jul 16 17:09:48.433017 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.432928 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" event={"ID":"45390ec0-93aa-4490-b2d9-19f169341002","Type":"ContainerStarted","Data":"1dec78a1af2a02fe7e7486e4f6e3fd30f96e7de84401f95ff3f2529c45e6d773"} Jul 16 17:09:48.433017 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.432979 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" event={"ID":"45390ec0-93aa-4490-b2d9-19f169341002","Type":"ContainerStarted","Data":"7bb07feb2d4ae2552a26819cf18bc06be4d8f01ec12b70cdc9f1985bd7489d21"} Jul 16 17:09:48.433245 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.433052 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:48.452743 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.452687 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" podStartSLOduration=1.452668027 podStartE2EDuration="1.452668027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:09:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:09:48.451566507 +0000 UTC m=+1018.263713259" watchObservedRunningTime="2026-07-16 17:09:48.452668027 +0000 UTC m=+1018.264814819" Jul 16 17:09:48.742693 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:48.742615 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:09:48.742839 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:09:48.742811 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:09:49.178238 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:49.178191 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xp7r7_69ec21d6-42fd-4fac-aa04-dee1a3cf73d1/dns/0.log" Jul 16 17:09:49.201055 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:49.201027 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xp7r7_69ec21d6-42fd-4fac-aa04-dee1a3cf73d1/kube-rbac-proxy/0.log" Jul 16 17:09:49.226724 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:49.226688 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-klbb5_20aa97c5-7150-489a-8fed-362759235062/dns-node-resolver/0.log" Jul 16 17:09:49.738385 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:49.738354 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-689cd77488-8bgjp_208c6c75-4bdd-4022-9c80-8c869242ebe1/registry/0.log" Jul 16 17:09:49.816259 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:49.816211 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sxph4_6fd8a22e-e8ee-4b1a-972b-dd45feb99961/node-ca/0.log" Jul 16 17:09:51.116588 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:51.116557 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vk2h_84968745-2495-402d-b079-4fc7cdcdb979/serve-healthcheck-canary/0.log" Jul 16 17:09:51.540270 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:51.540171 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szmk6_ef991e78-1b63-4be6-8085-e2ce75e34b1d/kube-rbac-proxy/0.log" Jul 16 17:09:51.563409 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:51.563372 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szmk6_ef991e78-1b63-4be6-8085-e2ce75e34b1d/exporter/0.log" Jul 16 17:09:51.586206 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:51.586176 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szmk6_ef991e78-1b63-4be6-8085-e2ce75e34b1d/extractor/0.log" Jul 16 17:09:53.901291 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:53.901255 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-d55957fc4-4vrfh_005c0f5c-5f17-4629-bf8d-6b0d87654e98/manager/6.log" Jul 16 17:09:53.901291 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:53.901290 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-d55957fc4-4vrfh_005c0f5c-5f17-4629-bf8d-6b0d87654e98/manager/6.log" Jul 16 17:09:53.922984 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:53.922948 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-7fcc57dcd5-56xbm_a9e3cba8-e12a-4f5a-b3c3-030c5dedce75/manager/6.log" Jul 16 17:09:53.923738 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:53.923721 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-7fcc57dcd5-56xbm_a9e3cba8-e12a-4f5a-b3c3-030c5dedce75/manager/6.log" Jul 16 17:09:54.447236 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:54.447200 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9wt4r/perf-node-gather-daemonset-kxmnv" Jul 16 17:09:58.097541 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:58.097506 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-ls8hm_ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee/migrator/0.log" Jul 16 17:09:58.119844 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:58.119815 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-ls8hm_ce182170-f5f0-4bc2-89ff-65dd1f2bd6ee/graceful-termination/0.log" Jul 16 17:09:58.461130 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:58.461077 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-dzqkl_bfc65de4-7e1b-480a-a8db-7aa45c42fbba/kube-storage-version-migrator-operator/1.log" Jul 16 17:09:58.462919 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:58.462885 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-dzqkl_bfc65de4-7e1b-480a-a8db-7aa45c42fbba/kube-storage-version-migrator-operator/0.log" Jul 16 17:09:58.742975 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:58.742895 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:09:58.743214 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:58.743200 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 17:09:59.871967 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:59.871934 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qstln_e950fbbf-eec7-444e-8931-97364a85ccee/kube-multus-additional-cni-plugins/0.log" Jul 16 17:09:59.900503 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:59.900470 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qstln_e950fbbf-eec7-444e-8931-97364a85ccee/egress-router-binary-copy/0.log" Jul 16 17:09:59.928210 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:59.928183 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qstln_e950fbbf-eec7-444e-8931-97364a85ccee/cni-plugins/0.log" Jul 16 17:09:59.956778 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:59.956733 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qstln_e950fbbf-eec7-444e-8931-97364a85ccee/bond-cni-plugin/0.log" Jul 16 17:09:59.983346 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:09:59.983315 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qstln_e950fbbf-eec7-444e-8931-97364a85ccee/routeoverride-cni/0.log" Jul 16 17:10:00.010314 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.010286 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qstln_e950fbbf-eec7-444e-8931-97364a85ccee/whereabouts-cni-bincopy/0.log" Jul 16 17:10:00.054800 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.054713 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qstln_e950fbbf-eec7-444e-8931-97364a85ccee/whereabouts-cni/0.log" Jul 16 17:10:00.100194 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.100149 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-fwl75_d3da308f-8883-4d50-bce7-0a07d8b731c3/kube-multus/0.log" Jul 16 17:10:00.230203 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.230164 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bp45h_2397c0af-6512-4e92-955b-101a5a49a461/network-metrics-daemon/0.log" Jul 16 17:10:00.276533 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.276496 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bp45h_2397c0af-6512-4e92-955b-101a5a49a461/kube-rbac-proxy/0.log" Jul 16 17:10:00.486158 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.486128 2580 generic.go:356] "Generic (PLEG): container finished" podID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" containerID="2d6e1c548052f65a86d19e89dbe3144ed01e24165e36aecc0fc492ac8d3b4a9c" exitCode=1 Jul 16 17:10:00.486345 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.486207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" event={"ID":"005c0f5c-5f17-4629-bf8d-6b0d87654e98","Type":"ContainerDied","Data":"2d6e1c548052f65a86d19e89dbe3144ed01e24165e36aecc0fc492ac8d3b4a9c"} Jul 16 17:10:00.486345 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.486293 2580 scope.go:117] "RemoveContainer" containerID="8bd3b281b4db6e34f3448c24fffe106937096f815641d75003cf1eee0ac3edc7" Jul 16 17:10:00.486629 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:00.486613 2580 scope.go:117] "RemoveContainer" containerID="2d6e1c548052f65a86d19e89dbe3144ed01e24165e36aecc0fc492ac8d3b4a9c" Jul 16 17:10:00.486829 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:10:00.486806 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98" Jul 16 17:10:01.593286 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.593252 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-controller/0.log" Jul 16 17:10:01.614883 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.614839 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/1.log" Jul 16 17:10:01.615622 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.615597 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovn-acl-logging/0.log" Jul 16 17:10:01.638326 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.638296 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/kube-rbac-proxy-node/0.log" Jul 16 17:10:01.668815 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.668783 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 17:10:01.692980 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.692944 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/northd/0.log" Jul 16 17:10:01.714692 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.714631 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/nbdb/0.log" Jul 16 17:10:01.742252 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.742205 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/sbdb/0.log" Jul 16 17:10:01.799832 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:01.799793 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-k5jjk_9fd8ed59-c971-4072-8b19-08ec7c7d913e/ovnkube-controller/0.log" Jul 16 17:10:02.830682 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:02.830653 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-6n9c5_3cfd8afe-9393-4e0d-8271-37acee2a7eb1/network-check-target-container/0.log" Jul 16 17:10:03.742941 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:03.742904 2580 scope.go:117] "RemoveContainer" containerID="adfbe2ead0a15dc3a9da14e6f13a1c0d571d4076d8347cd2e6aabdb642367cf1" Jul 16 17:10:03.743113 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:10:03.743067 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=llmisvc-controller-manager-7fcc57dcd5-56xbm_kserve(a9e3cba8-e12a-4f5a-b3c3-030c5dedce75)\"" pod="kserve/llmisvc-controller-manager-7fcc57dcd5-56xbm" podUID="a9e3cba8-e12a-4f5a-b3c3-030c5dedce75" Jul 16 17:10:03.940948 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:03.940917 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-rtzbr_decc38bf-d7d6-4f4d-b7a3-bea0a92f0990/iptables-alerter/0.log" Jul 16 17:10:04.391273 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:04.391238 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 17:10:04.391451 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:04.391299 2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" Jul 16 17:10:04.391630 ip-10-0-136-73 kubenswrapper[2580]: I0716 17:10:04.391616 2580 scope.go:117] "RemoveContainer" containerID="2d6e1c548052f65a86d19e89dbe3144ed01e24165e36aecc0fc492ac8d3b4a9c" Jul 16 17:10:04.391802 ip-10-0-136-73 kubenswrapper[2580]: E0716 17:10:04.391784 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-d55957fc4-4vrfh_kserve(005c0f5c-5f17-4629-bf8d-6b0d87654e98)\"" pod="kserve/kserve-controller-manager-d55957fc4-4vrfh" podUID="005c0f5c-5f17-4629-bf8d-6b0d87654e98"